Blog Company answers

Company answers

How Can AI Answer From Your Company's Information and Know When It Is Missing?

An assistant can quote a real document and still give the wrong answer. Here is what has to be true before a company answer is right, and what a useful "I cannot confirm this" looks like.

Bright marble desk by a city window with an open blank binder in front of five frosted glass plaques on glowing bases tinted teal, gold, violet, coral and blue, labeled Answer and point to the passage, Ask one precise question and A person with authority decides, with a magnifying glass, stacked notebooks, a ZZ plant and a coffee cup, beside the title How Can AI Answer From Your Company's Information and Know When It Is Missing?

We read the official documentation of four tools people use to answer from company documents: Microsoft Copilot Studio, Intercom Fin, NotebookLM and Claude. Each one refreshes and points to sources in its own way, and none of them decides on its own which of your documents is the current rule. What we offer is a way to check: a source register and a 30-question test you can run on one repeated question.

4

tools whose documentation we read, checked in October 2026

30

questions in the proposed test, written and approved before the first run

90

answers per setup when each of the 30 test questions runs three times (Teamulate method)

The thesis

A reliable company answer needs a current, applicable source, a claim you can check against it, and a clear route when the information is missing. Uploading the documents is only the start.

The scene

Two versions of the terms, one confident answer

A teaching example.

A customer asks whether a service includes weekend visits. Your shared folder holds two versions of the terms: one from last year and a newer draft nobody approved. The assistant finds a clear sentence in one of them and answers with confidence.

The sentence is real. The answer may still be wrong, because it came from the version that is no longer in force, or from the draft that never was. Nothing about the quote tells the customer which.

That is the gap this article is about. Having a file, finding a passage, knowing the current rule and giving the right answer are four different things.

How we looked

Documentation from four tools, read side by side

What the vendors document, checked October 27, 2026.

We read the official help pages of four tools people use to answer from company documents (Microsoft Copilot Studio, Intercom Fin, NotebookLM and Claude), plus Microsoft's guidance on evaluating answers and Anthropic's guidance on reducing unsupported answers. We checked them on October 27, 2026.

  • What this shows: how each tool says it refreshes content, points to sources and handles questions it cannot support.
  • Limits: this compares what each tool's documentation says. Accuracy depends on your own documents and setup, so test it with your own questions.

What the tools say

Each tool refreshes on its own clock

A change in your document may not reach the assistant straight away.

How four tools describe freshness and sources

ToolWhat the documentation saysWhat to check in your setup
Copilot StudioSharePoint files copied into the agent are synchronized every four to six hours; a direct SharePoint mode queries live search insteadWhich mode you use, and when a change actually reached the agent
Intercom FinWebsite content syncs about once a week and can be re-synced by handWhether a page you changed has synced, and to the right audience
NotebookLMSince May 26, 2026, Google Docs, Sheets and Slides added from Drive update automaticallyWhether a key condition sits in a comment, an image or another page
Claude CitationsReturns pointers to the exact passages in the documents you provideWhether that passage is current and applies to this case

Documented behaviour, checked October 27, 2026. Not a ranking.

Microsoft's evaluation guidance scores retrieval, how well the answer is supported by what was retrieved, and completeness as separate things. A good score on one says nothing about the others. Copilot Studio also notes that switching off answers without a source does not stop every use of general knowledge.

Three failures

A missing rule, a missed search, the wrong rule

Each one needs a different fix.

  • There is no rule. Nobody wrote the answer down. The fix is for the owner to write it, not for the assistant to guess.
  • The rule exists but was not found. The file is there, but the search missed it, or the key condition sits somewhere the tool does not read. The fix is in how the source is kept.
  • The wrong rule was found. An old version, a draft, or a rule for another service was applied as current. The fix is labelled versions and scope.

"I could not find an answer" can mean any of the three, or that the assistant had no access. A good assistant says what it could not establish, without claiming the information does not exist.

The method

Which document decides the answer

A source register, one row per deciding document.

Source register fields

FieldWhat goes here
Source and locationA stable name and the allowed path to the original
Owner and approverWho maintains it and who signs off real changes
StatusDraft, approved, replaced, withdrawn or pending review
Valid from and toWhen the rule starts and stops applying
Applies toService, product, location, channel and customer group
ReplacesWhich exact older version this one replaces
Last changed and last checkedWhen the original changed and when someone tested it with a question

A Teamulate working method, not a measured result.

Edit date is not effective date. A newer file can be a draft, and the rule in force can be older. When scope or validity is missing for a price or a term, send it for review instead of picking the newest file.

Routes

Answer, ask, or hand it to a person

The right route depends on what the sources support.

The right route for each situation

SituationRight routeExample wording
A current source covers itAnswer and point to the passage"Under the current procedure for this service..."
One deciding detail is missingAsk one precise question"Which service and which location is this for?"
Only part is supportedAnswer that part, name the gap"X is confirmed. The documents I can see do not cover Y."
Two current rules conflictSend both to the owner"The two documents that apply give different terms."
A special promise is asked forA person with authority decides"This needs confirmation for your specific case."

A Teamulate working method.

Do not turn every unknown into a general "contact us". A useful hand-off carries the question, what is known, what is missing, the sources checked and who acts next.

Check your own

A 30-question test before you rely on it

Write the expected answers first.

Pick one repeated question or group of questions. Write 30 test questions and the expected answers, and have the person who owns the rules approve them before anything runs.

The proposed test set

GroupQuestionsWhat it tests
Answerable12A direct fact, a reworded question, an exception, a table, an exact code, two sources combined
Needs a question or a person6Unconfirmed price, availability or timeline, missing context
Conflicting6Two incompatible sources, a draft, a custom scope
Old or future terms6An expired offer, a withdrawn document, a future version, a slow sync

A practical starting scope, not a statistically calculated sample.

Run each question three times in a fresh conversation, which gives 90 answers per setup. The three runs of one question are not independent cases, so also count how many of the 30 questions pass every run. Count a refusal as a failure when a sufficient, current source was there.

Support

What a marketing team with AI support can keep running, and what stays with you

Start with one process and the tools you have.

Start small: one repeated question, the documents that decide it, the tool you already use, and a person reviewing drafts. If a tidy FAQ solves it more cheaply, that is a good answer too. Add integrations only when the data or the refresh you need is missing.

What stays with you: the rules themselves, and decisions about prices, discounts and promises.

For B2B teams, keeping company knowledge current is part of the marketing operations our AI marketing team runs alongside you, with every step visible. You can see how our workflows run. To talk it through, request a demo.

Checklist

Checklist: before customers see answers

Run it on one repeated question.

  • One repeated question is chosen, with an owner.
  • Every deciding document has scope, status and dates.
  • The 30 questions and expected answers were approved before the first run.
  • Every confident wrong answer is classified: missing rule, not found, wrong rule, unsupported addition, missed hand-off.
  • Each hand-off carries what is known, what is missing and who acts next.
  • Someone re-runs the set after any change of model, tool or document.
  • The first stage is drafts reviewed by a person.

Key terms and facts

The short version

Deciding source
A document that is approved to settle a specific question, with an owner, a scope and dates when it applies.
Supported answer
An answer whose important claims can each be matched to a passage in a deciding source.
Hand-off
Passing a question to the person who owns the rule, with what is known, what is missing and which sources were checked.
Documented
What a vendor's own help page says the product does. It does not show how any one business has set it up.

Key facts

  • TEAMULATE REVIEWofficial documentation for Copilot Studio, Intercom Fin, NotebookLM and Claude, checked October 27, 2026.
  • DOCUMENTEDCopilot Studio says SharePoint files copied into an agent are synchronized every four to six hours.
  • DOCUMENTEDIntercom says website content synced to Fin updates about once a week, with a manual re-sync option.
  • TEAMULATE METHODa 30-question test (12 answerable, 6 needing a question or a person, 6 conflicting, 6 old or future terms).

Takeaways

What to do with this

A quote is not an answer

A real passage can still be old, a draft, or written for another case.

Know the refresh clock

Each tool updates on its own schedule, so a change may not reach the assistant straight away.

Name the gap

When the rule is missing, a useful answer says what is unknown and who will resolve it.

Test before you trust

Thirty approved questions, run three times, show failures, refusals and hand-offs separately.

Questions and answers

Common questions

Can AI answer customer questions from our own documents?

It can find passages and draft answers, but it does not decide on its own which document is the current rule. Label versions, scope and dates, and test it on a fixed set of questions before you rely on it.

Why does an AI assistant give an old answer after we changed a document?

Tools refresh on different schedules. Copilot Studio documents a four to six hour sync for copied SharePoint files, and Intercom Fin documents a weekly website sync. Check when the change actually reached the assistant.

Is a citation proof that the answer is right?

No. A citation shows where the text came from. You still need to check that the passage is current, applies to this case, and does not leave out an exception.

What should an assistant say when the information is missing?

Name what is confirmed, what is missing and who will resolve it. A general "contact us" or a guess both leave the customer without a next step.

How do I test an AI assistant before customers use it?

Write about 30 questions with approved expected answers, including questions it should not answer and conflicting or old documents. Run each one three times and count failures, refusals and hand-offs separately.

Sources

Named sources

Teamulate review of official vendor documentation and guidance, checked October 27, 2026:

Download the check

Pick one repeated customer question, find the document that should decide the answer, and test whether an AI assistant answers it, asks, or hands it to a person at the right moment.

Download The Company Answer Check (PDF)