Blog Company answers
Company answers
How Can AI Answer From Your Company's Information and Know When It Is Missing?
An assistant can quote a real document and still give the wrong answer. Here is what has to be true before a company answer is right, and what a useful "I cannot confirm this" looks like.
We read the official documentation of four tools people use to answer from company documents: Microsoft Copilot Studio, Intercom Fin, NotebookLM and Claude. Each one refreshes and points to sources in its own way, and none of them decides on its own which of your documents is the current rule. What we offer is a way to check: a source register and a 30-question test you can run on one repeated question.
4
tools whose documentation we read, checked in October 2026
30
questions in the proposed test, written and approved before the first run
90
answers per setup when each of the 30 test questions runs three times (Teamulate method)
The thesis
A reliable company answer needs a current, applicable source, a claim you can check against it, and a clear route when the information is missing. Uploading the documents is only the start.
The scene
Two versions of the terms, one confident answer
A teaching example.
A customer asks whether a service includes weekend visits. Your shared folder holds two versions of the terms: one from last year and a newer draft nobody approved. The assistant finds a clear sentence in one of them and answers with confidence.
The sentence is real. The answer may still be wrong, because it came from the version that is no longer in force, or from the draft that never was. Nothing about the quote tells the customer which.
That is the gap this article is about. Having a file, finding a passage, knowing the current rule and giving the right answer are four different things.
How we looked
Documentation from four tools, read side by side
What the vendors document, checked October 27, 2026.
We read the official help pages of four tools people use to answer from company documents (Microsoft Copilot Studio, Intercom Fin, NotebookLM and Claude), plus Microsoft's guidance on evaluating answers and Anthropic's guidance on reducing unsupported answers. We checked them on October 27, 2026.
- What this shows: how each tool says it refreshes content, points to sources and handles questions it cannot support.
- Limits: this compares what each tool's documentation says. Accuracy depends on your own documents and setup, so test it with your own questions.
What the tools say
Each tool refreshes on its own clock
A change in your document may not reach the assistant straight away.
How four tools describe freshness and sources
| Tool | What the documentation says | What to check in your setup |
|---|---|---|
| Copilot Studio | SharePoint files copied into the agent are synchronized every four to six hours; a direct SharePoint mode queries live search instead | Which mode you use, and when a change actually reached the agent |
| Intercom Fin | Website content syncs about once a week and can be re-synced by hand | Whether a page you changed has synced, and to the right audience |
| NotebookLM | Since May 26, 2026, Google Docs, Sheets and Slides added from Drive update automatically | Whether a key condition sits in a comment, an image or another page |
| Claude Citations | Returns pointers to the exact passages in the documents you provide | Whether that passage is current and applies to this case |
Documented behaviour, checked October 27, 2026. Not a ranking.
Microsoft's evaluation guidance scores retrieval, how well the answer is supported by what was retrieved, and completeness as separate things. A good score on one says nothing about the others. Copilot Studio also notes that switching off answers without a source does not stop every use of general knowledge.
Three failures
A missing rule, a missed search, the wrong rule
Each one needs a different fix.
- There is no rule. Nobody wrote the answer down. The fix is for the owner to write it, not for the assistant to guess.
- The rule exists but was not found. The file is there, but the search missed it, or the key condition sits somewhere the tool does not read. The fix is in how the source is kept.
- The wrong rule was found. An old version, a draft, or a rule for another service was applied as current. The fix is labelled versions and scope.
"I could not find an answer" can mean any of the three, or that the assistant had no access. A good assistant says what it could not establish, without claiming the information does not exist.
The method
Which document decides the answer
A source register, one row per deciding document.
Source register fields
| Field | What goes here |
|---|---|
| Source and location | A stable name and the allowed path to the original |
| Owner and approver | Who maintains it and who signs off real changes |
| Status | Draft, approved, replaced, withdrawn or pending review |
| Valid from and to | When the rule starts and stops applying |
| Applies to | Service, product, location, channel and customer group |
| Replaces | Which exact older version this one replaces |
| Last changed and last checked | When the original changed and when someone tested it with a question |
A Teamulate working method, not a measured result.
Edit date is not effective date. A newer file can be a draft, and the rule in force can be older. When scope or validity is missing for a price or a term, send it for review instead of picking the newest file.
Routes
Answer, ask, or hand it to a person
The right route depends on what the sources support.
The right route for each situation
| Situation | Right route | Example wording |
|---|---|---|
| A current source covers it | Answer and point to the passage | "Under the current procedure for this service..." |
| One deciding detail is missing | Ask one precise question | "Which service and which location is this for?" |
| Only part is supported | Answer that part, name the gap | "X is confirmed. The documents I can see do not cover Y." |
| Two current rules conflict | Send both to the owner | "The two documents that apply give different terms." |
| A special promise is asked for | A person with authority decides | "This needs confirmation for your specific case." |
A Teamulate working method.
Do not turn every unknown into a general "contact us". A useful hand-off carries the question, what is known, what is missing, the sources checked and who acts next.
Check your own
A 30-question test before you rely on it
Write the expected answers first.
Pick one repeated question or group of questions. Write 30 test questions and the expected answers, and have the person who owns the rules approve them before anything runs.
The proposed test set
| Group | Questions | What it tests |
|---|---|---|
| Answerable | 12 | A direct fact, a reworded question, an exception, a table, an exact code, two sources combined |
| Needs a question or a person | 6 | Unconfirmed price, availability or timeline, missing context |
| Conflicting | 6 | Two incompatible sources, a draft, a custom scope |
| Old or future terms | 6 | An expired offer, a withdrawn document, a future version, a slow sync |
A practical starting scope, not a statistically calculated sample.
Run each question three times in a fresh conversation, which gives 90 answers per setup. The three runs of one question are not independent cases, so also count how many of the 30 questions pass every run. Count a refusal as a failure when a sufficient, current source was there.
Support
What a marketing team with AI support can keep running, and what stays with you
Start with one process and the tools you have.
Start small: one repeated question, the documents that decide it, the tool you already use, and a person reviewing drafts. If a tidy FAQ solves it more cheaply, that is a good answer too. Add integrations only when the data or the refresh you need is missing.
What stays with you: the rules themselves, and decisions about prices, discounts and promises.
For B2B teams, keeping company knowledge current is part of the marketing operations our AI marketing team runs alongside you, with every step visible. You can see how our workflows run. To talk it through, request a demo.
Checklist
Checklist: before customers see answers
Run it on one repeated question.
- One repeated question is chosen, with an owner.
- Every deciding document has scope, status and dates.
- The 30 questions and expected answers were approved before the first run.
- Every confident wrong answer is classified: missing rule, not found, wrong rule, unsupported addition, missed hand-off.
- Each hand-off carries what is known, what is missing and who acts next.
- Someone re-runs the set after any change of model, tool or document.
- The first stage is drafts reviewed by a person.
Key terms and facts
The short version
- Deciding source
- A document that is approved to settle a specific question, with an owner, a scope and dates when it applies.
- Supported answer
- An answer whose important claims can each be matched to a passage in a deciding source.
- Hand-off
- Passing a question to the person who owns the rule, with what is known, what is missing and which sources were checked.
- Documented
- What a vendor's own help page says the product does. It does not show how any one business has set it up.
Key facts
- TEAMULATE REVIEWofficial documentation for Copilot Studio, Intercom Fin, NotebookLM and Claude, checked October 27, 2026.
- DOCUMENTEDCopilot Studio says SharePoint files copied into an agent are synchronized every four to six hours.
- DOCUMENTEDIntercom says website content synced to Fin updates about once a week, with a manual re-sync option.
- TEAMULATE METHODa 30-question test (12 answerable, 6 needing a question or a person, 6 conflicting, 6 old or future terms).
Takeaways
What to do with this
A quote is not an answer
A real passage can still be old, a draft, or written for another case.
Know the refresh clock
Each tool updates on its own schedule, so a change may not reach the assistant straight away.
Name the gap
When the rule is missing, a useful answer says what is unknown and who will resolve it.
Test before you trust
Thirty approved questions, run three times, show failures, refusals and hand-offs separately.
Questions and answers
Common questions
Can AI answer customer questions from our own documents?
It can find passages and draft answers, but it does not decide on its own which document is the current rule. Label versions, scope and dates, and test it on a fixed set of questions before you rely on it.
Why does an AI assistant give an old answer after we changed a document?
Tools refresh on different schedules. Copilot Studio documents a four to six hour sync for copied SharePoint files, and Intercom Fin documents a weekly website sync. Check when the change actually reached the assistant.
Is a citation proof that the answer is right?
No. A citation shows where the text came from. You still need to check that the passage is current, applies to this case, and does not leave out an exception.
What should an assistant say when the information is missing?
Name what is confirmed, what is missing and who will resolve it. A general "contact us" or a guess both leave the customer without a next step.
How do I test an AI assistant before customers use it?
Write about 30 questions with approved expected answers, including questions it should not answer and conflicting or old documents. Run each one three times and count failures, refusals and hand-offs separately.
Sources
Named sources
Teamulate review of official vendor documentation and guidance, checked October 27, 2026:
- Microsoft Learn: Unstructured data as a knowledge source (Copilot Studio): https://learn.microsoft.com/en-us/microsoft-copilot-studio/knowledge-unstructured-data
- Microsoft Learn: Knowledge sources summary (Copilot Studio): https://learn.microsoft.com/en-us/microsoft-copilot-studio/knowledge-copilot-studio
- Microsoft Learn: RAG evaluators: https://learn.microsoft.com/en-us/azure/foundry/concepts/evaluation-evaluators/rag-evaluators
- Intercom Help: Add your content for Fin AI Agent: https://www.intercom.com/help/en/articles/7837514-add-your-content-for-fin-ai-agent
- Google Workspace Updates: Automatic Drive syncing in NotebookLM (May 26, 2026): https://workspaceupdates.googleblog.com/2026/05/keep-your-sources-up-to-date-with-automatic-Drive-syncing-in-NotebookLM.html
- Google Help: Add or discover new sources for your notebook: https://support.google.com/gemininotebook/answer/16215270
- Anthropic: Reduce hallucinations: https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/reduce-hallucinations
- Anthropic: Citations: https://platform.claude.com/docs/en/build-with-claude/citations
Download the check
Pick one repeated customer question, find the document that should decide the answer, and test whether an AI assistant answers it, asks, or hands it to a person at the right moment.
Download The Company Answer Check (PDF)