Why Copilot Agents Show Different Sources to Every User

Published on August 19, 2026

You ask your Copilot agent for the latest remote work policy. Your manager asks the same question five minutes later. She gets three links; you get two. The answers differ, yet both are technically correct. This discrepancy is not a glitch; it is the system functioning exactly as designed. When you query an AI agent, you are not pulling from a static database. Instead, the agent filters sources in real time based on your identity, permissions, and the orchestration rules governing that conversation. Understanding how these layers work is key to achieving true AI answer transparency.

Why Copilot Agents Show Different Sources to Every User

The Permission Wall: Why Agent Answers Are Per-Person, Not Per-Agent

Screenshot of the Allow ungrounded responses setting in the Knowledge section.

Many teams assume a Copilot agent is a single entity with a fixed brain. That mental model breaks down the moment two users ask the same question. The system does not store one static answer; it constructs a response in real time based on who is asking. This is the core of Copilot source ranking: the engine filters available information through the lens of the individual user’s identity before generating text.

This process relies on Microsoft Entra ID to authenticate the specific person interacting with the agent. When a query is submitted, the system checks that user’s actual permissions in real time. It does not guess your role or rely on cached data from a previous session. Instead, it verifies access rights to every potential knowledge source. If you cannot see a SharePoint folder or a Dataverse table, the agent cannot see it either. Your access to enterprise data defines the boundary of the agent’s knowledge for that specific interaction.

Consider a simple scenario involving a question about “how to take time off.” A manager asking this question might receive a citation from the full compensation and benefits handbook, a document restricted to management-level staff. An intern asking the exact same question receives a citation from the general onboarding guide, which is accessible to all new hires. The underlying AI model is the same, and the question is identical, but the resulting source visibility is completely different. The agent is not giving a wrong answer to one person; it is giving a precise answer to each person based on what they are authorized to read.

This approach establishes a baseline for AI answer transparency. The system is transparent not just about what was found, but about who you are within the organizational hierarchy. It ensures that sensitive data, such as salary bands or internal strategy documents, never leaks into a response meant for a user without clearance. By tying source visibility directly to user identity, the agent acts as a compliant gateway rather than an open library. This dynamic filtering ensures that the AI respects your company’s data governance policies automatically, without requiring manual tagging or complex routing rules for every possible user role. The result is an experience where the agent feels personalized not because it remembers your preferences, but because it strictly adheres to your permissions.

The 25-Source Pruning: How Orchestration Mode Limits What AI Agents Can See

Screenshot of an agent's Overview page, focusing on the Knowledge section and highlighting the Web Search setting.

Understanding how an agent selects its references requires looking past the user interface to the underlying architecture. The specific mechanism governing this is often referred to as Copilot agent logic, a system that actively manages the volume of information the model processes. When you configure an agent, the orchestration mode dictates how these sources are handled, creating distinct boundaries for what the system can access and cite.

Classic vs. Generative: A Tale of Two Modes

The difference between modes is most visible in their rigidity. Classic mode is designed for strict, predictable flows, imposing hard caps on source quantity. For example, an agent in Classic mode can only search four URLs for SharePoint or website knowledge sources. This limit ensures that the system remains fast and focused, though it can feel restrictive for organizations with complex data structures.

Generative mode offers more flexibility, allowing agents to connect to a much larger ecosystem. Here, SharePoint and website sources can support up to 25 URLs each. This increased capacity allows for richer answers but introduces a new variable: relevance filtering. Because the system can now see more data, it must decide which pieces are actually useful for the current query.

The 25-Source Trigger

The critical constraint in Generative mode is not the number of sources you can connect, but what happens when you exceed them. If more than 25 distinct knowledge sources are configured, an internal GPT model prunes the list before the agent begins its search. This is a triage mechanism, not a random selection.

The model analyzes the user’s question and the available sources, then selects the 25 most relevant items to pass to the main answering model. This process directly impacts Source curation AI, as it determines which documents are in the active context. If a specific document is not deemed relevant by this preliminary step, the agent will not cite it, even if it contains the correct answer. This automatic filtering is a core component of Copilot source ranking, ensuring the system does not get overwhelmed by irrelevant data.

The Strategic Value of Uploaded Files

There is one exception to this pruning rule that makes it a vital tool for administrators. Files uploaded directly to the agent are exempt from the 25-source limit. In Generative mode, all uploaded documents are supported and remain in the active context regardless of how many other sources are configured.

This exemption turns uploaded files into a strategic asset. If a specific policy or manual is critical to every answer, uploading it directly ensures it is always available to the model. This guarantees that high-priority documents are never filtered out by the relevance triage, providing a layer of AI answer transparency that relies on explicit, manual curation rather than automated inference.

The Citation Gap: Why Correct Answers Sometimes Disappear

When the “Allow ungrounded responses” setting is turned off, the agent enforces a strict compliance rule: it must include an in-text citation to a knowledge source to provide an answer. If the model generates a response without this specific marker, the agent blocks the entire output. This behavior is the foundation of AI answer transparency, ensuring that every claim is traceable back to a verified document.

However, a common intermittent issue disrupts this process. The model may successfully retrieve the correct information from a source but fail to insert the required citation marker in the final text. In these cases, the agent withholds the response entirely, even though the underlying data is accurate. This is not a content error; it is a formatting or compliance failure. Because the model’s behavior is non-deterministic, the same question might yield a valid answer on one attempt and a blank response on the next, creating a confusing experience for end-users.

Mitigating Citation Failures

To stabilize this aspect of Copilot agent logic, you can adjust the system prompt to explicitly instruct the agent to “always include an in-text citation.” This reinforces the requirement at the generation stage, reducing the likelihood of oversight. Additionally, avoid instructions that force rigid output formats, such as strict JSON structures, which might inadvertently strip or hide the citation markers the system requires. By aligning the prompt’s formatting demands with the agent’s compliance needs, you reduce the chance of correct answers disappearing due to technical formatting constraints.

Enterprise Search Bias: How Web Search and Official Sources Shape the Feed

When the “Use information from the web” setting is active, the agent doesn’t just look at your internal files. It triggers a search across all public websites indexed by Bing. This is a form of enterprise search bias in action: external content is interleaved with your internal knowledge sources. If a web result is more semantically relevant to the query, it may appear in the answer alongside, or even prioritized over, an internal document. This can feel like an error, but it is simply the Copilot agent logic weighing public data against private data in real time.

The Role of Official Sources

Not all internal sources are treated equally. You can mark specific knowledge sources as “Official sources.” These are designated as verified and highly trusted, allowing the agent to use them directly without the usual verification flags. If you maintain a critical policy document, marking it as an official source ensures it carries more weight in the ranking process. This is a key lever in source curation AI, helping you steer the agent toward authoritative internal content even when web results are available.

Channel Limits and User Variance

What you see on your screen is also limited by the channel. In Microsoft Teams, for example, a response displays at most 20 citations. Even if the agent finds 30 relevant sources, you will only see a truncated set. Titles are capped at about 80 characters, and snippets at 480.

These layered filters mean that Copilot source ranking is not a static list. Two employees asking the same question in the same channel might see different results if their permissions differ or if a specific source is unavailable to one of them. This is a feature of AI answer transparency: the system is filtering not just by relevance, but by what each individual is allowed to see.

Frequently Asked Questions About Copilot Source Visibility

Does the agent “know” who you are?
Yes. It uses your Microsoft Entra ID to filter sources in real time, checking your actual permissions rather than guessing your role. This is the core of AI answer transparency: the system knows your identity, not just your query.

Why did I receive a web link instead of an internal document?
If “Use information from the web” is enabled, Bing results are interleaved with internal data. If your internal source was inaccessible or pruned by the Copilot agent logic, the web result may dominate the answer.

Can I force the agent to always use a specific source?
You can mark a source as an “Official source” to prioritize it. However, in Generative mode, the pruning logic still applies if the total source count exceeds 25. The model selects the 25 most relevant sources based on your specific query.

Is the 25-source limit a hard cap?
No, it is a pruning trigger. If a key source is always critical to your workflow, consider using an uploaded file (which is exempt from this limit) or designating it as an official source to ensure it remains in the agent’s active context.

Conclusion

Understanding these four layers — permission filters, orchestration pruning, citation compliance, and channel display limits — is the key to troubleshooting missing answers in your Copilot agent. When a response seems incomplete, the issue is rarely the model’s capability but rather how these systems interact. If your agent is only showing half the picture, is it a failure of the model, or a success of your permission structure?

AEO/GEO

Want to learn more?

Contact us for direct consultation and support.

Contact us

Related Articles

Crawl errors silently kill your Copilot visibility
Microsoft copilot & bing ai optimization

Crawl errors silently kill your Copilot visibility

Your website might be technically live, yet functionally invisible to the AI engines shaping modern discovery. A URL existing on the internet is not the...

Read article
Fix 7 crawl errors to improve Copilot content visibility
Microsoft copilot & bing ai optimization

Fix 7 crawl errors to improve Copilot content visibility

You ask Copilot for a summary of your product features, but the response cites a competitor. Or, worse, it says it cannot find the information. You check...

Read article
Fix 2 Crawl Errors to Boost Copilot Visibility
Microsoft copilot & bing ai optimization

Fix 2 Crawl Errors to Boost Copilot Visibility

Your homepage loads perfectly in Chrome. You refresh the page, watch the content render, and assume your site is live. Then you ask a Copilot-based agent...

Read article
Bing AI Freshness: What the Webmaster Blog Says About IndexNow
Microsoft copilot & bing ai optimization

Bing AI Freshness: What the Webmaster Blog Says About IndexNow

“No tool can guarantee when or how your content will appear in AI-generated results.” This blunt caveat from the Bing Webmaster Blog sets a realistic frame...

Read article
Two gates explain why Copilot cites so few sources
Microsoft copilot & bing ai optimization

Two gates explain why Copilot cites so few sources

You rank well on Google. Your content is current, authoritative, and relevant. Yet when users ask Microsoft Copilot, your site never appears in the citation...

Read article
The slot logic behind Copilot citations
Microsoft copilot & bing ai optimization

The slot logic behind Copilot citations

You hold the top three positions on Google for your brand’s primary keywords. Yet when a customer asks a generative AI question, your domain never appears...

Read article