knowAIedge
A little more informed. Every day.
Skip to learning content
← Lessons & paths
IntermediateRAG & Evaluation · 5 min suggested

RAG: give an answer the right evidence

Explain how retrieval helps answer questions about changing documents.

Source check: 2026-11-03 · Version 1
Original knowAIedge explanation, checked against the linked technical sources. AI-assisted; report corrections below.

In plain language

Retrieval-augmented generation first finds relevant material, then supplies that material to a model as context for an answer. Search may use keywords, vectors or a combination. A vector database is not a requirement of every RAG system.

The quality of the answer depends on what was retrieved and how the model uses it. Stale, irrelevant or unauthorized content can cause problems. Evaluate retrieval separately from the final answer, and keep citations linked to the supporting passages.

Try thinking about it this way

A support question asks about a recently updated feature. Search the current product manuals, select the relevant passage, and have the assistant answer with its source. Manually pasting a passage shows added context; automated selection is the retrieval step.

Try it yourself

For a question about a changed policy, name the retrieval step and how you would verify the answer against the source.

Go deeper · for developers and architects

Changing chunk size, overlap or ranking can help particular workloads. Diagnose failures using test queries before choosing a change. More retrieved text is not automatically better.

Check your understanding

3 related questions, with an explanation for each answer.

Explore the original sources

Microsoft RAG overview ↗
Report an issue

Tell the editors what needs correcting. Reports are reviewed and do not automatically remove content. Do not include personal or confidential information.

Finished this lesson?

Completion records your choice, not a measured skill level.

One useful next step
RAG or fine-tuning? Start with the problem →
Visitor notice: signed-in name/email, page views, topic selections and opened article links are recorded for your reading history and admin-only site administration. Opening a link does not confirm a full read. Anonymous visits are counted with a random 30-day browser cookie; clearing cookies or using another browser may count again. Search text and ChatGPT conversations are not tracked.