Asked about Making it actually work

Your RAG system gives a wrong answer. How do you find out why?

An answer that works

Separate the stages. Check whether the correct chunk was retrieved. If it was not, the problem is chunking, embedding or ranking. If it was, feed it deliberately and check the answer, which isolates a prompt or model problem.

Reading an answer is not being able to give one. The section that teaches this is Making it actually work, 4 hours of Retrieval-augmented generation.

Learn this properly

Also asked about Retrieval-augmented generation

What problem does RAG solve?How would you chunk documents?Why ask the model to cite sources?When would you fine-tune instead of using RAG?How do you handle a question your documents cannot answer?What is query rewriting and why does it matter?How do you keep a RAG index current?