Asked about Worked design: questions over company documents
How do you handle document permissions in a RAG system?
An answer that works
Store permission groups as chunk metadata and filter at retrieval time, so the model never receives text the user may not see. Instructing the model to withhold restricted content is not a control, since anything in the context can leak.
Reading an answer is not being able to give one. The section that teaches this is Worked design: questions over company documents, 6 hours of AI system design.
Learn this properlyAlso asked about AI system design
Design a system that answers questions over a company's internal documents.How do you handle the model being wrong in a production system?How would you know the system had regressed?What would you build first?How do you stop a support agent issuing unauthorised refunds?How would you evaluate this agent?