Asked about Worked design: questions over company documents
What would you build first?
An answer that works
Ingestion, retrieval with permission filtering, and a retrieval eval, because retrieval quality and access control decide whether the system works. Generation is comparatively easy once the right chunks arrive.
Reading an answer is not being able to give one. The section that teaches this is Worked design: questions over company documents, 6 hours of AI system design.
Learn this properlyAlso asked about AI system design
Design a system that answers questions over a company's internal documents.How do you handle the model being wrong in a production system?How would you know the system had regressed?How do you handle document permissions in a RAG system?How do you stop a support agent issuing unauthorised refunds?How would you evaluate this agent?