An AI feature returns a wrong answer but nothing errors. Where do you start?

An answer that works

The rendered prompt, exactly as sent, and the retrieved context. Most of the time the answer was not in what the model was given, which makes it a retrieval problem rather than a generation one, and those have completely different fixes.