Asked about Designing for a component that is sometimes wrong

How do you design a feature around a model that is sometimes wrong?

An answer that works

Assume mistakes rather than trying to eliminate them. Show sources so users can verify cheaply, make correction a single gesture, set expectations honestly in the copy, and match the level of autonomy to the cost of being wrong.

Reading an answer is not being able to give one. The section that teaches this is Designing for a component that is sometimes wrong, 5 hours of Product judgement for AI.

Learn this properly

Also asked about Product judgement for AI

Why are AI failures harder for users than ordinary software failures?How do you decide whether a model is accurate enough to ship?Would you show a confidence score to users?You launched an AI writing assistant. How do you know it is helping?How do you decide what to fully automate?