Asked about Operating the service day to day
An AI feature starts misbehaving in production. What do you do first?
An answer that works
Check whether the provider is having issues, then what recently changed, including prompt edits and model versions. Mitigate first by rolling back or switching to a fallback, then diagnose.
Reading an answer is not being able to give one. The section that teaches this is Operating the service day to day, 4 hours of Deployment & serving.
Learn this properlyAlso asked about Deployment & serving
What is different about deploying an AI service?Your model provider is having an outage. What should your service do?What would you monitor on an AI service?Your prediction endpoint has a 150 ms p99 target and is missing it. Where do you start?How should prompt changes be released?How long should a canary run before you trust it?What breaks a model in production that no offline evaluation can catch?You expect 50 requests per second at peak, each taking about 8 seconds. What capacity do you need?
All 10 questions on Deployment & serving