Asked about Operating the service day to day
How should prompt changes be released?
An answer that works
Like code: versioned, tested against the eval suite before release, and rolled out gradually with the ability to revert. A prompt edit can change behaviour as much as a code change.
Reading an answer is not being able to give one. The section that teaches this is Operating the service day to day, 4 hours of Deployment & serving.
Learn this properlyAlso asked about Deployment & serving
What is different about deploying an AI service?Your model provider is having an outage. What should your service do?What would you monitor on an AI service?Your prediction endpoint has a 150 ms p99 target and is missing it. Where do you start?An AI feature starts misbehaving in production. What do you do first?How long should a canary run before you trust it?What breaks a model in production that no offline evaluation can catch?You expect 50 requests per second at peak, each taking about 8 seconds. What capacity do you need?
All 10 questions on Deployment & serving