Asked about The cost maths, and caching whole responses
What are the risks of semantic caching?
An answer that works
Returning an answer to a question that is similar but means something different, and leaking answers between users when responses are personal. Limit it to non-personal questions, tune the threshold on near-miss examples, and scope it by tenant.
Then they push further
What would be in your cache key for an exact response cache?
The model and version, the prompt version, the full messages, the sampling settings, and the tenant or user when answers can differ between them. Leaving one out means serving an answer produced under different conditions.
Reading an answer is not being able to give one. The section that teaches this is The cost maths, and caching whole responses, 4 hours of Prompt caching.
Learn this properly