Asked about Managing the context as it grows
How does prompt caching interact with context management?
An answer that works
Caching matches a stable prefix, so anything volatile must go last. If a summary is inserted near the front, it invalidates the cache every time it updates. Order from most stable to most volatile and the cache keeps working.
Reading an answer is not being able to give one. The section that teaches this is Managing the context as it grows, 4 hours of The agent loop.
Learn this properlyAlso asked about The agent loop
What is an agent, in one sentence?When would you not use an agent?Where does the loop run?How do you stop an agent running forever?An agent keeps calling the same tool with the same arguments. What do you do?What should an agent return when it runs out of budget?An agent overflows its context after ten turns. What do you do?What must survive compaction?
All 12 questions on The agent loop