Asked about Parameters that change the output
What belongs in the system prompt rather than the user message?
An answer that works
Anything constant across the conversation: role, output format, tone, and the rule for what to do when information is missing. Keeping it stable also lets prompt caching apply to it.
Reading an answer is not being able to give one. The section that teaches this is Parameters that change the output, 2 hours of The Messages API.
Learn this properlyAlso asked about The Messages API
What are the roles in a chat request and what is each for?What is stop_reason and why check it?Does max_tokens make the model give shorter answers?Are LLM APIs stateful or stateless?Why does a long conversation get expensive faster than you would expect?How would you keep a long-running chat affordable?What does temperature do?Is temperature 0 deterministic?
All 10 questions on The Messages API