Asked about Parameters that change the output
What does temperature do?
An answer that works
It scales the probability distribution before a token is sampled. Low values concentrate probability on the most likely token, high values spread it out. It can only produce variety where the model was already uncertain.
Reading an answer is not being able to give one. The section that teaches this is Parameters that change the output, 2 hours of The Messages API.
Learn this properlyAlso asked about The Messages API
What are the roles in a chat request and what is each for?What is stop_reason and why check it?Does max_tokens make the model give shorter answers?Are LLM APIs stateful or stateless?Why does a long conversation get expensive faster than you would expect?How would you keep a long-running chat affordable?Is temperature 0 deterministic?How do you make a model give shorter answers?
All 10 questions on The Messages API