Asked about Counting tokens and what they cost
Why is output usually more expensive than input?
An answer that works
Generating tokens is sequential work: the model produces one token at a time, each conditioned on all the previous ones. Reading input is done in one parallel pass. The pricing reflects the difference in compute.
Reading an answer is not being able to give one. The section that teaches this is Counting tokens and what they cost, 2 hours of Tokenization.
Learn this properlyAlso asked about Tokenization
What is a token?Why use subword tokens rather than words or characters?Roughly how many tokens is 1,000 words of English?Why does the same content cost more in some languages?Your chatbot costs $0.40 per conversation and needs to be under $0.10. Where do you look first?How would you estimate the monthly cost of a feature before building it?What is a context window?What happens if you exceed it?
All 14 questions on Tokenization