Asked about How the algorithms actually work

What is the difference between value-based and policy-based methods?

An answer that works

Value methods learn how good states or actions are and act greedily with respect to that, suiting discrete actions. Policy methods adjust behaviour directly, handling continuous actions and forming the basis of language model post-training. Actor-critic uses both.

Reading an answer is not being able to give one. The section that teaches this is How the algorithms actually work, 4 hours of Reinforcement learning.

Learn this properly

Also asked about Reinforcement learning

What is the credit assignment problem?How does reinforcement learning apply to language models?What is reward hacking?Why does PPO limit how much the policy can change?Why is RL less stable than supervised learning?What is the exploration-exploitation trade-off?Our ranker orders items purely by measured click-through rate. What goes wrong?Explain the Q-learning update.

All 14 questions on Reinforcement learning