Asked about Grading with a model

Should the judge explain its reasoning?

An answer that works

Usually yes, briefly, before the verdict. A short critique first tends to make the verdict more accurate, and when the judge disagrees with you it shows whether the rubric or the judge is at fault. Reasoning written after the verdict is just justification. The cost is extra output tokens on every call.

Reading an answer is not being able to give one. The section that teaches this is Grading with a model, 6 hours of LLM-as-judge.

Learn this properly

Also asked about LLM-as-judge

How do you know your LLM judge is any good?What are the biases of an LLM judge?When would you use pairwise comparison rather than scoring?How would you monitor answer quality in production with an LLM judge?Your judge marks 80% of traffic as passing. Is the pass rate 80%?