Eval set

Also: evaluation set, eval suite

A fixed collection of inputs with known-good outcomes, run against the system to turn "this feels better" into a number that can be compared between versions.

A definition is not an understanding. This is taught properly in Building the dataset, part of Evaluation.