A/B test

Also: online experiment, randomised controlled experiment

Randomly assigning users to two versions and comparing an outcome metric between them. The only way to know whether a change helped real people rather than an offline dataset.