Asked about Matching people to items
Why do offline metrics mislead for recommenders?
An answer that works
You only observe interactions with what was shown, under the previous system. A better recommender surfaces different items, which offline scoring counts as wrong. Live experiments are necessary rather than optional here.
Reading an answer is not being able to give one. The section that teaches this is Matching people to items, 5 hours of Recommendation systems.
Learn this properly