Asked about Probability, and reading an experiment honestly
Why is accuracy misleading on imbalanced data?
An answer that works
Because the base rate dominates. A model that always predicts the majority class scores very well while being useless, and even an accurate classifier for a rare condition produces mostly false positives. Precision, recall and the cost of each error type are the honest measures.
Reading an answer is not being able to give one. The section that teaches this is Probability, and reading an experiment honestly, 6 hours of Probability & statistics.
Learn this properlyAlso asked about Probability & statistics
Your new prompt scores 86 percent against 82 percent on a 50-case eval. Ship it?A test for a condition affecting 1 in 1000 people is 99 percent accurate. You test positive. What is the chance you have it?Why report p95 latency rather than the mean?What is maximum likelihood estimation?Why is cross-entropy the loss for classification?How would you put a confidence interval on an eval score?What does it mean for a model to be calibrated?What is perplexity?
All 20 questions on Probability & statistics