Asked about Choosing the metric that matches the cost of being wrong
How do you choose a classification threshold?
An answer that works
From the business requirement rather than the default of 0.5. Plot the precision-recall curve and pick the point meeting the constraint, such as maximum recall while precision stays above a required level.
Reading an answer is not being able to give one. The section that teaches this is Choosing the metric that matches the cost of being wrong, 5 hours of Model evaluation & metrics.
Learn this properlyAlso asked about Model evaluation & metrics
When would you optimise for recall over precision?Why can ROC AUC mislead on imbalanced data?What is data leakage and how does it happen?When would you use RMSE rather than MAE?Why can MAPE be misleading?When would you use macro F1 instead of accuracy?You are building a model to flag possibly fraudulent insurance claims for investigation. Which metric do you optimise?