Asked about The questions every ML interview asks, answered properly
When would you choose logistic regression over gradient boosting?
An answer that works
When interpretability or calibrated, stable probabilities matter, when data is small, when features are already well engineered and roughly linear in effect, or when the model must be simple to deploy and audit. Otherwise boosting usually wins on accuracy for tabular data.
Reading an answer is not being able to give one. The section that teaches this is The questions every ML interview asks, answered properly, 3 hours of Supervised learning.
Learn this properlyAlso asked about Supervised learning
You have a tabular dataset and a classification task. What do you try first?Why do gradient boosted trees still beat neural networks on tabular data?What is the difference between bagging and boosting?How does a decision tree choose where to split?Why does gradient boosting work?Can you trust linear regression coefficients as feature importance?Walk me through how you would approach a new tabular classification problem.Explain the bias-variance trade-off.
All 12 questions on Supervised learning