Asked about The questions every ML interview asks, answered properly
What is the curse of dimensionality?
An answer that works
As the number of features grows, data becomes sparse in the space and distances between points become similar, so methods that rely on neighbourhoods, like k-nearest neighbours, degrade. You need far more data to cover the space, which is why feature selection, regularisation and dimensionality reduction matter.
Reading an answer is not being able to give one. The section that teaches this is The questions every ML interview asks, answered properly, 3 hours of Supervised learning.
Learn this properlyAlso asked about Supervised learning
You have a tabular dataset and a classification task. What do you try first?Why do gradient boosted trees still beat neural networks on tabular data?What is the difference between bagging and boosting?How does a decision tree choose where to split?Why does gradient boosting work?Can you trust linear regression coefficients as feature importance?Walk me through how you would approach a new tabular classification problem.Explain the bias-variance trade-off.
All 12 questions on Supervised learning