Overfitting

Learning the training set itself, including its noise, instead of the pattern behind it. Training loss keeps falling while validation loss flattens and then rises.

A definition is not an understanding. This is taught properly in Memorising instead of learning, part of Overfitting & regularisation.

Learn this properly

Terms from the same topic

UnderfittingRegularisationDropoutEarly stoppingHeld-out setTrain/validation/test splitCross-validationData leakage