Catastrophic forgetting
A model losing abilities it previously had when trained hard on something narrow. The reason a fine-tune that nails its task can become worse at everything around it.
A definition is not an understanding. This is taught properly in Running a fine-tune properly, part of Fine-tuning.
Learn this properlyTerms from the same topic