Maximum likelihood estimation

Also: MLE

Choosing the parameters under which the observed data would have been most probable. Minimising cross-entropy loss is exactly this, done by gradient descent.

A definition is not an understanding. This is taught properly in Estimation, likelihood and uncertainty, part of Probability & statistics.

Learn this properly

Terms from the same topic

Perplexity Tail latency Probability distribution Expectation Variance KL divergence Entropy Bayes' theorem