Gradient

The vector of partial derivatives of a function with respect to every input, pointing in the direction of steepest increase. Training walks the opposite way.

A definition is not an understanding. This is taught properly in Derivatives and the chain rule, part of Calculus for ML.

Learn this properly

Terms from the same topic

Gradient descentStochastic gradient descentAdamGradient clippingPartial derivativeChain rule