Chain rule

The rule for differentiating composed functions: multiply the derivative of the outer by the derivative of the inner. Applied through a network's layers, it is exactly backpropagation.

A definition is not an understanding. This is taught properly in Derivatives and the chain rule, part of Calculus for ML.

Learn this properly

Terms from the same topic

Gradient descentStochastic gradient descentAdamGradient clippingGradientPartial derivative