Asked about Norms, projections and decompositions

What is the difference between L1 and L2 regularisation?

An answer that works

L2 penalises squared weights and shrinks all of them slightly. L1 penalises absolute values and drives many weights to exactly zero, so it performs feature selection. The difference comes from the geometry of the two norms.

Reading an answer is not being able to give one. The section that teaches this is Norms, projections and decompositions, 5 hours of Linear algebra.

Learn this properly

Also asked about Linear algebra

What does a dot product tell you?Why do matrix multiply shapes have to line up?What is broadcasting and why is it risky?What does SVD give you?How does PCA relate to eigenvectors?What does the dot product of two vectors tell you?How is linear regression a linear algebra problem?Explain PCA.

All 10 questions on Linear algebra