Deep double descent explained (4/4)
Recent works analyzing over-parameterized regimes.
Deep double descent explained (3/4) - Two models
The role of inductive biases with two linear examples (linear regression with gaussian noise & Random Fourier Features).
Deep double descent explained (2/4) - Inductive bias of SGD
Inductive biases and the example of gradient descent.
Deep double descent explained (1/4) - Generalization error
A blog post series on the phenomenon of double descent and the role of inductive biases in deep learning.