Difference between revisions
generalization-deep-learning
Source +0 −0
… 16 unchanged lines
Revision 74 as rendered
Classical learning theory predicts that models with more parameters than data should overfit. Networks fit even random labels and still generalize on real data, as Zhang and colleagues showed in 2017. Implicit regularization, double descent and scaling laws describe the behavior without fully explaining it.