Alert button

Size-Independent Sample Complexity of Neural Networks

Jun 06, 2018
Noah Golowich, Alexander Rakhlin, Ohad Shamir

Share this with someone who'll enjoy it:

We study the sample complexity of learning neural networks, by providing new bounds on their Rademacher complexity assuming norm constraints on the parameter matrix of each layer. Compared to previous work, these complexity bounds have improved dependence on the network depth, and under some additional assumptions, are fully independent of the network size (both depth and width). These results are derived using some novel techniques, which may be of independent interest.

* Clarified discussion of scale-sensitive bounds in the existing literature  
View paper onarxiv icon

Share this with someone who'll enjoy it: