Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Bayesian Interpolation with Deep Linear Networks


Jan 02, 2023
Boris Hanin, Alexander Zlokapa

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Maximal Initial Learning Rates in Deep ReLU Networks


Dec 14, 2022
Gaurav Iyer, Boris Hanin, David Rolnick

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis


May 11, 2022
Wuyang Chen, Wei Huang, Xinyu Gong, Boris Hanin, Zhangyang Wang

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Correlation Functions in Random Fully Connected Neural Networks at Finite Width


Apr 03, 2022
Boris Hanin

Add code

* 88p 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Ridgeless Interpolation with Shallow ReLU Networks in $1D$ is Nearest Neighbor Curvature Extrapolation and Provably Generalizes on Lipschitz Functions


Sep 27, 2021
Boris Hanin

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Random Neural Networks in the Infinite Width Limit as Gaussian Processes


Jul 04, 2021
Boris Hanin

Add code

* 26p 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

The Principles of Deep Learning Theory


Jun 18, 2021
Daniel A. Roberts, Sho Yaida, Boris Hanin

Add code

* 451 pages, to be published by Cambridge University Press 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Deep ReLU Networks Preserve Expected Length


Feb 21, 2021
Boris Hanin, Ryan Jeong, David Rolnick

Add code

* 25 pages, 5 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Data augmentation as stochastic optimization


Oct 21, 2020
Boris Hanin, Yi Sun

Add code

* 25 pages 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Finite Depth and Width Corrections to the Neural Tangent Kernel


Sep 13, 2019
Boris Hanin, Mihai Nica

Add code

* 27 pages, 2 figures, comments welcome 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email
1
2
>>