Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Neha S. Wadia

Whitening and second order optimization both destroy information about the dataset, and can make generalization impossible


Aug 25, 2020
Neha S. Wadia, Daniel Duckworth, Samuel S. Schoenholz, Ethan Dyer, Jascha Sohl-Dickstein

* 15+7 pages, 7 figures; added references, edited model descriptions for clarity, results unchanged 

  Access Paper or Ask Questions

Critical Point-Finding Methods Reveal Gradient-Flat Regions of Deep Network Losses


Mar 23, 2020
Charles G. Frye, James Simon, Neha S. Wadia, Andrew Ligeralde, Michael R. DeWeese, Kristofer E. Bouchard

* 18 pages, 5 figures 

  Access Paper or Ask Questions

Numerically Recovering the Critical Points of a Deep Linear Autoencoder


Jan 29, 2019
Charles G. Frye, Neha S. Wadia, Michael R. DeWeese, Kristofer E. Bouchard


  Access Paper or Ask Questions