Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Jonathan Frankle

The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models


Dec 12, 2020
Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Yang Zhang, Michael Carbin, Zhangyang Wang


  Access Paper or Ask Questions

Revisiting "Qualitatively Characterizing Neural Network Optimization Problems"


Dec 12, 2020
Jonathan Frankle

* Workshop on Deep Learning and Information Geometry (NeurIPS 2020) 

  Access Paper or Ask Questions

Are all negatives created equal in contrastive instance discrimination?


Oct 25, 2020
Tiffany Tianhui Cai, Jonathan Frankle, David J. Schwab, Ari S. Morcos

* Fixed author name error 

  Access Paper or Ask Questions

Pruning Neural Networks at Initialization: Why are We Missing the Mark?


Sep 18, 2020
Jonathan Frankle, Gintare Karolina Dziugaite, Daniel M. Roy, Michael Carbin


  Access Paper or Ask Questions

The Lottery Ticket Hypothesis for Pre-trained BERT Networks


Jul 23, 2020
Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Yang Zhang, Zhangyang Wang, Michael Carbin


  Access Paper or Ask Questions

On the Predictability of Pruning Across Scales


Jun 19, 2020
Jonathan S. Rosenfeld, Jonathan Frankle, Michael Carbin, Nir Shavit


  Access Paper or Ask Questions

What is the State of Neural Network Pruning?


Mar 06, 2020
Davis Blalock, Jose Javier Gonzalez Ortiz, Jonathan Frankle, John Guttag

* Published in Proceedings of Machine Learning and Systems 2020 (MLSys 2020) 

  Access Paper or Ask Questions

Comparing Rewinding and Fine-tuning in Neural Network Pruning


Mar 05, 2020
Alex Renda, Jonathan Frankle, Michael Carbin

* ICLR 2020 

  Access Paper or Ask Questions

Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs


Feb 29, 2020
Jonathan Frankle, David J. Schwab, Ari S. Morcos


  Access Paper or Ask Questions

The Early Phase of Neural Network Training


Feb 24, 2020
Jonathan Frankle, David J. Schwab, Ari S. Morcos

* ICLR 2020 Camera Ready. Available on OpenReview at https://openreview.net/forum?id=Hkl1iRNFwS 

  Access Paper or Ask Questions

Linear Mode Connectivity and the Lottery Ticket Hypothesis


Dec 11, 2019
Jonathan Frankle, Gintare Karolina Dziugaite, Daniel M. Roy, Michael Carbin

* This submission subsumes 1903.01611 ("Stabilizing the Lottery Ticket Hypothesis" and "The Lottery Ticket Hypothesis at Scale") 

  Access Paper or Ask Questions

Dissecting Pruned Neural Networks


Jun 29, 2019
Jonathan Frankle, David Bau


  Access Paper or Ask Questions

The Lottery Ticket Hypothesis at Scale


Mar 05, 2019
Jonathan Frankle, Gintare Karolina Dziugaite, Daniel M. Roy, Michael Carbin


  Access Paper or Ask Questions

The Lottery Ticket Hypothesis: Finding Small, Trainable Neural Networks


May 20, 2018
Jonathan Frankle, Michael Carbin

* NIPS Submission 

  Access Paper or Ask Questions