Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Erich Elsen

Top-KAST: Top-K Always Sparse Training


Jun 07, 2021
Siddhant M. Jayakumar, Razvan Pascanu, Jack W. Rae, Simon Osindero, Erich Elsen

* Advances in Neural Information Processing Systems, 33, 20744-20754 

  Access Paper or Ask Questions

On the Generalization Benefit of Noise in Stochastic Gradient Descent


Jun 26, 2020
Samuel L. Smith, Erich Elsen, Soham De

* Camera-ready version of ICML 2020 

  Access Paper or Ask Questions

Sparse GPU Kernels for Deep Learning


Jun 18, 2020
Trevor Gale, Matei Zaharia, Cliff Young, Erich Elsen


  Access Paper or Ask Questions

AlgebraNets


Jun 16, 2020
Jordan Hoffmann, Simon Schmitt, Simon Osindero, Karen Simonyan, Erich Elsen


  Access Paper or Ask Questions

A Practical Sparse Approximation for Real Time Recurrent Learning


Jun 12, 2020
Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero, Karen Simonyan, Alex Graves


  Access Paper or Ask Questions

End-to-End Adversarial Text-to-Speech


Jun 05, 2020
Jeff Donahue, Sander Dieleman, Mikołaj Bińkowski, Erich Elsen, Karen Simonyan


  Access Paper or Ask Questions

Rigging the Lottery: Making All Tickets Winners


Nov 25, 2019
Utku Evci, Trevor Gale, Jacob Menick, Pablo Samuel Castro, Erich Elsen


  Access Paper or Ask Questions

Fast Sparse ConvNets


Nov 21, 2019
Erich Elsen, Marat Dukhan, Trevor Gale, Karen Simonyan


  Access Paper or Ask Questions

High Fidelity Speech Synthesis with Adversarial Networks


Sep 26, 2019
Mikołaj Bińkowski, Jeff Donahue, Sander Dieleman, Aidan Clark, Erich Elsen, Norman Casagrande, Luis C. Cobo, Karen Simonyan


  Access Paper or Ask Questions

The Difficulty of Training Sparse Neural Networks


Jul 17, 2019
Utku Evci, Fabian Pedregosa, Aidan Gomez, Erich Elsen

* sparse networks, pruning, energy landscape, sparsity 

  Access Paper or Ask Questions

Non-Differentiable Supervised Learning with Evolution Strategies and Hybrid Methods


Jun 07, 2019
Karel Lenc, Erich Elsen, Tom Schaul, Karen Simonyan


  Access Paper or Ask Questions

The State of Sparsity in Deep Neural Networks


Feb 25, 2019
Trevor Gale, Erich Elsen, Sara Hooker


  Access Paper or Ask Questions

Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset


Oct 30, 2018
Curtis Hawthorne, Andriy Stasyuk, Adam Roberts, Ian Simon, Cheng-Zhi Anna Huang, Sander Dieleman, Erich Elsen, Jesse Engel, Douglas Eck

* Examples available at https://goo.gl/magenta/maestro-examples 

  Access Paper or Ask Questions

Efficient Neural Audio Synthesis


Jun 25, 2018
Nal Kalchbrenner, Erich Elsen, Karen Simonyan, Seb Noury, Norman Casagrande, Edward Lockhart, Florian Stimberg, Aaron van den Oord, Sander Dieleman, Koray Kavukcuoglu

* 10 pages 

  Access Paper or Ask Questions

Onsets and Frames: Dual-Objective Piano Transcription


Jun 05, 2018
Curtis Hawthorne, Erich Elsen, Jialin Song, Adam Roberts, Ian Simon, Colin Raffel, Jesse Engel, Sageev Oore, Douglas Eck

* Examples available at https://goo.gl/magenta/onsets-frames-examples 

  Access Paper or Ask Questions

Mixed Precision Training


Feb 15, 2018
Paulius Micikevicius, Sharan Narang, Jonah Alben, Gregory Diamos, Erich Elsen, David Garcia, Boris Ginsburg, Michael Houston, Oleksii Kuchaiev, Ganesh Venkatesh, Hao Wu

* Published as a conference paper at ICLR 2018 

  Access Paper or Ask Questions

Parallel WaveNet: Fast High-Fidelity Speech Synthesis


Nov 28, 2017
Aaron van den Oord, Yazhe Li, Igor Babuschkin, Karen Simonyan, Oriol Vinyals, Koray Kavukcuoglu, George van den Driessche, Edward Lockhart, Luis C. Cobo, Florian Stimberg, Norman Casagrande, Dominik Grewe, Seb Noury, Sander Dieleman, Erich Elsen, Nal Kalchbrenner, Heiga Zen, Alex Graves, Helen King, Tom Walters, Dan Belov, Demis Hassabis


  Access Paper or Ask Questions

Exploring Sparsity in Recurrent Neural Networks


Nov 06, 2017
Sharan Narang, Erich Elsen, Gregory Diamos, Shubho Sengupta

* Published as a conference paper at ICLR 2017 

  Access Paper or Ask Questions

DSD: Dense-Sparse-Dense Training for Deep Neural Networks


Feb 21, 2017
Song Han, Jeff Pool, Sharan Narang, Huizi Mao, Enhao Gong, Shijian Tang, Erich Elsen, Peter Vajda, Manohar Paluri, John Tran, Bryan Catanzaro, William J. Dally

* Published as a conference paper at ICLR 2017 

  Access Paper or Ask Questions

Deep Speech 2: End-to-End Speech Recognition in English and Mandarin


Dec 08, 2015
Dario Amodei, Rishita Anubhai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse Engel, Linxi Fan, Christopher Fougner, Tony Han, Awni Hannun, Billy Jun, Patrick LeGresley, Libby Lin, Sharan Narang, Andrew Ng, Sherjil Ozair, Ryan Prenger, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Yi Wang, Zhiqian Wang, Chong Wang, Bo Xiao, Dani Yogatama, Jun Zhan, Zhenyao Zhu


  Access Paper or Ask Questions

Deep Speech: Scaling up end-to-end speech recognition


Dec 19, 2014
Awni Hannun, Carl Case, Jared Casper, Bryan Catanzaro, Greg Diamos, Erich Elsen, Ryan Prenger, Sanjeev Satheesh, Shubho Sengupta, Adam Coates, Andrew Y. Ng


  Access Paper or Ask Questions