Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Aaron Defazio

Aaron Defazio

INRIA Paris - Rocquencourt, LIENS, MSR - INRIA

Stochastic Polyak Stepsize with a Moving Target


Jun 22, 2021
Robert M. Gower, Aaron Defazio, Michael Rabbat

* 41 pages, 13 figures, 1 table 

  Access Paper or Ask Questions

Adaptivity without Compromise: A Momentumized, Adaptive, Dual Averaged Gradient Method for Stochastic Optimization


Jan 26, 2021
Aaron Defazio, Samy Jelassi


  Access Paper or Ask Questions

Dual Averaging is Surprisingly Effective for Deep Learning Optimization


Oct 20, 2020
Samy Jelassi, Aaron Defazio


  Access Paper or Ask Questions

Understanding the Role of Momentum in Non-Convex Optimization: Practical Insights from a Lyapunov Analysis


Oct 01, 2020
Aaron Defazio


  Access Paper or Ask Questions

On the convergence of the Stochastic Heavy Ball Method


Jun 14, 2020
Othmane Sebbouh, Robert M. Gower, Aaron Defazio


  Access Paper or Ask Questions

Factorial Powers for Stochastic Optimization


Jun 01, 2020
Aaron Defazio, Robert M. Gower


  Access Paper or Ask Questions

End-to-End Variational Networks for Accelerated MRI Reconstruction


Apr 15, 2020
Anuroop Sriram, Jure Zbontar, Tullie Murrell, Aaron Defazio, C. Lawrence Zitnick, Nafissa Yakubova, Florian Knoll, Patricia Johnson


  Access Paper or Ask Questions

MRI Banding Removal via Adversarial Training


Feb 04, 2020
Aaron Defazio, Tullie Murrell, Michael P. Recht


  Access Paper or Ask Questions

Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challenge


Jan 06, 2020
Florian Knoll, Tullie Murrell, Anuroop Sriram, Nafissa Yakubova, Jure Zbontar, Michael Rabbat, Aaron Defazio, Matthew J. Muckley, Daniel K. Sodickson, C. Lawrence Zitnick, Michael P. Recht


  Access Paper or Ask Questions

Offset Masking Improves Deep Learning based Accelerated MRI Reconstructions


Dec 02, 2019
Aaron Defazio


  Access Paper or Ask Questions

GrappaNet: Combining Parallel Imaging with Deep Learning for Multi-Coil MRI Reconstruction


Nov 04, 2019
Anuroop Sriram, Jure Zbontar, Tullie Murrell, C. Lawrence Zitnick, Aaron Defazio, Daniel K. Sodickson


  Access Paper or Ask Questions

Scaling Laws for the Principled Design, Initialization and Preconditioning of ReLU Networks


Jun 10, 2019
Aaron Defazio, Léon Bottou


  Access Paper or Ask Questions

On the Curved Geometry of Accelerated Optimization


Dec 11, 2018
Aaron Defazio


  Access Paper or Ask Questions

Controlling Covariate Shift using Equilibrium Normalization of Weights


Dec 11, 2018
Aaron Defazio, Léon Bottou


  Access Paper or Ask Questions

On the Ineffectiveness of Variance Reduced Optimization for Deep Learning


Dec 11, 2018
Aaron Defazio, Léon Bottou


  Access Paper or Ask Questions

fastMRI: An Open Dataset and Benchmarks for Accelerated MRI


Nov 21, 2018
Jure Zbontar, Florian Knoll, Anuroop Sriram, Matthew J. Muckley, Mary Bruno, Aaron Defazio, Marc Parente, Krzysztof J. Geras, Joe Katsnelson, Hersh Chandarana, Zizhao Zhang, Michal Drozdzal, Adriana Romero, Michael Rabbat, Pascal Vincent, James Pinkerton, Duo Wang, Nafissa Yakubova, Erich Owens, C. Lawrence Zitnick, Michael P. Recht, Daniel K. Sodickson, Yvonne W. Lui

* 29 pages, 8 figures 

  Access Paper or Ask Questions

A Simple Practical Accelerated Method for Finite Sums


Oct 27, 2016
Aaron Defazio


  Access Paper or Ask Questions

New Optimisation Methods for Machine Learning


Mar 19, 2016
Aaron Defazio

* PhD thesis, 205 pages 

  Access Paper or Ask Questions

Non-Uniform Stochastic Average Gradient Method for Training Conditional Random Fields


Apr 16, 2015
Mark Schmidt, Reza Babanezhad, Mohamed Osama Ahmed, Aaron Defazio, Ann Clifton, Anoop Sarkar

* AI/Stats 2015, 24 pages 

  Access Paper or Ask Questions

SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives


Dec 16, 2014
Aaron Defazio, Francis Bach, Simon Lacoste-Julien

* Advances In Neural Information Processing Systems, Nov 2014, Montreal, Canada 

  Access Paper or Ask Questions

A Comparison of learning algorithms on the Arcade Learning Environment


Oct 31, 2014
Aaron Defazio, Thore Graepel


  Access Paper or Ask Questions

A Graphical Model Formulation of Collaborative Filtering Neighbourhood Methods with Fast Maximum Entropy Training


Jun 18, 2012
Aaron Defazio, Tiberio Caetano

* ICML2012 

  Access Paper or Ask Questions