Mirrorless Mirror Descent: A More Natural Discretization of Riemannian Gradient Flow

Apr 24, 2020
Suriya Gunasekar, Blake Woodworth, Nathan Srebro

* 10 pages 

  Access Model/Code and Paper
Kernel and Rich Regimes in Overparametrized Models

Feb 24, 2020
Blake Woodworth, Suriya Gunasekar, Jason D. Lee, Edward Moroshko, Pedro Savarese, Itay Golan, Daniel Soudry, Nathan Srebro

* This updates and significantly extends a previous article (arXiv:1906.05827), Sections 6 and 7.1 are the most major additions. 30 pages. arXiv admin note: text overlap with arXiv:1906.05827 

  Access Model/Code and Paper
Is Local SGD Better than Minibatch SGD?

Feb 18, 2020
Blake Woodworth, Kumar Kshitij Patel, Sebastian U. Stich, Zhen Dai, Brian Bullins, H. Brendan McMahan, Ohad Shamir, Nathan Srebro

* 29 pages 

  Access Model/Code and Paper
Lower Bounds for Non-Convex Stochastic Optimization

Dec 05, 2019
Yossi Arjevani, Yair Carmon, John C. Duchi, Dylan J. Foster, Nathan Srebro, Blake Woodworth

  Access Model/Code and Paper
The gradient complexity of linear regression

Nov 06, 2019
Mark Braverman, Elad Hazan, Max Simchowitz, Blake Woodworth

  Access Model/Code and Paper
Open Problem: The Oracle Complexity of Convex Optimization with Limited Memory

Jul 01, 2019
Blake Woodworth, Nathan Srebro

* 9 pages 

  Access Model/Code and Paper
Guaranteed Validity for Empirical Approaches to Adaptive Data Analysis

Jun 21, 2019
Ryan Rogers, Aaron Roth, Adam Smith, Nathan Srebro, Om Thakkar, Blake Woodworth

  Access Model/Code and Paper
Kernel and Deep Regimes in Overparametrized Models

Jun 13, 2019
Blake Woodworth, Suriya Gunasekar, Jason Lee, Daniel Soudry, Nathan Srebro

* 16 pages 

  Access Model/Code and Paper
The Complexity of Making the Gradient Small in Stochastic Convex Optimization

Feb 14, 2019
Dylan J. Foster, Ayush Sekhari, Ohad Shamir, Nathan Srebro, Karthik Sridharan, Blake Woodworth

  Access Model/Code and Paper
Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints

Sep 28, 2018
Andrew Cotter, Maya Gupta, Heinrich Jiang, Nathan Srebro, Karthik Sridharan, Serena Wang, Blake Woodworth, Seungil You

  Access Model/Code and Paper
Graph Oracle Models, Lower Bounds, and Gaps for Parallel Stochastic Optimization

Jul 31, 2018
Blake Woodworth, Jialei Wang, Brendan McMahan, Nathan Srebro

  Access Model/Code and Paper
The Everlasting Database: Statistical Validity at a Fair Price

Mar 12, 2018
Blake Woodworth, Vitaly Feldman, Saharon Rosset, Nathan Srebro

* 14 pages 

  Access Model/Code and Paper
Learning Non-Discriminatory Predictors

Nov 01, 2017
Blake Woodworth, Suriya Gunasekar, Mesrob I. Ohannessian, Nathan Srebro

* 28 pages 

  Access Model/Code and Paper
Implicit Regularization in Matrix Factorization

May 25, 2017
Suriya Gunasekar, Blake Woodworth, Srinadh Bhojanapalli, Behnam Neyshabur, Nathan Srebro

  Access Model/Code and Paper
Tight Complexity Bounds for Optimizing Composite Objectives

Oct 27, 2016
Blake Woodworth, Nathan Srebro

  Access Model/Code and Paper