Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Blake Woodworth

On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent


Feb 19, 2021
Shahar Azulay, Edward Moroshko, Mor Shpigel Nacson, Blake Woodworth, Nathan Srebro, Amir Globerson, Daniel Soudry

* 33 pages, 2 figures 

  Access Paper or Ask Questions

The Min-Max Complexity of Distributed Stochastic Convex Optimization with Intermittent Communication


Feb 02, 2021
Blake Woodworth, Brian Bullins, Ohad Shamir, Nathan Srebro

* 27 pages 

  Access Paper or Ask Questions

Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy


Jul 13, 2020
Edward Moroshko, Suriya Gunasekar, Blake Woodworth, Jason D. Lee, Nathan Srebro, Daniel Soudry


  Access Paper or Ask Questions

Minibatch vs Local SGD for Heterogeneous Distributed Learning


Jun 18, 2020
Blake Woodworth, Kumar Kshitij Patel, Nathan Srebro

* 34 pages 

  Access Paper or Ask Questions

Mirrorless Mirror Descent: A More Natural Discretization of Riemannian Gradient Flow


Apr 24, 2020
Suriya Gunasekar, Blake Woodworth, Nathan Srebro

* 10 pages 

  Access Paper or Ask Questions

Kernel and Rich Regimes in Overparametrized Models


Feb 24, 2020
Blake Woodworth, Suriya Gunasekar, Jason D. Lee, Edward Moroshko, Pedro Savarese, Itay Golan, Daniel Soudry, Nathan Srebro

* This updates and significantly extends a previous article (arXiv:1906.05827), Sections 6 and 7.1 are the most major additions. 30 pages. arXiv admin note: text overlap with arXiv:1906.05827 

  Access Paper or Ask Questions

Is Local SGD Better than Minibatch SGD?


Feb 18, 2020
Blake Woodworth, Kumar Kshitij Patel, Sebastian U. Stich, Zhen Dai, Brian Bullins, H. Brendan McMahan, Ohad Shamir, Nathan Srebro

* 29 pages 

  Access Paper or Ask Questions

Lower Bounds for Non-Convex Stochastic Optimization


Dec 05, 2019
Yossi Arjevani, Yair Carmon, John C. Duchi, Dylan J. Foster, Nathan Srebro, Blake Woodworth


  Access Paper or Ask Questions

The gradient complexity of linear regression


Nov 06, 2019
Mark Braverman, Elad Hazan, Max Simchowitz, Blake Woodworth


  Access Paper or Ask Questions

Open Problem: The Oracle Complexity of Convex Optimization with Limited Memory


Jul 01, 2019
Blake Woodworth, Nathan Srebro

* 9 pages 

  Access Paper or Ask Questions

Guaranteed Validity for Empirical Approaches to Adaptive Data Analysis


Jun 21, 2019
Ryan Rogers, Aaron Roth, Adam Smith, Nathan Srebro, Om Thakkar, Blake Woodworth


  Access Paper or Ask Questions

Kernel and Deep Regimes in Overparametrized Models


Jun 13, 2019
Blake Woodworth, Suriya Gunasekar, Jason Lee, Daniel Soudry, Nathan Srebro

* 16 pages 

  Access Paper or Ask Questions

The Complexity of Making the Gradient Small in Stochastic Convex Optimization


Feb 14, 2019
Dylan J. Foster, Ayush Sekhari, Ohad Shamir, Nathan Srebro, Karthik Sridharan, Blake Woodworth


  Access Paper or Ask Questions

Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints


Sep 28, 2018
Andrew Cotter, Maya Gupta, Heinrich Jiang, Nathan Srebro, Karthik Sridharan, Serena Wang, Blake Woodworth, Seungil You


  Access Paper or Ask Questions

Graph Oracle Models, Lower Bounds, and Gaps for Parallel Stochastic Optimization


Jul 31, 2018
Blake Woodworth, Jialei Wang, Brendan McMahan, Nathan Srebro


  Access Paper or Ask Questions

The Everlasting Database: Statistical Validity at a Fair Price


Mar 12, 2018
Blake Woodworth, Vitaly Feldman, Saharon Rosset, Nathan Srebro

* 14 pages 

  Access Paper or Ask Questions

Learning Non-Discriminatory Predictors


Nov 01, 2017
Blake Woodworth, Suriya Gunasekar, Mesrob I. Ohannessian, Nathan Srebro

* 28 pages 

  Access Paper or Ask Questions

Implicit Regularization in Matrix Factorization


May 25, 2017
Suriya Gunasekar, Blake Woodworth, Srinadh Bhojanapalli, Behnam Neyshabur, Nathan Srebro


  Access Paper or Ask Questions

Tight Complexity Bounds for Optimizing Composite Objectives


Oct 27, 2016
Blake Woodworth, Nathan Srebro


  Access Paper or Ask Questions