Alert button
Picture for Blake Woodworth

Blake Woodworth

Alert button

SIERRA

Two Losses Are Better Than One: Faster Optimization Using a Cheaper Proxy

Feb 07, 2023
Blake Woodworth, Konstantin Mishchenko, Francis Bach

Figure 1 for Two Losses Are Better Than One: Faster Optimization Using a Cheaper Proxy
Figure 2 for Two Losses Are Better Than One: Faster Optimization Using a Cheaper Proxy
Viaarxiv icon

Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays

Jun 15, 2022
Konstantin Mishchenko, Francis Bach, Mathieu Even, Blake Woodworth

Figure 1 for Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays
Figure 2 for Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays
Figure 3 for Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays
Viaarxiv icon

Non-Convex Optimization with Certificates and Fast Rates Through Kernel Sums of Squares

Apr 11, 2022
Blake Woodworth, Francis Bach, Alessandro Rudi

Figure 1 for Non-Convex Optimization with Certificates and Fast Rates Through Kernel Sums of Squares
Figure 2 for Non-Convex Optimization with Certificates and Fast Rates Through Kernel Sums of Squares
Viaarxiv icon

A Stochastic Newton Algorithm for Distributed Convex Optimization

Oct 07, 2021
Brian Bullins, Kumar Kshitij Patel, Ohad Shamir, Nathan Srebro, Blake Woodworth

Figure 1 for A Stochastic Newton Algorithm for Distributed Convex Optimization
Figure 2 for A Stochastic Newton Algorithm for Distributed Convex Optimization
Figure 3 for A Stochastic Newton Algorithm for Distributed Convex Optimization
Figure 4 for A Stochastic Newton Algorithm for Distributed Convex Optimization
Viaarxiv icon

The Minimax Complexity of Distributed Optimization

Sep 01, 2021
Blake Woodworth

Figure 1 for The Minimax Complexity of Distributed Optimization
Figure 2 for The Minimax Complexity of Distributed Optimization
Figure 3 for The Minimax Complexity of Distributed Optimization
Figure 4 for The Minimax Complexity of Distributed Optimization
Viaarxiv icon

A Field Guide to Federated Optimization

Jul 14, 2021
Jianyu Wang, Zachary Charles, Zheng Xu, Gauri Joshi, H. Brendan McMahan, Blaise Aguera y Arcas, Maruan Al-Shedivat, Galen Andrew, Salman Avestimehr, Katharine Daly, Deepesh Data, Suhas Diggavi, Hubert Eichner, Advait Gadhikar, Zachary Garrett, Antonious M. Girgis, Filip Hanzely, Andrew Hard, Chaoyang He, Samuel Horvath, Zhouyuan Huo, Alex Ingerman, Martin Jaggi, Tara Javidi, Peter Kairouz, Satyen Kale, Sai Praneeth Karimireddy, Jakub Konecny, Sanmi Koyejo, Tian Li, Luyang Liu, Mehryar Mohri, Hang Qi, Sashank J. Reddi, Peter Richtarik, Karan Singhal, Virginia Smith, Mahdi Soltanolkotabi, Weikang Song, Ananda Theertha Suresh, Sebastian U. Stich, Ameet Talwalkar, Hongyi Wang, Blake Woodworth, Shanshan Wu, Felix X. Yu, Honglin Yuan, Manzil Zaheer, Mi Zhang, Tong Zhang, Chunxiang Zheng, Chen Zhu, Wennan Zhu

Figure 1 for A Field Guide to Federated Optimization
Figure 2 for A Field Guide to Federated Optimization
Figure 3 for A Field Guide to Federated Optimization
Figure 4 for A Field Guide to Federated Optimization
Viaarxiv icon

An Even More Optimal Stochastic Optimization Algorithm: Minibatching and Interpolation Learning

Jun 04, 2021
Blake Woodworth, Nathan Srebro

Viaarxiv icon

On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent

Feb 19, 2021
Shahar Azulay, Edward Moroshko, Mor Shpigel Nacson, Blake Woodworth, Nathan Srebro, Amir Globerson, Daniel Soudry

Figure 1 for On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent
Figure 2 for On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent
Viaarxiv icon

The Min-Max Complexity of Distributed Stochastic Convex Optimization with Intermittent Communication

Feb 02, 2021
Blake Woodworth, Brian Bullins, Ohad Shamir, Nathan Srebro

Viaarxiv icon

Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy

Jul 13, 2020
Edward Moroshko, Suriya Gunasekar, Blake Woodworth, Jason D. Lee, Nathan Srebro, Daniel Soudry

Figure 1 for Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy
Figure 2 for Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy
Figure 3 for Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy
Figure 4 for Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy
Viaarxiv icon