Picture for Courtney Paquette

Courtney Paquette

The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms

Add code
May 30, 2024
Viaarxiv icon

4+3 Phases of Compute-Optimal Neural Scaling Laws

May 23, 2024
Viaarxiv icon

Mirror Descent Algorithms with Nearly Dimension-Independent Rates for Differentially-Private Stochastic Saddle-Point Problems

Mar 05, 2024
Figure 1 for Mirror Descent Algorithms with Nearly Dimension-Independent Rates for Differentially-Private Stochastic Saddle-Point Problems
Viaarxiv icon

Implicit Diffusion: Efficient Optimization through Stochastic Sampling

Add code
Feb 08, 2024
Viaarxiv icon

Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index models

Aug 17, 2023
Figure 1 for Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index models
Figure 2 for Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index models
Figure 3 for Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index models
Figure 4 for Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index models
Viaarxiv icon

Only Tails Matter: Average-Case Universality and Robustness in the Convex Regime

Jun 22, 2022
Figure 1 for Only Tails Matter: Average-Case Universality and Robustness in the Convex Regime
Figure 2 for Only Tails Matter: Average-Case Universality and Robustness in the Convex Regime
Figure 3 for Only Tails Matter: Average-Case Universality and Robustness in the Convex Regime
Figure 4 for Only Tails Matter: Average-Case Universality and Robustness in the Convex Regime
Viaarxiv icon

Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions

Add code
Jun 15, 2022
Figure 1 for Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions
Figure 2 for Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions
Figure 3 for Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions
Figure 4 for Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions
Viaarxiv icon

Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions

Add code
Jun 02, 2022
Figure 1 for Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions
Figure 2 for Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions
Figure 3 for Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions
Figure 4 for Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions
Viaarxiv icon

Homogenization of SGD in high-dimensions: Exact dynamics and generalization properties

Add code
May 14, 2022
Figure 1 for Homogenization of SGD in high-dimensions: Exact dynamics and generalization properties
Figure 2 for Homogenization of SGD in high-dimensions: Exact dynamics and generalization properties
Figure 3 for Homogenization of SGD in high-dimensions: Exact dynamics and generalization properties
Figure 4 for Homogenization of SGD in high-dimensions: Exact dynamics and generalization properties
Viaarxiv icon

Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models

Add code
Jun 07, 2021
Figure 1 for Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models
Figure 2 for Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models
Figure 3 for Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models
Figure 4 for Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models
Viaarxiv icon