Picture for Ashok Cutkosky

Ashok Cutkosky

Richard

General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimization

Add code
Nov 11, 2024
Figure 1 for General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimization
Viaarxiv icon

Empirical Tests of Optimization Assumptions in Deep Learning

Add code
Jul 01, 2024
Viaarxiv icon

Private Zeroth-Order Nonsmooth Nonconvex Optimization

Add code
Jun 27, 2024
Viaarxiv icon

Fully Unconstrained Online Learning

Add code
May 30, 2024
Viaarxiv icon

Online Linear Regression in Dynamic Environments via Discounting

Add code
May 29, 2024
Viaarxiv icon

Adam with model exponential moving average is effective for nonconvex optimization

Add code
May 28, 2024
Viaarxiv icon

The Road Less Scheduled

Add code
May 24, 2024
Viaarxiv icon

Random Scaling and Momentum for Non-smooth Non-convex Optimization

Add code
May 16, 2024
Viaarxiv icon

When, Why and How Much? Adaptive Learning Rate Scheduling by Refinement

Add code
Oct 11, 2023
Viaarxiv icon

Improving Adaptive Online Learning Using Refined Discretization

Add code
Sep 27, 2023
Viaarxiv icon