Picture for Ionut-Vlad Modoranu

Ionut-Vlad Modoranu

MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence

Add code
May 24, 2024
Figure 1 for MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence
Figure 2 for MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence
Figure 3 for MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence
Figure 4 for MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence
Viaarxiv icon

Error Feedback Can Accurately Compress Preconditioners

Add code
Jun 16, 2023
Figure 1 for Error Feedback Can Accurately Compress Preconditioners
Figure 2 for Error Feedback Can Accurately Compress Preconditioners
Figure 3 for Error Feedback Can Accurately Compress Preconditioners
Figure 4 for Error Feedback Can Accurately Compress Preconditioners
Viaarxiv icon