Picture for Keith Rush

Keith Rush

Fine-Tuning Large Language Models with User-Level Differential Privacy

Add code
Jul 10, 2024
Viaarxiv icon

Cascade-Aware Training of Language Models

Add code
May 29, 2024
Viaarxiv icon

FAX: Scalable and Differentiable Federated Primitives in JAX

Add code
Mar 11, 2024
Figure 1 for FAX: Scalable and Differentiable Federated Primitives in JAX
Figure 2 for FAX: Scalable and Differentiable Federated Primitives in JAX
Figure 3 for FAX: Scalable and Differentiable Federated Primitives in JAX
Figure 4 for FAX: Scalable and Differentiable Federated Primitives in JAX
Viaarxiv icon

(Amplified) Banded Matrix Factorization: A unified approach to private training

Add code
Jun 13, 2023
Figure 1 for (Amplified) Banded Matrix Factorization: A unified approach to private training
Figure 2 for (Amplified) Banded Matrix Factorization: A unified approach to private training
Figure 3 for (Amplified) Banded Matrix Factorization: A unified approach to private training
Figure 4 for (Amplified) Banded Matrix Factorization: A unified approach to private training
Viaarxiv icon

Convergence of Gradient Descent with Linearly Correlated Noise and Applications to Differentially Private Learning

Add code
Feb 02, 2023
Figure 1 for Convergence of Gradient Descent with Linearly Correlated Noise and Applications to Differentially Private Learning
Figure 2 for Convergence of Gradient Descent with Linearly Correlated Noise and Applications to Differentially Private Learning
Figure 3 for Convergence of Gradient Descent with Linearly Correlated Noise and Applications to Differentially Private Learning
Figure 4 for Convergence of Gradient Descent with Linearly Correlated Noise and Applications to Differentially Private Learning
Viaarxiv icon

Federated Automatic Differentiation

Add code
Jan 18, 2023
Figure 1 for Federated Automatic Differentiation
Figure 2 for Federated Automatic Differentiation
Figure 3 for Federated Automatic Differentiation
Figure 4 for Federated Automatic Differentiation
Viaarxiv icon

Multi-Epoch Matrix Factorization Mechanisms for Private Machine Learning

Add code
Nov 12, 2022
Figure 1 for Multi-Epoch Matrix Factorization Mechanisms for Private Machine Learning
Figure 2 for Multi-Epoch Matrix Factorization Mechanisms for Private Machine Learning
Figure 3 for Multi-Epoch Matrix Factorization Mechanisms for Private Machine Learning
Figure 4 for Multi-Epoch Matrix Factorization Mechanisms for Private Machine Learning
Viaarxiv icon

Private Online Prefix Sums via Optimal Matrix Factorizations

Add code
Feb 16, 2022
Figure 1 for Private Online Prefix Sums via Optimal Matrix Factorizations
Figure 2 for Private Online Prefix Sums via Optimal Matrix Factorizations
Viaarxiv icon

Iterated Vector Fields and Conservatism, with Applications to Federated Learning

Add code
Sep 08, 2021
Figure 1 for Iterated Vector Fields and Conservatism, with Applications to Federated Learning
Viaarxiv icon

Federated Reconstruction: Partially Local Federated Learning

Add code
Feb 18, 2021
Figure 1 for Federated Reconstruction: Partially Local Federated Learning
Figure 2 for Federated Reconstruction: Partially Local Federated Learning
Figure 3 for Federated Reconstruction: Partially Local Federated Learning
Figure 4 for Federated Reconstruction: Partially Local Federated Learning
Viaarxiv icon