Picture for Mufan Bill Li

Mufan Bill Li

Sampling from the Mean-Field Stationary Distribution

Add code
Feb 18, 2024
Viaarxiv icon

Differential Equation Scaling Limits of Shaped and Unshaped Neural Networks

Add code
Oct 18, 2023
Viaarxiv icon

Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit

Add code
Sep 28, 2023
Viaarxiv icon

The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit

Add code
Jun 30, 2023
Viaarxiv icon

Improved Discretization Analysis for Underdamped Langevin Monte Carlo

Add code
Feb 16, 2023
Viaarxiv icon

The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization

Add code
Jun 06, 2022
Figure 1 for The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization
Figure 2 for The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization
Figure 3 for The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization
Figure 4 for The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization
Viaarxiv icon

Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev

Add code
Dec 23, 2021
Figure 1 for Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev
Figure 2 for Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev
Viaarxiv icon

The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization

Add code
Jun 07, 2021
Figure 1 for The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization
Figure 2 for The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization
Figure 3 for The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization
Figure 4 for The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization
Viaarxiv icon

Higher Order Generalization Error for First Order Discretization of Langevin Diffusion

Add code
Feb 11, 2021
Figure 1 for Higher Order Generalization Error for First Order Discretization of Langevin Diffusion
Figure 2 for Higher Order Generalization Error for First Order Discretization of Langevin Diffusion
Figure 3 for Higher Order Generalization Error for First Order Discretization of Langevin Diffusion
Viaarxiv icon

Riemannian Langevin Algorithm for Solving Semidefinite Programs

Add code
Oct 22, 2020
Figure 1 for Riemannian Langevin Algorithm for Solving Semidefinite Programs
Viaarxiv icon