Alert button

Variational inference via Wasserstein gradient flows

May 31, 2022
Marc Lambert, Sinho Chewi, Francis Bach, Silvère Bonnabel, Philippe Rigollet

Figure 1 for Variational inference via Wasserstein gradient flows
Figure 2 for Variational inference via Wasserstein gradient flows
Figure 3 for Variational inference via Wasserstein gradient flows
Figure 4 for Variational inference via Wasserstein gradient flows

Share this with someone who'll enjoy it:

Along with Markov chain Monte Carlo (MCMC) methods, variational inference (VI) has emerged as a central computational approach to large-scale Bayesian inference. Rather than sampling from the true posterior $\pi$, VI aims at producing a simple but effective approximation $\hat \pi$ to $\pi$ for which summary statistics are easy to compute. However, unlike the well-studied MCMC methodology, VI is still poorly understood and dominated by heuristics. In this work, we propose principled methods for VI, in which $\hat \pi$ is taken to be a Gaussian or a mixture of Gaussians, which rest upon the theory of gradient flows on the Bures-Wasserstein space of Gaussian measures. Akin to MCMC, it comes with strong theoretical guarantees when $\pi$ is log-concave.

* 52 pages, 15 figures  
View paper onarxiv iconopen_review iconOpenReview

Share this with someone who'll enjoy it: