Alert button

VIB is Half Bayes

Nov 17, 2020
Alexander A Alemi, Warren R Morningstar, Ben Poole, Ian Fischer, Joshua V Dillon

Figure 1 for VIB is Half Bayes
Figure 2 for VIB is Half Bayes
Figure 3 for VIB is Half Bayes

Share this with someone who'll enjoy it:

In discriminative settings such as regression and classification there are two random variables at play, the inputs X and the targets Y. Here, we demonstrate that the Variational Information Bottleneck can be viewed as a compromise between fully empirical and fully Bayesian objectives, attempting to minimize the risks due to finite sampling of Y only. We argue that this approach provides some of the benefits of Bayes while requiring only some of the work.

View paper onarxiv iconopen_review iconOpenReview

Share this with someone who'll enjoy it: