Alert button

Understanding disentangling in $β$-VAE

Add code
Alert button
Apr 10, 2018
Figure 1 for Understanding disentangling in $β$-VAE
Figure 2 for Understanding disentangling in $β$-VAE
Figure 3 for Understanding disentangling in $β$-VAE
Figure 4 for Understanding disentangling in $β$-VAE

Share this with someone who'll enjoy it:

We present new intuitions and theoretical assessments of the emergence of disentangled representation in variational autoencoders. Taking a rate-distortion theory perspective, we show the circumstances under which representations aligned with the underlying generative factors of variation of data emerge when optimising the modified ELBO bound in $\beta$-VAE, as training progresses. From these insights, we propose a modification to the training regime of $\beta$-VAE, that progressively increases the information capacity of the latent code during training. This modification facilitates the robust learning of disentangled representations in $\beta$-VAE, without the previous trade-off in reconstruction accuracy.

* Presented at the 2017 NIPS Workshop on Learning Disentangled Representations  

Share this with someone who'll enjoy it: