Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


Structural Autoencoders Improve Representations for Generation and Transfer

Jun 14, 2020
Felix Leeb, Yashas Annadani, Stefan Bauer, Bernhard Schölkopf


Share this with someone who'll enjoy it:


We study the problem of structuring a learned representation to significantly improve performance without supervision. Unlike most methods which focus on using side information like weak supervision or defining new regularization objectives, we focus on improving the learned representation by structuring the architecture of the model. We propose a self-attention based architecture to make the encoder explicitly associate parts of the representation with parts of the input observation. Meanwhile, our structural decoder architecture encourages a hierarchical structure in the latent space, akin to structural causal models, and learns a natural ordering of the latent mechanisms. We demonstrate how these models learn a representation which improves results in a variety of downstream tasks including generation, disentanglement, and transfer using several challenging and natural image datasets.

* Submitted to NeurIPS 2020 


   Access Paper Source



Share this with someone who'll enjoy it: