Alert button

Shaping representations through communication: community size effect in artificial learning systems

Dec 12, 2019
Olivier Tieleman, Angeliki Lazaridou, Shibl Mourad, Charles Blundell, Doina Precup

Figure 1 for Shaping representations through communication: community size effect in artificial learning systems
Figure 2 for Shaping representations through communication: community size effect in artificial learning systems
Figure 3 for Shaping representations through communication: community size effect in artificial learning systems

Share this with someone who'll enjoy it:

Motivated by theories of language and communication that explain why communities with large numbers of speakers have, on average, simpler languages with more regularity, we cast the representation learning problem in terms of learning to communicate. Our starting point sees the traditional autoencoder setup as a single encoder with a fixed decoder partner that must learn to communicate. Generalizing from there, we introduce community-based autoencoders in which multiple encoders and decoders collectively learn representations by being randomly paired up on successive training iterations. We find that increasing community sizes reduce idiosyncrasies in the learned codes, resulting in representations that better encode concept categories and correlate with human feature norms.

* NeurIPS 2019 workshop on visually grounded interaction and language  
View paper onarxiv icon

Share this with someone who'll enjoy it: