Alert button

Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning

May 14, 2020
Angeliki Lazaridou, Anna Potapenko, Olivier Tieleman

Figure 1 for Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning
Figure 2 for Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning
Figure 3 for Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning
Figure 4 for Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning

Share this with someone who'll enjoy it:

We present a method for combining multi-agent communication and traditional data-driven approaches to natural language learning, with an end goal of teaching agents to communicate with humans in natural language. Our starting point is a language model that has been trained on generic, not task-specific language data. We then place this model in a multi-agent self-play environment that generates task-specific rewards used to adapt or modulate the model, turning it into a task-conditional language model. We introduce a new way for combining the two types of learning based on the idea of reranking language model samples, and show that this method outperforms others in communicating with humans in a visual referential communication task. Finally, we present a taxonomy of different types of language drift that can occur alongside a set of measures to detect them.

* to appear at ACL 2020  
View paper onarxiv icon

Share this with someone who'll enjoy it: