Alert button

Language-Conditioned Reinforcement Learning to Solve Misunderstandings with Action Corrections

Nov 18, 2022
Frank Röder, Manfred Eppe

Figure 1 for Language-Conditioned Reinforcement Learning to Solve Misunderstandings with Action Corrections
Figure 2 for Language-Conditioned Reinforcement Learning to Solve Misunderstandings with Action Corrections
Figure 3 for Language-Conditioned Reinforcement Learning to Solve Misunderstandings with Action Corrections
Figure 4 for Language-Conditioned Reinforcement Learning to Solve Misunderstandings with Action Corrections

Share this with someone who'll enjoy it:

Human-to-human conversation is not just talking and listening. It is an incremental process where participants continually establish a common understanding to rule out misunderstandings. Current language understanding methods for intelligent robots do not consider this. There exist numerous approaches considering non-understandings, but they ignore the incremental process of resolving misunderstandings. In this article, we present a first formalization and experimental validation of incremental action-repair for robotic instruction-following based on reinforcement learning. To evaluate our approach, we propose a collection of benchmark environments for action correction in language-conditioned reinforcement learning, utilizing a synthetic instructor to generate language goals and their corresponding corrections. We show that a reinforcement learning agent can successfully learn to understand incremental corrections of misunderstood instructions.

* Accepted to the 2nd Workshop on Language in Reinforcement Learning, (NeurIPS 2022)  
View paper onarxiv icon

Share this with someone who'll enjoy it: