Alert button

Towards Continual Reinforcement Learning: A Review and Perspectives

Dec 25, 2020
Khimya Khetarpal, Matthew Riemer, Irina Rish, Doina Precup

Figure 1 for Towards Continual Reinforcement Learning: A Review and Perspectives
Figure 2 for Towards Continual Reinforcement Learning: A Review and Perspectives
Figure 3 for Towards Continual Reinforcement Learning: A Review and Perspectives
Figure 4 for Towards Continual Reinforcement Learning: A Review and Perspectives

Share this with someone who'll enjoy it:

In this article, we aim to provide a literature review of different formulations and approaches to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We begin by discussing our perspective on why RL is a natural fit for studying continual learning. We then provide a taxonomy of different continual RL formulations and mathematically characterize the non-stationary dynamics of each setting. We go on to discuss evaluation of continual RL agents, providing an overview of benchmarks used in the literature and important metrics for understanding agent performance. Finally, we highlight open problems and challenges in bridging the gap between the current state of continual RL and findings in neuroscience. While still in its early days, the study of continual RL has the promise to develop better incremental reinforcement learners that can function in increasingly realistic applications where non-stationarity plays a vital role. These include applications such as those in the fields of healthcare, education, logistics, and robotics.

* Preprint, 52 pages, 8 figures  
View paper onarxiv icon

Share this with someone who'll enjoy it: