Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Models

Nov 02, 2018
Kurtland Chua, Roberto Calandra, Rowan McAllister, Sergey Levine



Model-based reinforcement learning (RL) algorithms can attain excellent sample efficiency, but often lag behind the best model-free algorithms in terms of asymptotic performance. This is especially true with high-capacity parametric function approximators, such as deep networks. In this paper, we study how to bridge this gap, by employing uncertainty-aware dynamics models. We propose a new algorithm called probabilistic ensembles with trajectory sampling (PETS) that combines uncertainty-aware deep network dynamics models with sampling-based uncertainty propagation. Our comparison to state-of-the-art model-based and model-free deep RL algorithms shows that our approach matches the asymptotic performance of model-free algorithms on several challenging benchmark tasks, while requiring significantly fewer samples (e.g., 8 and 125 times fewer samples than Soft Actor Critic and Proximal Policy Optimization respectively on the half-cheetah task).

* NIPS 2018, video and code available at https://sites.google.com/view/drl-in-a-handful-of-trials/ 


Share this with someone who'll enjoy it:

   Access Paper Source



Share this with someone who'll enjoy it: