Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


Learning Predictive Representations for Deformable Objects Using Contrastive Estimation

Mar 11, 2020
Wilson Yan, Ashwin Vangipuram, Pieter Abbeel, Lerrel Pinto


Share this with someone who'll enjoy it:


Using visual model-based learning for deformable object manipulation is challenging due to difficulties in learning plannable visual representations along with complex dynamic models. In this work, we propose a new learning framework that jointly optimizes both the visual representation model and the dynamics model using contrastive estimation. Using simulation data collected by randomly perturbing deformable objects on a table, we learn latent dynamics models for these objects in an offline fashion. Then, using the learned models, we use simple model-based planning to solve challenging deformable object manipulation tasks such as spreading ropes and cloths. Experimentally, we show substantial improvements in performance over standard model-based learning techniques across our rope and cloth manipulation suite. Finally, we transfer our visual manipulation policies trained on data purely collected in simulation to a real PR2 robot through domain randomization.

* Project website: https://sites.google.com/view/contrastive-predictive-model 


   Access Paper Source



Share this with someone who'll enjoy it: