Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Joshua B. Tenenbaum

PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics


Apr 07, 2021
Zhiao Huang, Yuanming Hu, Tao Du, Siyuan Zhou, Hao Su, Joshua B. Tenenbaum, Chuang Gan

* Accepted to ICLR 2021 as a spotlight presentation. Project page: http://plasticinelab.csail.mit.edu/ 

  Access Paper or Ask Questions

Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning


Mar 30, 2021
Zhenfang Chen, Jiayuan Mao, Jiajun Wu, Kwan-Yee Kenneth Wong, Joshua B. Tenenbaum, Chuang Gan

* ICLR 2021. Project page: http://dcl.csail.mit.edu/ 

  Access Paper or Ask Questions

The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AI


Mar 25, 2021
Chuang Gan, Siyuan Zhou, Jeremy Schwartz, Seth Alter, Abhishek Bhandwaldar, Dan Gutfreund, Daniel L. K. Yamins, James J DiCarlo, Josh McDermott, Antonio Torralba, Joshua B. Tenenbaum

* Project page: http://tdw-transport.csail.mit.edu/ 

  Access Paper or Ask Questions

PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception


Mar 19, 2021
Aviv Netanyahu, Tianmin Shu, Boris Katz, Andrei Barbu, Joshua B. Tenenbaum

* The first two authors contributed equally; AAAI 2021; 13 pages, 7 figures; Project page: https://www.tshu.io/PHASE 

  Access Paper or Ask Questions

Learning Task Decomposition with Ordered Memory Policy Network


Mar 19, 2021
Yuchen Lu, Yikang Shen, Siyuan Zhou, Aaron Courville, Joshua B. Tenenbaum, Chuang Gan


  Access Paper or Ask Questions

AGENT: A Benchmark for Core Psychological Reasoning


Feb 25, 2021
Tianmin Shu, Abhishek Bhandwaldar, Chuang Gan, Kevin A. Smith, Shari Liu, Dan Gutfreund, Elizabeth Spelke, Joshua B. Tenenbaum, Tomer D. Ullman

* 12 pages, 7 figures 

  Access Paper or Ask Questions

Augmenting Policy Learning with Routines Discovered from a Demonstration


Dec 24, 2020
Zelin Zhao, Chuang Gan, Jiajun Wu, Xiaoxiao Guo, Joshua B. Tenenbaum

* To appear in AAAI-21. Code is available at https://github.com/sjtuytc/-AAAI21-RoutineAugmentedPolicyLearning-RAPL

  Access Paper or Ask Questions

Representing Partial Programs with Blended Abstract Semantics


Dec 23, 2020
Maxwell Nye, Yewen Pu, Matthew Bowers, Jacob Andreas, Joshua B. Tenenbaum, Armando Solar-Lezama


  Access Paper or Ask Questions

Object-Centric Diagnosis of Visual Reasoning


Dec 21, 2020
Jianwei Yang, Jiayuan Mao, Jiajun Wu, Devi Parikh, David D. Cox, Joshua B. Tenenbaum, Chuang Gan


  Access Paper or Ask Questions

Neural Radiance Flow for 4D View Synthesis and Video Processing


Dec 17, 2020
Yilun Du, Yinan Zhang, Hong-Xing Yu, Joshua B. Tenenbaum, Jiajun Wu

* Website: https://yilundu.github.io/nerflow/ 

  Access Paper or Ask Questions

Multi-Plane Program Induction with 3D Box Priors


Nov 22, 2020
Yikai Li, Jiayuan Mao, Xiuming Zhang, William T. Freeman, Joshua B. Tenenbaum, Noah Snavely, Jiajun Wu

* NeurIPS 2020. First two authors contributed equally. Project page: http://bpi.csail.mit.edu 

  Access Paper or Ask Questions

Towards Human-Level Learning of Complex Physical Puzzles


Nov 14, 2020
Kei Ota, Devesh K. Jha, Diego Romeres, Jeroen van Baar, Kevin A. Smith, Takayuki Semitsu, Tomoaki Oiki, Alan Sullivan, Daniel Nikovski, Joshua B. Tenenbaum

* 10 pages, 7 figures 

  Access Paper or Ask Questions

Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration


Oct 19, 2020
Xavier Puig, Tianmin Shu, Shuang Li, Zilin Wang, Joshua B. Tenenbaum, Sanja Fidler, Antonio Torralba


  Access Paper or Ask Questions

Learning abstract structure for drawing by efficient motor program induction


Aug 08, 2020
Lucas Y. Tian, Kevin Ellis, Marta Kryven, Joshua B. Tenenbaum


  Access Paper or Ask Questions

Noisy Agents: Self-supervised Exploration by Predicting Auditory Events


Jul 27, 2020
Chuang Gan, Xiaoyu Chen, Phillip Isola, Antonio Torralba, Joshua B. Tenenbaum

* Project page: http://noisy-agent.csail.mit.edu 

  Access Paper or Ask Questions

End-to-End Optimization of Scene Layout


Jul 23, 2020
Andrew Luo, Zhoutong Zhang, Jiajun Wu, Joshua B. Tenenbaum

* CVPR 2020 (Oral). Project page: http://3dsln.csail.mit.edu/ 

  Access Paper or Ask Questions

Foley Music: Learning to Generate Music from Videos


Jul 21, 2020
Chuang Gan, Deng Huang, Peihao Chen, Joshua B. Tenenbaum, Antonio Torralba

* ECCV 2020. Project page: http://foley-music.csail.mit.edu 

  Access Paper or Ask Questions

ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation


Jul 09, 2020
Chuang Gan, Jeremy Schwartz, Seth Alter, Martin Schrimpf, James Traer, Julian De Freitas, Jonas Kubilius, Abhishek Bhandwaldar, Nick Haber, Megumi Sano, Kuno Kim, Elias Wang, Damian Mrowca, Michael Lingelbach, Aidan Curtis, Kevin Feigelis, Daniel M. Bear, Dan Gutfreund, David Cox, James J. DiCarlo, Josh McDermott, Joshua B. Tenenbaum, Daniel L. K. Yamins

* Project page: http://www.threedworld.org 

  Access Paper or Ask Questions

Learning to learn generative programs with Memoised Wake-Sleep


Jul 06, 2020
Luke B. Hewitt, Tuan Anh Le, Joshua B. Tenenbaum


  Access Paper or Ask Questions

Perspective Plane Program Induction from a Single Image


Jun 25, 2020
Yikai Li, Jiayuan Mao, Xiuming Zhang, William T. Freeman, Joshua B. Tenenbaum, Jiajun Wu

* CVPR 2020. First two authors contributed equally. Project page: http://p3i.csail.mit.edu/ 

  Access Paper or Ask Questions

Learning Physical Graph Representations from Visual Scenes


Jun 24, 2020
Daniel M. Bear, Chaofei Fan, Damian Mrowca, Yunzhu Li, Seth Alter, Aran Nayebi, Jeremy Schwartz, Li Fei-Fei, Jiajun Wu, Joshua B. Tenenbaum, Daniel L. K. Yamins

* 23 pages; corrected affiliations and acknowledgments 

  Access Paper or Ask Questions

Learning with AMIGo: Adversarially Motivated Intrinsic Goals


Jun 22, 2020
Andres Campero, Roberta Raileanu, Heinrich Küttler, Joshua B. Tenenbaum, Tim Rocktäschel, Edward Grefenstette

* 17 pages, 5 figures 

  Access Paper or Ask Questions

DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning


Jun 15, 2020
Kevin Ellis, Catherine Wong, Maxwell Nye, Mathias Sable-Meyer, Luc Cary, Lucas Morales, Luke Hewitt, Armando Solar-Lezama, Joshua B. Tenenbaum


  Access Paper or Ask Questions

Online Bayesian Goal Inference for Boundedly-Rational Planning Agents


Jun 13, 2020
Tan Zhi-Xuan, Jordyn L. Mann, Tom Silver, Joshua B. Tenenbaum, Vikash K. Mansinghka

* 11 pages, 5 figures (supplement: 8 pages, 8 figures) 

  Access Paper or Ask Questions

Visual Grounding of Learned Physical Models


Apr 28, 2020
Yunzhu Li, Toru Lin, Kexin Yi, Daniel Bear, Daniel L. K. Yamins, Jiajun Wu, Joshua B. Tenenbaum, Antonio Torralba

* The second and the third authors contributed equally to this paper, and are listed in alphabetical order. Project Page: http://visual-physics-grounding.csail.mit.edu/ 

  Access Paper or Ask Questions

Music Gesture for Visual Sound Separation


Apr 20, 2020
Chuang Gan, Deng Huang, Hang Zhao, Joshua B. Tenenbaum, Antonio Torralba

* CVPR 2020. Project page: http://music-gesture.csail.mit.edu 

  Access Paper or Ask Questions

Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense


Apr 20, 2020
Yixin Zhu, Tao Gao, Lifeng Fan, Siyuan Huang, Mark Edmonds, Hangxin Liu, Feng Gao, Chi Zhang, Siyuan Qi, Ying Nian Wu, Joshua B. Tenenbaum, Song-Chun Zhu

* Engineering, Feb, 2020 
* For high quality figures, please refer to http://wellyzhang.github.io/attach/dark.pdf 

  Access Paper or Ask Questions