Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed
Learning abstract structure for drawing by efficient motor program induction

Aug 08, 2020
Lucas Y. Tian, Kevin Ellis, Marta Kryven, Joshua B. Tenenbaum


  Access Model/Code and Paper
Noisy Agents: Self-supervised Exploration by Predicting Auditory Events

Jul 27, 2020
Chuang Gan, Xiaoyu Chen, Phillip Isola, Antonio Torralba, Joshua B. Tenenbaum

* Project page: http://noisy-agent.csail.mit.edu 

  Access Model/Code and Paper
End-to-End Optimization of Scene Layout

Jul 23, 2020
Andrew Luo, Zhoutong Zhang, Jiajun Wu, Joshua B. Tenenbaum

* CVPR 2020 (Oral). Project page: http://3dsln.csail.mit.edu/ 

  Access Model/Code and Paper
Foley Music: Learning to Generate Music from Videos

Jul 21, 2020
Chuang Gan, Deng Huang, Peihao Chen, Joshua B. Tenenbaum, Antonio Torralba

* ECCV 2020. Project page: http://foley-music.csail.mit.edu 

  Access Model/Code and Paper
ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation

Jul 09, 2020
Chuang Gan, Jeremy Schwartz, Seth Alter, Martin Schrimpf, James Traer, Julian De Freitas, Jonas Kubilius, Abhishek Bhandwaldar, Nick Haber, Megumi Sano, Kuno Kim, Elias Wang, Damian Mrowca, Michael Lingelbach, Aidan Curtis, Kevin Feigelis, Daniel M. Bear, Dan Gutfreund, David Cox, James J. DiCarlo, Josh McDermott, Joshua B. Tenenbaum, Daniel L. K. Yamins

* Project page: http://www.threedworld.org 

  Access Model/Code and Paper
Learning to learn generative programs with Memoised Wake-Sleep

Jul 06, 2020
Luke B. Hewitt, Tuan Anh Le, Joshua B. Tenenbaum


  Access Model/Code and Paper
Perspective Plane Program Induction from a Single Image

Jun 25, 2020
Yikai Li, Jiayuan Mao, Xiuming Zhang, William T. Freeman, Joshua B. Tenenbaum, Jiajun Wu

* CVPR 2020. First two authors contributed equally. Project page: http://p3i.csail.mit.edu/ 

  Access Model/Code and Paper
Learning Physical Graph Representations from Visual Scenes

Jun 24, 2020
Daniel M. Bear, Chaofei Fan, Damian Mrowca, Yunzhu Li, Seth Alter, Aran Nayebi, Jeremy Schwartz, Li Fei-Fei, Jiajun Wu, Joshua B. Tenenbaum, Daniel L. K. Yamins

* 23 pages; corrected affiliations and acknowledgments 

  Access Model/Code and Paper
Learning with AMIGo: Adversarially Motivated Intrinsic Goals

Jun 22, 2020
Andres Campero, Roberta Raileanu, Heinrich K√ľttler, Joshua B. Tenenbaum, Tim Rockt√§schel, Edward Grefenstette

* 17 pages, 5 figures 

  Access Model/Code and Paper
DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning

Jun 15, 2020
Kevin Ellis, Catherine Wong, Maxwell Nye, Mathias Sable-Meyer, Luc Cary, Lucas Morales, Luke Hewitt, Armando Solar-Lezama, Joshua B. Tenenbaum


  Access Model/Code and Paper
Online Bayesian Goal Inference for Boundedly-Rational Planning Agents

Jun 13, 2020
Tan Zhi-Xuan, Jordyn L. Mann, Tom Silver, Joshua B. Tenenbaum, Vikash K. Mansinghka

* 11 pages, 5 figures (supplement: 8 pages, 8 figures) 

  Access Model/Code and Paper
Visual Grounding of Learned Physical Models

Apr 28, 2020
Yunzhu Li, Toru Lin, Kexin Yi, Daniel Bear, Daniel L. K. Yamins, Jiajun Wu, Joshua B. Tenenbaum, Antonio Torralba

* The second and the third authors contributed equally to this paper, and are listed in alphabetical order. Project Page: http://visual-physics-grounding.csail.mit.edu/ 

  Access Model/Code and Paper
Music Gesture for Visual Sound Separation

Apr 20, 2020
Chuang Gan, Deng Huang, Hang Zhao, Joshua B. Tenenbaum, Antonio Torralba

* CVPR 2020. Project page: http://music-gesture.csail.mit.edu 

  Access Model/Code and Paper
Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense

Apr 20, 2020
Yixin Zhu, Tao Gao, Lifeng Fan, Siyuan Huang, Mark Edmonds, Hangxin Liu, Feng Gao, Chi Zhang, Siyuan Qi, Ying Nian Wu, Joshua B. Tenenbaum, Song-Chun Zhu

* Engineering, Feb, 2020 
* For high quality figures, please refer to http://wellyzhang.github.io/attach/dark.pdf 

  Access Model/Code and Paper
Too many cooks: Coordinating multi-agent collaboration through inverse planning

Mar 26, 2020
Rose E. Wang, Sarah A. Wu, James A. Evans, Joshua B. Tenenbaum, David C. Parkes, Max Kleiman-Weiner

* Rose E. Wang and Sarah A. Wu contributed equally. Accepted as an extended abstract to AAMAS 2020 

  Access Model/Code and Paper
Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?

Mar 25, 2020
Yonglong Tian, Yue Wang, Dilip Krishnan, Joshua B. Tenenbaum, Phillip Isola

* First two authors contributed equally. Code: http://github.com/WangYueFt/rfs/ 

  Access Model/Code and Paper
Learning Compositional Rules via Neural Program Synthesis

Mar 12, 2020
Maxwell I. Nye, Armando Solar-Lezama, Joshua B. Tenenbaum, Brenden M. Lake


  Access Model/Code and Paper
Visual Concept-Metaconcept Learning

Feb 04, 2020
Chi Han, Jiayuan Mao, Chuang Gan, Joshua B. Tenenbaum, Jiajun Wu

* NeurIPS 2019. First two authors contributed equally. Project page: http://vcml.csail.mit.edu/ 

  Access Model/Code and Paper
Look, Listen, and Act: Towards Audio-Visual Embodied Navigation

Dec 25, 2019
Chuang Gan, Yiwei Zhang, Jiajun Wu, Boqing Gong, Joshua B. Tenenbaum


  Access Model/Code and Paper
Entity Abstraction in Visual Model-Based Reinforcement Learning

Dec 04, 2019
Rishi Veerapaneni, John D. Co-Reyes, Michael Chang, Michael Janner, Chelsea Finn, Jiajun Wu, Joshua B. Tenenbaum, Sergey Levine

* Accepted at CoRL 2019 

  Access Model/Code and Paper
Accurate Vision-based Manipulation through Contact Reasoning

Nov 08, 2019
Alina Kloss, Maria Bauza, Jiajun Wu, Joshua B. Tenenbaum, Alberto Rodriguez, Jeannette Bohg

* submitted to ICRA 2020 

  Access Model/Code and Paper
CLEVRER: CoLlision Events for Video REpresentation and Reasoning

Oct 03, 2019
Kexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum

* The first two authors contributed equally to this work. Project page: http://clevrer.csail.mit.edu/ 

  Access Model/Code and Paper
Dual Sequential Monte Carlo: Tunneling Filtering and Planning in Continuous POMDPs

Sep 28, 2019
Yunbo Wang, Bo Liu, Jiajun Wu, Yuke Zhu, Simon S. Du, Li Fei-Fei, Joshua B. Tenenbaum


  Access Model/Code and Paper
Program-Guided Image Manipulators

Sep 04, 2019
Jiayuan Mao, Xiuming Zhang, Yikai Li, William T. Freeman, Joshua B. Tenenbaum, Jiajun Wu

* ICCV 2019. First two authors contributed equally. Project page: http://pgim.csail.mit.edu/ 

  Access Model/Code and Paper
The Tools Challenge: Rapid Trial-and-Error Learning in Physical Problem Solving

Jul 25, 2019
Kelsey R. Allen, Kevin A. Smith, Joshua B. Tenenbaum

* This manuscript is an extended version of a paper "Rapid Trial-and-Error Learning in Physical Problem Solving" accepted for oral presentation at the 41st Annual Meeting of the Cognitive Science Society (2019). It represents ongoing work on the part of the authors 

  Access Model/Code and Paper
Neurally-Guided Structure Inference

Jun 17, 2019
Sidi Lu, Jiayuan Mao, Joshua B. Tenenbaum, Jiajun Wu

* PMLR(2019)97: 4144--4153 
* Proceedings of the 36th International Conference on Machine Learning (ICML 2019). First two authors contributed equally. Project page: http://ngsi.csail.mit.edu 

  Access Model/Code and Paper
DensePhysNet: Learning Dense Physical Object Representations via Multi-step Dynamic Interactions

Jun 11, 2019
Zhenjia Xu, Jiajun Wu, Andy Zeng, Joshua B. Tenenbaum, Shuran Song

* RSS 2019. Project page: http://zhenjiaxu.com/DensePhysNet 

  Access Model/Code and Paper