Antonio Torralba

Rewriting a Deep Generative Model

Jul 30, 2020
David Bau, Steven Liu, Tongzhou Wang, Jun-Yan Zhu, Antonio Torralba

* ECCV 2020 (oral). Code at https://github.com/davidbau/rewriting. For videos and demos see https://rewriting.csail.mit.edu/

Access Model/Code and Paper

Noisy Agents: Self-supervised Exploration by Predicting Auditory Events

Jul 27, 2020
Chuang Gan, Xiaoyu Chen, Phillip Isola, Antonio Torralba, Joshua B. Tenenbaum

* Project page: http://noisy-agent.csail.mit.edu

Access Model/Code and Paper

Foley Music: Learning to Generate Music from Videos

Jul 21, 2020
Chuang Gan, Deng Huang, Peihao Chen, Joshua B. Tenenbaum, Antonio Torralba

* ECCV 2020. Project page: http://foley-music.csail.mit.edu

Access Model/Code and Paper

Estimating Generalization under Distribution Shifts via Domain-Invariant Representations

Jul 06, 2020
Ching-Yao Chuang, Antonio Torralba, Stefanie Jegelka

* International Conference on Machine Learning, 2020
* arXiv admin note: text overlap with arXiv:1910.05804

Access Model/Code and Paper

Debiased Contrastive Learning

Jul 05, 2020
Ching-Yao Chuang, Joshua Robinson, Lin Yen-Chen, Antonio Torralba, Stefanie Jegelka

Access Model/Code and Paper

Causal Discovery in Physical Systems from Videos

Jul 02, 2020
Yunzhu Li, Antonio Torralba, Animashree Anandkumar, Dieter Fox, Animesh Garg

* Project page: https://yunzhuli.github.io/V-CDN/

Access Model/Code and Paper

Diverse Image Generation via Self-Conditioned GANs

Jun 18, 2020
Steven Liu, Tongzhou Wang, David Bau, Jun-Yan Zhu, Antonio Torralba

* CVPR 2020. Code: https://github.com/stevliu/self-conditioned-gan. Webpage: http://selfcondgan.csail.mit.edu/

Access Model/Code and Paper

AVLnet: Learning Audio-Visual Language Representations from Instructional Videos

Jun 16, 2020
Andrew Rouditchenko, Angie Boggust, David Harwath, Dhiraj Joshi, Samuel Thomas, Kartik Audhkhasi, Rogerio Feris, Brian Kingsbury, Michael Picheny, Antonio Torralba, James Glass

Access Model/Code and Paper

Learning to Simulate Dynamic Environments with GameGAN

May 25, 2020
Seung Wook Kim, Yuhao Zhou, Jonah Philion, Antonio Torralba, Sanja Fidler

* CVPR 2020

Access Model/Code and Paper

Semantic Photo Manipulation with a Generative Image Prior

May 15, 2020
David Bau, Hendrik Strobelt, William Peebles, Jonas, Bolei Zhou, Jun-Yan Zhu, Antonio Torralba

* Bau, David, et al. "Semantic photo manipulation with a generative image prior." ACM Transactions on Graphics (TOG) 38.4 (2019)
* SIGGRAPH 2019

Access Model/Code and Paper

Visual Grounding of Learned Physical Models

Apr 28, 2020
Yunzhu Li, Toru Lin, Kexin Yi, Daniel Bear, Daniel L. K. Yamins, Jiajun Wu, Joshua B. Tenenbaum, Antonio Torralba

* The second and the third authors contributed equally to this paper, and are listed in alphabetical order. Project Page: http://visual-physics-grounding.csail.mit.edu/

Access Model/Code and Paper

Music Gesture for Visual Sound Separation

Apr 20, 2020
Chuang Gan, Deng Huang, Hang Zhao, Joshua B. Tenenbaum, Antonio Torralba

* CVPR 2020. Project page: http://music-gesture.csail.mit.edu

Access Model/Code and Paper

Self-supervised Moving Vehicle Tracking with Stereo Sound

Oct 25, 2019
Chuang Gan, Hang Zhao, Peihao Chen, David Cox, Antonio Torralba

* To appear at ICCV 2019. Project page: http://sound-track.csail.mit.edu

Access Model/Code and Paper

Seeing What a GAN Cannot Generate

Oct 24, 2019
David Bau, Jun-Yan Zhu, Jonas Wulff, William Peebles, Hendrik Strobelt, Bolei Zhou, Antonio Torralba

* ICCV 2019 oral; http://ganseeing.csail.mit.edu/

Access Model/Code and Paper

Gaze360: Physically Unconstrained Gaze Estimation in the Wild

Oct 22, 2019
Petr Kellnhofer, Adria Recasens, Simon Stent, Wojciech Matusik, Antonio Torralba

* International Conference in Computer Vision, 2019

Access Model/Code and Paper

Learning Compositional Koopman Operators for Model-Based Control

Oct 18, 2019
Yunzhu Li, Hao He, Jiajun Wu, Dina Katabi, Antonio Torralba

* The first two authors contributed equally to this paper. Project Page: http://koopman.csail.mit.edu/ Video: https://www.youtube.com/watch?v=idFH4K16cfQ&feature=youtu.be

Access Model/Code and Paper

The Role of Embedding Complexity in Domain-invariant Representations

Oct 13, 2019
Ching-Yao Chuang, Antonio Torralba, Stefanie Jegelka

Access Model/Code and Paper

Neural Turtle Graphics for Modeling City Road Layouts

Oct 04, 2019
Hang Chu, Daiqing Li, David Acuna, Amlan Kar, Maria Shugrina, Xinkai Wei, Ming-Yu Liu, Antonio Torralba, Sanja Fidler

* ICCV-2019 Oral

Access Model/Code and Paper

CLEVRER: CoLlision Events for Video REpresentation and Reasoning

Oct 03, 2019
Kexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum

* The first two authors contributed equally to this work. Project page: http://clevrer.csail.mit.edu/

Access Model/Code and Paper

Connecting Touch and Vision via Cross-Modal Prediction

Jun 14, 2019
Yunzhu Li, Jun-Yan Zhu, Russ Tedrake, Antonio Torralba

* Accepted to CVPR 2019. Project Page: http://visgel.csail.mit.edu/

Access Model/Code and Paper

How to make a pizza: Learning a compositional layer-based GAN model

Jun 06, 2019
Dim P. Papadopoulos, Youssef Tamaazousti, Ferda Ofli, Ingmar Weber, Antonio Torralba

* CVPR 2019

Access Model/Code and Paper

Meta-Sim: Learning to Generate Synthetic Datasets

Apr 25, 2019
Amlan Kar, Aayush Prakash, Ming-Yu Liu, Eric Cameracci, Justin Yuan, Matt Rusiniak, David Acuna, Antonio Torralba, Sanja Fidler

* Webpage: https://nv-tlabs.github.io/meta-sim/

Access Model/Code and Paper

Self-Supervised Audio-Visual Co-Segmentation

Apr 18, 2019
Andrew Rouditchenko, Hang Zhao, Chuang Gan, Josh McDermott, Antonio Torralba

* Accepted to ICASSP 2019

Access Model/Code and Paper

The Sound of Motions

Apr 11, 2019
Hang Zhao, Chuang Gan, Wei-Chiu Ma, Antonio Torralba

Access Model/Code and Paper

Visualizing and Understanding Generative Adversarial Networks (Extended Abstract)

Jan 29, 2019
David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B. Tenenbaum, William T. Freeman, Antonio Torralba

* In AAAI-19 workshop on Network Interpretability for Deep Learning arXiv admin note: substantial text overlap with arXiv:1811.10597

Access Model/Code and Paper

GAN Dissection: Visualizing and Understanding Generative Adversarial Networks

Dec 08, 2018
David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B. Tenenbaum, William T. Freeman, Antonio Torralba

* 18 pages, 19 figures

Access Model/Code and Paper

Visual Object Networks: Image Generation with Disentangled 3D Representation

Dec 06, 2018
Jun-Yan Zhu, Zhoutong Zhang, Chengkai Zhang, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum, William T. Freeman

* NeurIPS 2018. Code: https://github.com/junyanz/VON Website: http://von.csail.mit.edu/

Access Model/Code and Paper

Dataset Distillation

Nov 27, 2018
Tongzhou Wang, Jun-Yan Zhu, Antonio Torralba, Alexei A. Efros

Access Model/Code and Paper

Semantic Understanding of Scenes through the ADE20K Dataset

Oct 16, 2018
Bolei Zhou, Hang Zhao, Xavier Puig, Tete Xiao, Sanja Fidler, Adela Barriuso, Antonio Torralba

* IJCV extension

Access Model/Code and Paper

Recipe1M: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images

Oct 14, 2018
Javier Marin, Aritro Biswas, Ferda Ofli, Nicholas Hynes, Amaia Salvador, Yusuf Aytar, Ingmar Weber, Antonio Torralba

* Submitted to Transactions on Pattern Analysis and Machine Intelligence

Access Model/Code and Paper