Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed
Listening to Sounds of Silence for Speech Denoising

Oct 22, 2020
Ruilin Xu, Rundi Wu, Yuko Ishiwaka, Carl Vondrick, Changxi Zheng

* 9 pages, 6 figures, accepted in NeurIPS 2020; Sound examples can be found at http://www.cs.columbia.edu/cg/listen_to_the_silence/ 

  Access Paper or Ask Questions

We Have So Much In Common: Modeling Semantic Relational Set Abstractions in Videos

Aug 12, 2020
Alex Andonian, Camilo Fosco, Mathew Monfort, Allen Lee, Rogerio Feris, Carl Vondrick, Aude Oliva

* European Conference on Computer Vision (ECCV) 2020, accepted 

  Access Paper or Ask Questions

Analogical Reasoning for Visually Grounded Language Acquisition

Jul 22, 2020
Bo Wu, Haoyu Qin, Alireza Zareian, Carl Vondrick, Shih-Fu Chang

* 12 pages 

  Access Paper or Ask Questions

Multitask Learning Strengthens Adversarial Robustness

Jul 14, 2020
Chengzhi Mao, Amogh Gupta, Vikram Nitin, Baishakhi Ray, Shuran Song, Junfeng Yang, Carl Vondrick


  Access Paper or Ask Questions

Video Representations of Goals Emerge from Watching Failure

Jun 28, 2020
Dave Epstein, Carl Vondrick


  Access Paper or Ask Questions

Learning to Learn Words from Narrated Video

Nov 25, 2019
Dídac Surís, Dave Epstein, Heng Ji, Shih-Fu Chang, Carl Vondrick

* 11 pages, 11 figures 

  Access Paper or Ask Questions

Oops! Predicting Unintentional Action in Video

Nov 25, 2019
Dave Epstein, Boyuan Chen, Carl Vondrick

* 11 pages, 9 figures 

  Access Paper or Ask Questions

Visual Hide and Seek

Oct 15, 2019
Boyuan Chen, Shuran Song, Hod Lipson, Carl Vondrick

* 14 pages, 8 figures 

  Access Paper or Ask Questions

Metric Learning for Adversarial Robustness

Sep 03, 2019
Chengzhi Mao, Ziyuan Zhong, Junfeng Yang, Carl Vondrick, Baishakhi Ray


  Access Paper or Ask Questions

Relational Action Forecasting

Apr 08, 2019
Chen Sun, Abhinav Shrivastava, Carl Vondrick, Rahul Sukthankar, Kevin Murphy, Cordelia Schmid

* CVPR 2019 (oral) 

  Access Paper or Ask Questions

VideoBERT: A Joint Model for Video and Language Representation Learning

Apr 03, 2019
Chen Sun, Austin Myers, Carl Vondrick, Kevin Murphy, Cordelia Schmid


  Access Paper or Ask Questions

Multi-level Multimodal Common Semantic Space for Image-Phrase Grounding

Nov 28, 2018
Hassan Akbari, Svebor Karaman, Surabhi Bhargava, Brian Chen, Carl Vondrick, Shih-Fu Chang


  Access Paper or Ask Questions

The Sound of Pixels

Oct 14, 2018
Hang Zhao, Chuang Gan, Andrew Rouditchenko, Carl Vondrick, Josh McDermott, Antonio Torralba


  Access Paper or Ask Questions

Actor-Centric Relation Network

Jul 28, 2018
Chen Sun, Abhinav Shrivastava, Carl Vondrick, Kevin Murphy, Rahul Sukthankar, Cordelia Schmid

* ECCV 2018 camera ready 

  Access Paper or Ask Questions

Tracking Emerges by Colorizing Videos

Jul 27, 2018
Carl Vondrick, Abhinav Shrivastava, Alireza Fathi, Sergio Guadarrama, Kevin Murphy

* ECCV 2018. Blog post: https://ai.googleblog.com/2018/06/self-supervised-tracking-via-video.html 

  Access Paper or Ask Questions

AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions

Apr 30, 2018
Chunhui Gu, Chen Sun, David A. Ross, Carl Vondrick, Caroline Pantofaru, Yeqing Li, Sudheendra Vijayanarasimhan, George Toderici, Susanna Ricco, Rahul Sukthankar, Cordelia Schmid, Jitendra Malik

* To appear in CVPR 2018. Check dataset page https://research.google.com/ava/ for details 

  Access Paper or Ask Questions

Moments in Time Dataset: one million videos for event understanding

Jan 09, 2018
Mathew Monfort, Bolei Zhou, Sarah Adel Bargal, Alex Andonian, Tom Yan, Kandan Ramakrishnan, Lisa Brown, Quanfu Fan, Dan Gutfruend, Carl Vondrick, Aude Oliva


  Access Paper or Ask Questions

See, Hear, and Read: Deep Aligned Representations

Jun 03, 2017
Yusuf Aytar, Carl Vondrick, Antonio Torralba


  Access Paper or Ask Questions

Who is Mistaken?

Mar 31, 2017
Benjamin Eysenbach, Carl Vondrick, Antonio Torralba

* See project website at: http://people.csail.mit.edu/bce/mistaken/ . (Edit: fixed typos and references) 

  Access Paper or Ask Questions

Following Gaze Across Views

Dec 09, 2016
Adrià Recasens, Carl Vondrick, Aditya Khosla, Antonio Torralba

* 9 pages, 8 figures 

  Access Paper or Ask Questions

Predicting Motivations of Actions by Leveraging Text

Nov 30, 2016
Carl Vondrick, Deniz Oktay, Hamed Pirsiavash, Antonio Torralba

* CVPR 2016 

  Access Paper or Ask Questions

Anticipating Visual Representations from Unlabeled Video

Nov 30, 2016
Carl Vondrick, Hamed Pirsiavash, Antonio Torralba

* CVPR 2016 

  Access Paper or Ask Questions

Cross-Modal Scene Networks

Oct 27, 2016
Yusuf Aytar, Lluis Castrejon, Carl Vondrick, Hamed Pirsiavash, Antonio Torralba

* See more at http://cmplaces.csail.mit.edu/. arXiv admin note: text overlap with arXiv:1607.07295 

  Access Paper or Ask Questions

SoundNet: Learning Sound Representations from Unlabeled Video

Oct 27, 2016
Yusuf Aytar, Carl Vondrick, Antonio Torralba

* NIPS 2016 

  Access Paper or Ask Questions

Generating Videos with Scene Dynamics

Oct 26, 2016
Carl Vondrick, Hamed Pirsiavash, Antonio Torralba

* NIPS 2016. See more at http://web.mit.edu/vondrick/tinyvideo/ 

  Access Paper or Ask Questions

Learning Aligned Cross-Modal Representations from Weakly Aligned Data

Jul 25, 2016
Lluis Castrejon, Yusuf Aytar, Carl Vondrick, Hamed Pirsiavash, Antonio Torralba

* Conference paper at CVPR 2016 

  Access Paper or Ask Questions

Learning visual biases from human imagination

Nov 16, 2015
Carl Vondrick, Hamed Pirsiavash, Aude Oliva, Antonio Torralba

* To appear at NIPS 2015 

  Access Paper or Ask Questions

Do We Need More Training Data?

Mar 05, 2015
Xiangxin Zhu, Carl Vondrick, Charless Fowlkes, Deva Ramanan


  Access Paper or Ask Questions

Visualizing Object Detection Features

Feb 19, 2015
Carl Vondrick, Aditya Khosla, Hamed Pirsiavash, Tomasz Malisiewicz, Antonio Torralba

* In submission to IJCV 

  Access Paper or Ask Questions

Inverting and Visualizing Features for Object Detection

May 05, 2013
Carl Vondrick, Aditya Khosla, Tomasz Malisiewicz, Antonio Torralba

* This paper is a preprint of our conference paper. We have made it available early in the hopes that others find it useful 

  Access Paper or Ask Questions