Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Chen Sun

Chen Sun

Episodic Transformer for Vision-and-Language Navigation


May 13, 2021
Alexander Pashevich, Cordelia Schmid, Chen Sun

Figure 1 for Episodic Transformer for Vision-and-Language Navigation
Figure 2 for Episodic Transformer for Vision-and-Language Navigation
Figure 3 for Episodic Transformer for Vision-and-Language Navigation
Figure 4 for Episodic Transformer for Vision-and-Language Navigation
* Code available at https://github.com/alexpashevich/E.T.; 19 pages 
  Access Paper or Ask Questions

Local Metrics for Multi-Object Tracking


Apr 06, 2021
Jack Valmadre, Alex Bewley, Jonathan Huang, Chen Sun, Cristian Sminchisescu, Cordelia Schmid

Figure 1 for Local Metrics for Multi-Object Tracking
Figure 2 for Local Metrics for Multi-Object Tracking
Figure 3 for Local Metrics for Multi-Object Tracking
Figure 4 for Local Metrics for Multi-Object Tracking

  Access Paper or Ask Questions

Composable Augmentation Encoding for Video Representation Learning


Apr 01, 2021
Chen Sun, Arsha Nagrani, Yonglong Tian, Cordelia Schmid

Figure 1 for Composable Augmentation Encoding for Video Representation Learning
Figure 2 for Composable Augmentation Encoding for Video Representation Learning
Figure 3 for Composable Augmentation Encoding for Video Representation Learning
Figure 4 for Composable Augmentation Encoding for Video Representation Learning

  Access Paper or Ask Questions

ViViT: A Video Vision Transformer


Mar 29, 2021
Anurag Arnab, Mostafa Dehghani, Georg Heigold, Chen Sun, Mario Lučić, Cordelia Schmid

Figure 1 for ViViT: A Video Vision Transformer
Figure 2 for ViViT: A Video Vision Transformer
Figure 3 for ViViT: A Video Vision Transformer
Figure 4 for ViViT: A Video Vision Transformer

  Access Paper or Ask Questions

Unified Graph Structured Models for Video Understanding


Mar 29, 2021
Anurag Arnab, Chen Sun, Cordelia Schmid

Figure 1 for Unified Graph Structured Models for Video Understanding
Figure 2 for Unified Graph Structured Models for Video Understanding
Figure 3 for Unified Graph Structured Models for Video Understanding
Figure 4 for Unified Graph Structured Models for Video Understanding

  Access Paper or Ask Questions

Learning Temporal Dynamics from Cycles in Narrated Video


Jan 07, 2021
Dave Epstein, Jiajun Wu, Cordelia Schmid, Chen Sun

Figure 1 for Learning Temporal Dynamics from Cycles in Narrated Video
Figure 2 for Learning Temporal Dynamics from Cycles in Narrated Video
Figure 3 for Learning Temporal Dynamics from Cycles in Narrated Video
Figure 4 for Learning Temporal Dynamics from Cycles in Narrated Video

  Access Paper or Ask Questions

TNT: Target-driveN Trajectory Prediction


Aug 21, 2020
Hang Zhao, Jiyang Gao, Tian Lan, Chen Sun, Benjamin Sapp, Balakrishnan Varadarajan, Yue Shen, Yi Shen, Yuning Chai, Cordelia Schmid, Congcong Li, Dragomir Anguelov

Figure 1 for TNT: Target-driveN Trajectory Prediction
Figure 2 for TNT: Target-driveN Trajectory Prediction
Figure 3 for TNT: Target-driveN Trajectory Prediction
Figure 4 for TNT: Target-driveN Trajectory Prediction

  Access Paper or Ask Questions

The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)


Aug 03, 2020
Samuel Albanie, Yang Liu, Arsha Nagrani, Antoine Miech, Ernesto Coto, Ivan Laptev, Rahul Sukthankar, Bernard Ghanem, Andrew Zisserman, Valentin Gabeur, Chen Sun, Karteek Alahari, Cordelia Schmid, Shizhe Chen, Yida Zhao, Qin Jin, Kaixu Cui, Hui Liu, Chen Wang, Yudong Jiang, Xiaoshuai Hao

Figure 1 for The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)
Figure 2 for The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)
Figure 3 for The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)
Figure 4 for The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)
* Individual reports, dataset information, rules, and released source code can be found at the competition webpage (https://www.robots.ox.ac.uk/~vgg/challenges/video-pentathlon) 
  Access Paper or Ask Questions

Learning Video Representations from Textual Web Supervision


Jul 29, 2020
Jonathan C. Stroud, David A. Ross, Chen Sun, Jia Deng, Rahul Sukthankar, Cordelia Schmid

Figure 1 for Learning Video Representations from Textual Web Supervision
Figure 2 for Learning Video Representations from Textual Web Supervision
Figure 3 for Learning Video Representations from Textual Web Supervision
Figure 4 for Learning Video Representations from Textual Web Supervision

  Access Paper or Ask Questions

Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos


Jul 21, 2020
Anurag Arnab, Chen Sun, Arsha Nagrani, Cordelia Schmid

Figure 1 for Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
Figure 2 for Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
Figure 3 for Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
Figure 4 for Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
* ECCV 2020 
  Access Paper or Ask Questions

Multi-modal Transformer for Video Retrieval


Jul 21, 2020
Valentin Gabeur, Chen Sun, Karteek Alahari, Cordelia Schmid

Figure 1 for Multi-modal Transformer for Video Retrieval
Figure 2 for Multi-modal Transformer for Video Retrieval
Figure 3 for Multi-modal Transformer for Video Retrieval
Figure 4 for Multi-modal Transformer for Video Retrieval
* ECCV 2020 (spotlight paper) 
  Access Paper or Ask Questions

What makes for good views for contrastive learning


May 20, 2020
Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan, Cordelia Schmid, Phillip Isola

Figure 1 for What makes for good views for contrastive learning
Figure 2 for What makes for good views for contrastive learning
Figure 3 for What makes for good views for contrastive learning
Figure 4 for What makes for good views for contrastive learning
* submitted to ECCV 2020 
  Access Paper or Ask Questions

VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation


May 08, 2020
Jiyang Gao, Chen Sun, Hang Zhao, Yi Shen, Dragomir Anguelov, Congcong Li, Cordelia Schmid

Figure 1 for VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation
Figure 2 for VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation
Figure 3 for VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation
Figure 4 for VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation
* CVPR 2020 
  Access Paper or Ask Questions

Speech2Action: Cross-modal Supervision for Action Recognition


Mar 30, 2020
Arsha Nagrani, Chen Sun, David Ross, Rahul Sukthankar, Cordelia Schmid, Andrew Zisserman

Figure 1 for Speech2Action: Cross-modal Supervision for Action Recognition
Figure 2 for Speech2Action: Cross-modal Supervision for Action Recognition
Figure 3 for Speech2Action: Cross-modal Supervision for Action Recognition
Figure 4 for Speech2Action: Cross-modal Supervision for Action Recognition
* Accepted to CVPR 2020 
  Access Paper or Ask Questions

Unsupervised Learning of Object Structure and Dynamics from Videos


Jun 19, 2019
Matthias Minderer, Chen Sun, Ruben Villegas, Forrester Cole, Kevin Murphy, Honglak Lee

Figure 1 for Unsupervised Learning of Object Structure and Dynamics from Videos
Figure 2 for Unsupervised Learning of Object Structure and Dynamics from Videos
Figure 3 for Unsupervised Learning of Object Structure and Dynamics from Videos
Figure 4 for Unsupervised Learning of Object Structure and Dynamics from Videos

  Access Paper or Ask Questions

Contrastive Bidirectional Transformer for Temporal Representation Learning


Jun 13, 2019
Chen Sun, Fabien Baradel, Kevin Murphy, Cordelia Schmid

Figure 1 for Contrastive Bidirectional Transformer for Temporal Representation Learning
Figure 2 for Contrastive Bidirectional Transformer for Temporal Representation Learning
Figure 3 for Contrastive Bidirectional Transformer for Temporal Representation Learning
Figure 4 for Contrastive Bidirectional Transformer for Temporal Representation Learning

  Access Paper or Ask Questions

Intra-Ensemble in Neural Networks


Apr 09, 2019
Yuan Gao, Zixiang Cai, Yimin Chen, Wenke Chen, Kan Yang, Chen Sun, Cong Yao

Figure 1 for Intra-Ensemble in Neural Networks
Figure 2 for Intra-Ensemble in Neural Networks
Figure 3 for Intra-Ensemble in Neural Networks
Figure 4 for Intra-Ensemble in Neural Networks

  Access Paper or Ask Questions

Relational Action Forecasting


Apr 08, 2019
Chen Sun, Abhinav Shrivastava, Carl Vondrick, Rahul Sukthankar, Kevin Murphy, Cordelia Schmid

Figure 1 for Relational Action Forecasting
Figure 2 for Relational Action Forecasting
Figure 3 for Relational Action Forecasting
Figure 4 for Relational Action Forecasting
* CVPR 2019 (oral) 
  Access Paper or Ask Questions

VideoBERT: A Joint Model for Video and Language Representation Learning


Apr 03, 2019
Chen Sun, Austin Myers, Carl Vondrick, Kevin Murphy, Cordelia Schmid

Figure 1 for VideoBERT: A Joint Model for Video and Language Representation Learning
Figure 2 for VideoBERT: A Joint Model for Video and Language Representation Learning
Figure 3 for VideoBERT: A Joint Model for Video and Language Representation Learning
Figure 4 for VideoBERT: A Joint Model for Video and Language Representation Learning

  Access Paper or Ask Questions

Affordance Learning In Direct Perception for Autonomous Driving


Mar 20, 2019
Chen Sun, Jean M. Uwabeza Vianney, Dongpu Cao

Figure 1 for Affordance Learning In Direct Perception for Autonomous Driving
Figure 2 for Affordance Learning In Direct Perception for Autonomous Driving
Figure 3 for Affordance Learning In Direct Perception for Autonomous Driving
Figure 4 for Affordance Learning In Direct Perception for Autonomous Driving
* 9 pages, 13 figures 
  Access Paper or Ask Questions

Unsupervised Discovery of Parts, Structure, and Dynamics


Mar 12, 2019
Zhenjia Xu, Zhijian Liu, Chen Sun, Kevin Murphy, William T. Freeman, Joshua B. Tenenbaum, Jiajun Wu

Figure 1 for Unsupervised Discovery of Parts, Structure, and Dynamics
Figure 2 for Unsupervised Discovery of Parts, Structure, and Dynamics
Figure 3 for Unsupervised Discovery of Parts, Structure, and Dynamics
Figure 4 for Unsupervised Discovery of Parts, Structure, and Dynamics
* ICLR 2019. The first two authors contributed equally to this work 
  Access Paper or Ask Questions

Stochastic Prediction of Multi-Agent Interactions from Partial Observations


Feb 25, 2019
Chen Sun, Per Karlsson, Jiajun Wu, Joshua B Tenenbaum, Kevin Murphy

Figure 1 for Stochastic Prediction of Multi-Agent Interactions from Partial Observations
Figure 2 for Stochastic Prediction of Multi-Agent Interactions from Partial Observations
Figure 3 for Stochastic Prediction of Multi-Agent Interactions from Partial Observations
Figure 4 for Stochastic Prediction of Multi-Agent Interactions from Partial Observations
* ICLR 2019 camera ready 
  Access Paper or Ask Questions

D3D: Distilled 3D Networks for Video Action Recognition


Dec 19, 2018
Jonathan C. Stroud, David A. Ross, Chen Sun, Jia Deng, Rahul Sukthankar

Figure 1 for D3D: Distilled 3D Networks for Video Action Recognition
Figure 2 for D3D: Distilled 3D Networks for Video Action Recognition
Figure 3 for D3D: Distilled 3D Networks for Video Action Recognition
Figure 4 for D3D: Distilled 3D Networks for Video Action Recognition

  Access Paper or Ask Questions

Composing Text and Image for Image Retrieval - An Empirical Odyssey


Dec 18, 2018
Nam Vo, Lu Jiang, Chen Sun, Kevin Murphy, Li-Jia Li, Li Fei-Fei, James Hays

Figure 1 for Composing Text and Image for Image Retrieval - An Empirical Odyssey
Figure 2 for Composing Text and Image for Image Retrieval - An Empirical Odyssey
Figure 3 for Composing Text and Image for Image Retrieval - An Empirical Odyssey
Figure 4 for Composing Text and Image for Image Retrieval - An Empirical Odyssey

  Access Paper or Ask Questions

Actor-Centric Relation Network


Jul 28, 2018
Chen Sun, Abhinav Shrivastava, Carl Vondrick, Kevin Murphy, Rahul Sukthankar, Cordelia Schmid

Figure 1 for Actor-Centric Relation Network
Figure 2 for Actor-Centric Relation Network
Figure 3 for Actor-Centric Relation Network
Figure 4 for Actor-Centric Relation Network
* ECCV 2018 camera ready 
  Access Paper or Ask Questions

Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification


Jul 27, 2018
Saining Xie, Chen Sun, Jonathan Huang, Zhuowen Tu, Kevin Murphy

Figure 1 for Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification
Figure 2 for Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification
Figure 3 for Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification
Figure 4 for Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification
* ECCV 2018 camera ready 
  Access Paper or Ask Questions

Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning


Jun 16, 2018
Yin Cui, Yang Song, Chen Sun, Andrew Howard, Serge Belongie

Figure 1 for Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning
Figure 2 for Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning
Figure 3 for Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning
Figure 4 for Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning
* CVPR 2018 
  Access Paper or Ask Questions

AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions


Apr 30, 2018
Chunhui Gu, Chen Sun, David A. Ross, Carl Vondrick, Caroline Pantofaru, Yeqing Li, Sudheendra Vijayanarasimhan, George Toderici, Susanna Ricco, Rahul Sukthankar, Cordelia Schmid, Jitendra Malik

Figure 1 for AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions
Figure 2 for AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions
Figure 3 for AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions
Figure 4 for AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions
* To appear in CVPR 2018. Check dataset page https://research.google.com/ava/ for details 
  Access Paper or Ask Questions

The iNaturalist Species Classification and Detection Dataset


Apr 10, 2018
Grant Van Horn, Oisin Mac Aodha, Yang Song, Yin Cui, Chen Sun, Alex Shepard, Hartwig Adam, Pietro Perona, Serge Belongie

Figure 1 for The iNaturalist Species Classification and Detection Dataset
Figure 2 for The iNaturalist Species Classification and Detection Dataset
Figure 3 for The iNaturalist Species Classification and Detection Dataset
Figure 4 for The iNaturalist Species Classification and Detection Dataset
* CVPR 2018 
  Access Paper or Ask Questions