Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Chen Sun

Chen Sun

Multiview Transformers for Video Recognition


Jan 12, 2022
Shen Yan, Xuehan Xiong, Anurag Arnab, Zhichao Lu, Mi Zhang, Chen Sun, Cordelia Schmid

Figure 1 for Multiview Transformers for Video Recognition
Figure 2 for Multiview Transformers for Video Recognition
Figure 3 for Multiview Transformers for Video Recognition
Figure 4 for Multiview Transformers for Video Recognition
* Technical report 
  Access Paper or Ask Questions

Masking Modalities for Cross-modal Video Retrieval


Nov 03, 2021
Valentin Gabeur, Arsha Nagrani, Chen Sun, Karteek Alahari, Cordelia Schmid

Figure 1 for Masking Modalities for Cross-modal Video Retrieval
Figure 2 for Masking Modalities for Cross-modal Video Retrieval
Figure 3 for Masking Modalities for Cross-modal Video Retrieval
Figure 4 for Masking Modalities for Cross-modal Video Retrieval
* Accepted at WACV 2022 
  Access Paper or Ask Questions

Does Vision-and-Language Pretraining Improve Lexical Grounding?


Sep 21, 2021
Tian Yun, Chen Sun, Ellie Pavlick

Figure 1 for Does Vision-and-Language Pretraining Improve Lexical Grounding?
Figure 2 for Does Vision-and-Language Pretraining Improve Lexical Grounding?
Figure 3 for Does Vision-and-Language Pretraining Improve Lexical Grounding?
Figure 4 for Does Vision-and-Language Pretraining Improve Lexical Grounding?
* Camera ready for Findings of EMNLP 2021 
  Access Paper or Ask Questions

DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets


Aug 22, 2021
Junru Gu, Chen Sun, Hang Zhao

Figure 1 for DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets
Figure 2 for DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets
Figure 3 for DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets
Figure 4 for DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets
* Accepted to ICCV 2021 
  Access Paper or Ask Questions

Discrete-Valued Neural Communication


Jul 10, 2021
Dianbo Liu, Alex Lamb, Kenji Kawaguchi, Anirudh Goyal, Chen Sun, Michael Curtis Mozer, Yoshua Bengio

Figure 1 for Discrete-Valued Neural Communication
Figure 2 for Discrete-Valued Neural Communication
Figure 3 for Discrete-Valued Neural Communication
Figure 4 for Discrete-Valued Neural Communication

  Access Paper or Ask Questions

Attention Bottlenecks for Multimodal Fusion


Jun 30, 2021
Arsha Nagrani, Shan Yang, Anurag Arnab, Aren Jansen, Cordelia Schmid, Chen Sun

Figure 1 for Attention Bottlenecks for Multimodal Fusion
Figure 2 for Attention Bottlenecks for Multimodal Fusion
Figure 3 for Attention Bottlenecks for Multimodal Fusion
Figure 4 for Attention Bottlenecks for Multimodal Fusion

  Access Paper or Ask Questions

HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps


Jun 28, 2021
Lu Mi, Hang Zhao, Charlie Nash, Xiaohan Jin, Jiyang Gao, Chen Sun, Cordelia Schmid, Nir Shavit, Yuning Chai, Dragomir Anguelov

Figure 1 for HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps
Figure 2 for HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps
Figure 3 for HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps
Figure 4 for HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps

  Access Paper or Ask Questions

Episodic Transformer for Vision-and-Language Navigation


May 13, 2021
Alexander Pashevich, Cordelia Schmid, Chen Sun

Figure 1 for Episodic Transformer for Vision-and-Language Navigation
Figure 2 for Episodic Transformer for Vision-and-Language Navigation
Figure 3 for Episodic Transformer for Vision-and-Language Navigation
Figure 4 for Episodic Transformer for Vision-and-Language Navigation
* Code available at https://github.com/alexpashevich/E.T.; 19 pages 
  Access Paper or Ask Questions

Local Metrics for Multi-Object Tracking


Apr 06, 2021
Jack Valmadre, Alex Bewley, Jonathan Huang, Chen Sun, Cristian Sminchisescu, Cordelia Schmid

Figure 1 for Local Metrics for Multi-Object Tracking
Figure 2 for Local Metrics for Multi-Object Tracking
Figure 3 for Local Metrics for Multi-Object Tracking
Figure 4 for Local Metrics for Multi-Object Tracking

  Access Paper or Ask Questions

Composable Augmentation Encoding for Video Representation Learning


Apr 01, 2021
Chen Sun, Arsha Nagrani, Yonglong Tian, Cordelia Schmid

Figure 1 for Composable Augmentation Encoding for Video Representation Learning
Figure 2 for Composable Augmentation Encoding for Video Representation Learning
Figure 3 for Composable Augmentation Encoding for Video Representation Learning
Figure 4 for Composable Augmentation Encoding for Video Representation Learning

  Access Paper or Ask Questions

ViViT: A Video Vision Transformer


Mar 29, 2021
Anurag Arnab, Mostafa Dehghani, Georg Heigold, Chen Sun, Mario LučiΔ‡, Cordelia Schmid

Figure 1 for ViViT: A Video Vision Transformer
Figure 2 for ViViT: A Video Vision Transformer
Figure 3 for ViViT: A Video Vision Transformer
Figure 4 for ViViT: A Video Vision Transformer

  Access Paper or Ask Questions

Unified Graph Structured Models for Video Understanding


Mar 29, 2021
Anurag Arnab, Chen Sun, Cordelia Schmid

Figure 1 for Unified Graph Structured Models for Video Understanding
Figure 2 for Unified Graph Structured Models for Video Understanding
Figure 3 for Unified Graph Structured Models for Video Understanding
Figure 4 for Unified Graph Structured Models for Video Understanding

  Access Paper or Ask Questions

Learning Temporal Dynamics from Cycles in Narrated Video


Jan 07, 2021
Dave Epstein, Jiajun Wu, Cordelia Schmid, Chen Sun

Figure 1 for Learning Temporal Dynamics from Cycles in Narrated Video
Figure 2 for Learning Temporal Dynamics from Cycles in Narrated Video
Figure 3 for Learning Temporal Dynamics from Cycles in Narrated Video
Figure 4 for Learning Temporal Dynamics from Cycles in Narrated Video

  Access Paper or Ask Questions

TNT: Target-driveN Trajectory Prediction


Aug 21, 2020
Hang Zhao, Jiyang Gao, Tian Lan, Chen Sun, Benjamin Sapp, Balakrishnan Varadarajan, Yue Shen, Yi Shen, Yuning Chai, Cordelia Schmid, Congcong Li, Dragomir Anguelov

Figure 1 for TNT: Target-driveN Trajectory Prediction
Figure 2 for TNT: Target-driveN Trajectory Prediction
Figure 3 for TNT: Target-driveN Trajectory Prediction
Figure 4 for TNT: Target-driveN Trajectory Prediction

  Access Paper or Ask Questions

The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)


Aug 03, 2020
Samuel Albanie, Yang Liu, Arsha Nagrani, Antoine Miech, Ernesto Coto, Ivan Laptev, Rahul Sukthankar, Bernard Ghanem, Andrew Zisserman, Valentin Gabeur, Chen Sun, Karteek Alahari, Cordelia Schmid, Shizhe Chen, Yida Zhao, Qin Jin, Kaixu Cui, Hui Liu, Chen Wang, Yudong Jiang, Xiaoshuai Hao

Figure 1 for The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)
Figure 2 for The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)
Figure 3 for The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)
Figure 4 for The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)
* Individual reports, dataset information, rules, and released source code can be found at the competition webpage (https://www.robots.ox.ac.uk/~vgg/challenges/video-pentathlon) 
  Access Paper or Ask Questions

Learning Video Representations from Textual Web Supervision


Jul 29, 2020
Jonathan C. Stroud, David A. Ross, Chen Sun, Jia Deng, Rahul Sukthankar, Cordelia Schmid

Figure 1 for Learning Video Representations from Textual Web Supervision
Figure 2 for Learning Video Representations from Textual Web Supervision
Figure 3 for Learning Video Representations from Textual Web Supervision
Figure 4 for Learning Video Representations from Textual Web Supervision

  Access Paper or Ask Questions

Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos


Jul 21, 2020
Anurag Arnab, Chen Sun, Arsha Nagrani, Cordelia Schmid

Figure 1 for Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
Figure 2 for Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
Figure 3 for Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
Figure 4 for Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
* ECCV 2020 
  Access Paper or Ask Questions

Multi-modal Transformer for Video Retrieval


Jul 21, 2020
Valentin Gabeur, Chen Sun, Karteek Alahari, Cordelia Schmid

Figure 1 for Multi-modal Transformer for Video Retrieval
Figure 2 for Multi-modal Transformer for Video Retrieval
Figure 3 for Multi-modal Transformer for Video Retrieval
Figure 4 for Multi-modal Transformer for Video Retrieval
* ECCV 2020 (spotlight paper) 
  Access Paper or Ask Questions

What makes for good views for contrastive learning


May 20, 2020
Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan, Cordelia Schmid, Phillip Isola

Figure 1 for What makes for good views for contrastive learning
Figure 2 for What makes for good views for contrastive learning
Figure 3 for What makes for good views for contrastive learning
Figure 4 for What makes for good views for contrastive learning
* submitted to ECCV 2020 
  Access Paper or Ask Questions

VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation


May 08, 2020
Jiyang Gao, Chen Sun, Hang Zhao, Yi Shen, Dragomir Anguelov, Congcong Li, Cordelia Schmid

Figure 1 for VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation
Figure 2 for VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation
Figure 3 for VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation
Figure 4 for VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation
* CVPR 2020 
  Access Paper or Ask Questions

Speech2Action: Cross-modal Supervision for Action Recognition


Mar 30, 2020
Arsha Nagrani, Chen Sun, David Ross, Rahul Sukthankar, Cordelia Schmid, Andrew Zisserman

Figure 1 for Speech2Action: Cross-modal Supervision for Action Recognition
Figure 2 for Speech2Action: Cross-modal Supervision for Action Recognition
Figure 3 for Speech2Action: Cross-modal Supervision for Action Recognition
Figure 4 for Speech2Action: Cross-modal Supervision for Action Recognition
* Accepted to CVPR 2020 
  Access Paper or Ask Questions

Unsupervised Learning of Object Structure and Dynamics from Videos


Jun 19, 2019
Matthias Minderer, Chen Sun, Ruben Villegas, Forrester Cole, Kevin Murphy, Honglak Lee

Figure 1 for Unsupervised Learning of Object Structure and Dynamics from Videos
Figure 2 for Unsupervised Learning of Object Structure and Dynamics from Videos
Figure 3 for Unsupervised Learning of Object Structure and Dynamics from Videos
Figure 4 for Unsupervised Learning of Object Structure and Dynamics from Videos

  Access Paper or Ask Questions

Contrastive Bidirectional Transformer for Temporal Representation Learning


Jun 13, 2019
Chen Sun, Fabien Baradel, Kevin Murphy, Cordelia Schmid

Figure 1 for Contrastive Bidirectional Transformer for Temporal Representation Learning
Figure 2 for Contrastive Bidirectional Transformer for Temporal Representation Learning
Figure 3 for Contrastive Bidirectional Transformer for Temporal Representation Learning
Figure 4 for Contrastive Bidirectional Transformer for Temporal Representation Learning

  Access Paper or Ask Questions

Intra-Ensemble in Neural Networks


Apr 09, 2019
Yuan Gao, Zixiang Cai, Yimin Chen, Wenke Chen, Kan Yang, Chen Sun, Cong Yao

Figure 1 for Intra-Ensemble in Neural Networks
Figure 2 for Intra-Ensemble in Neural Networks
Figure 3 for Intra-Ensemble in Neural Networks
Figure 4 for Intra-Ensemble in Neural Networks

  Access Paper or Ask Questions

Relational Action Forecasting


Apr 08, 2019
Chen Sun, Abhinav Shrivastava, Carl Vondrick, Rahul Sukthankar, Kevin Murphy, Cordelia Schmid

Figure 1 for Relational Action Forecasting
Figure 2 for Relational Action Forecasting
Figure 3 for Relational Action Forecasting
Figure 4 for Relational Action Forecasting
* CVPR 2019 (oral) 
  Access Paper or Ask Questions

VideoBERT: A Joint Model for Video and Language Representation Learning


Apr 03, 2019
Chen Sun, Austin Myers, Carl Vondrick, Kevin Murphy, Cordelia Schmid

Figure 1 for VideoBERT: A Joint Model for Video and Language Representation Learning
Figure 2 for VideoBERT: A Joint Model for Video and Language Representation Learning
Figure 3 for VideoBERT: A Joint Model for Video and Language Representation Learning
Figure 4 for VideoBERT: A Joint Model for Video and Language Representation Learning

  Access Paper or Ask Questions