Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Zhe Gan

SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning


Nov 25, 2021
Kevin Lin, Linjie Li, Chung-Ching Lin, Faisal Ahmed, Zhe Gan, Zicheng Liu, Yumao Lu, Lijuan Wang


  Access Paper or Ask Questions

An Empirical Study of Training End-to-End Vision-and-Language Transformers


Nov 25, 2021
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang, Lijuan Wang, Chenguang Zhu, Pengchuan Zhang, Lu Yuan, Nanyun Peng, Zicheng Liu, Michael Zeng


  Access Paper or Ask Questions

VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling


Nov 24, 2021
Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu

* Code is available at https://github.com/tsujuifu/pytorch_violet 

  Access Paper or Ask Questions

Scaling Up Vision-Language Pre-training for Image Captioning


Nov 24, 2021
Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang


  Access Paper or Ask Questions

Crossing the Format Boundary of Text and Boxes: Towards Unified Vision-Language Modeling


Nov 23, 2021
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang


  Access Paper or Ask Questions

UFO: A UniFied TransfOrmer for Vision-Language Representation Learning


Nov 19, 2021
Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang


  Access Paper or Ask Questions

Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models


Nov 04, 2021
Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Hassan Awadallah, Bo Li

* Oral Presentation in NeurIPS 2021 (Datasets and Benchmarks Track). 24 pages, 4 figures, 12 tables 

  Access Paper or Ask Questions

An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA


Sep 10, 2021
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang


  Access Paper or Ask Questions

Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE


Jul 02, 2021
Junya Chen, Zhe Gan, Xuan Li, Qing Guo, Liqun Chen, Shuyang Gao, Tagyoung Chung, Yi Xu, Belinda Zeng, Wenlian Lu, Fan Li, Lawrence Carin, Chenyang Tao


  Access Paper or Ask Questions

Chasing Sparsity in Vision Transformers: An End-to-End Exploration


Jun 09, 2021
Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang


  Access Paper or Ask Questions

VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation


Jun 08, 2021
Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, Tamara Lee Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu

* VALUE is available at https://value-leaderboard.github.io/ 

  Access Paper or Ask Questions

Chasing Sparsity in Vision Transformers:An End-to-End Exploration


Jun 08, 2021
Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang


  Access Paper or Ask Questions

Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models


Jun 01, 2021
Linjie Li, Jie Lei, Zhe Gan, Jingjing Liu


  Access Paper or Ask Questions

Playing Lottery Tickets with Vision and Language


Apr 23, 2021
Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu


  Access Paper or Ask Questions

CUPID: Adaptive Curation of Pre-training Data for Video-and-Language Representation Learning


Apr 13, 2021
Luowei Zhou, Jingjing Liu, Yu Cheng, Zhe Gan, Lei Zhang

* 12 pages, 4 figures 

  Access Paper or Ask Questions

The Elastic Lottery Ticket Hypothesis


Mar 30, 2021
Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang


  Access Paper or Ask Questions

Adversarial Feature Augmentation and Normalization for Visual Recognition


Mar 22, 2021
Tianlong Chen, Yu Cheng, Zhe Gan, Jianfeng Wang, Lijuan Wang, Zhangyang Wang, Jingjing Liu


  Access Paper or Ask Questions

Improving Zero-shot Voice Style Transfer via Disentangled Representation Learning


Mar 17, 2021
Siyang Yuan, Pengyu Cheng, Ruiyi Zhang, Weituo Hao, Zhe Gan, Lawrence Carin

* To appear in ICLR 2021 

  Access Paper or Ask Questions

Ultra-Data-Efficient GAN Training: Drawing A Lottery Ticket First, Then Training It Toughly


Feb 28, 2021
Tianlong Chen, Yu Cheng, Zhe Gan, Jingjing Liu, Zhangyang Wang


  Access Paper or Ask Questions

Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling


Feb 11, 2021
Jie Lei, Linjie Li, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, Jingjing Liu

* 12 pages, 5 figures, 11 tables. - Happy Chinese New Year! 

  Access Paper or Ask Questions

EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets


Dec 31, 2020
Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jingjing Liu


  Access Paper or Ask Questions

Wasserstein Contrastive Representation Distillation


Dec 15, 2020
Liqun Chen, Zhe Gan, Dong Wang, Jingjing Liu, Ricardo Henao, Lawrence Carin


  Access Paper or Ask Questions

A Closer Look at the Robustness of Vision-and-Language Pre-trained Models


Dec 15, 2020
Linjie Li, Zhe Gan, Jingjing Liu


  Access Paper or Ask Questions

InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective


Oct 14, 2020
Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi Jia, Bo Li, Jingjing Liu

* 20 pages, 8 tables, 2 figures 

  Access Paper or Ask Questions

Cross-Thought for Sentence Encoder Pre-training


Oct 07, 2020
Shuohang Wang, Yuwei Fang, Siqi Sun, Zhe Gan, Yu Cheng, Jing Jiang, Jingjing Liu

* Accepted by EMNLP 2020 

  Access Paper or Ask Questions

Multi-Fact Correction in Abstractive Text Summarization


Oct 06, 2020
Yue Dong, Shuohang Wang, Zhe Gan, Yu Cheng, Jackie Chi Kit Cheung, Jingjing Liu

* 12 pages, accepted at EMNLP2020 

  Access Paper or Ask Questions

MagGAN: High-Resolution Face Attribute Editing with Mask-Guided Generative Adversarial Network


Oct 03, 2020
Yi Wei, Zhe Gan, Wenbo Li, Siwei Lyu, Ming-Ching Chang, Lei Zhang, Jianfeng Gao, Pengchuan Zhang

* published at ACCV2020 

  Access Paper or Ask Questions