Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Nan Duan

NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion


Nov 24, 2021
Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang, Nan Duan


  Access Paper or Ask Questions

Adversarial Retriever-Ranker for dense text retrieval


Oct 29, 2021
Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen


  Access Paper or Ask Questions

XLM-K: Improving Cross-Lingual Language Model Pre-Training with Multilingual Knowledge


Sep 26, 2021
Xiaoze Jiang, Yaobo Liang, Weizhu Chen, Nan Duan


  Access Paper or Ask Questions

Contextual Fine-to-Coarse Distillation for Coarse-grained Response Selection in Open-Domain Conversations


Sep 24, 2021
Wei Chen, Yeyun Gong, Can Xu, Huang Hu, Bolun Yao, Zhongyu Wei, Zhihao Fan, Xiaowu Hu, Bartuer Zhou, Biao Cheng, Daxin Jiang, Nan Duan


  Access Paper or Ask Questions

KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation


Sep 22, 2021
Yongfei Liu, Chenfei Wu, Shao-yen Tseng, Vasudev Lal, Xuming He, Nan Duan


  Access Paper or Ask Questions

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy


Sep 17, 2021
Colin B. Clement, Shuai Lu, Xiaoyu Liu, Michele Tufano, Dawn Drain, Nan Duan, Neel Sundaresan, Alexey Svyatkovskiy

* EMNLP 2021 camera ready 

  Access Paper or Ask Questions

KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning


Sep 14, 2021
Haonan Li, Yeyun Gong, Jian Jiao, Ruofei Zhang, Timothy Baldwin, Nan Duan

* Accepted to EMNLP 2021 Findings 

  Access Paper or Ask Questions

Discovering Representation Sprachbund For Multilingual Pre-Training


Sep 01, 2021
Yimin Fan, Yaobo Liang, Alexandre Muzio, Hany Hassan, Houqiang Li, Ming Zhou, Nan Duan

* To Appear at the Findings of EMNLP2021 

  Access Paper or Ask Questions

Hybrid Reasoning Network for Video-based Commonsense Captioning


Aug 05, 2021
Weijiang Yu, Jian Liang, Lei Ji, Lu Li, Yuejian Fang, Nong Xiao, Nan Duan

* 11 pages, 6 figures 

  Access Paper or Ask Questions

From LSAT: The Progress and Challenges of Complex Reasoning


Aug 02, 2021
Siyuan Wang, Zhongkun Liu, Wanjun Zhong, Ming Zhou, Zhongyu Wei, Zhumin Chen, Nan Duan

* 17 pages, 5 figures submitted for consideration of publication to the IEEE Transactions on Audio, Speech, and Language Processing, 2021 

  Access Paper or Ask Questions

Learning to Generate Code Sketches


Jun 18, 2021
Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltiadis Allamanis


  Access Paper or Ask Questions

GEM: A General Evaluation Benchmark for Multimodal Tasks


Jun 18, 2021
Lin Su, Nan Duan, Edward Cui, Lei Ji, Chenfei Wu, Huaishao Luo, Yongfei Liu, Ming Zhong, Taroon Bharti, Arun Sacheti

* Accepted by Findings of ACL 2021 

  Access Paper or Ask Questions

FastSeq: Make Sequence Generation Faster


Jun 08, 2021
Yu Yan, Fei Hu, Jiusheng Chen, Nikhil Bhendawade, Ting Ye, Yeyun Gong, Nan Duan, Desheng Cui, Bingyu Chi, Ruifei Zhang

* ACL 2021 Demo Track 

  Access Paper or Ask Questions

CoSQA: 20,000+ Web Queries for Code Search and Question Answering


May 27, 2021
Junjie Huang, Duyu Tang, Linjun Shou, Ming Gong, Ke Xu, Daxin Jiang, Ming Zhou, Nan Duan

* ACL 2021 main conference. The CoSQA data and leaderboard are available at https://github.com/microsoft/CodeXGLUE/tree/main/Text-Code/NL-code-search-WebQuery. The code is available at https://github.com/Jun-jie-Huang/CoCLR 

  Access Paper or Ask Questions

EL-Attention: Memory Efficient Lossless Attention for Generation


May 11, 2021
Yu Yan, Jiusheng Chen, Weizhen Qi, Nikhil Bhendawade, Yeyun Gong, Nan Duan, Ruofei Zhang

* ICML 2021 

  Access Paper or Ask Questions

Poolingformer: Long Document Modeling with Pooling Attention


May 10, 2021
Hang Zhang, Yeyun Gong, Yelong Shen, Weisheng Li, Jiancheng Lv, Nan Duan, Weizhu Chen

* Accepted by ICML 2021 

  Access Paper or Ask Questions

Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text


May 08, 2021
Siyuan Wang, Wanjun Zhong, Duyu Tang, Zhongyu Wei, Zhihao Fan, Daxin Jiang, Ming Zhou, Nan Duan

* 10 pages, 4 figures 

  Access Paper or Ask Questions

CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval


May 08, 2021
Huaishao Luo, Lei Ji, Ming Zhong, Yang Chen, Wen Lei, Nan Duan, Tianrui Li


  Access Paper or Ask Questions

GODIVA: Generating Open-DomaIn Videos from nAtural Descriptions


Apr 30, 2021
Chenfei Wu, Lun Huang, Qianxi Zhang, Binyang Li, Lei Ji, Fan Yang, Guillermo Sapiro, Nan Duan


  Access Paper or Ask Questions

ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation


Apr 16, 2021
Weizhen Qi, Yeyun Gong, Yu Yan, Can Xu, Bolun Yao, Bartuer Zhou, Biao Cheng, Daxin Jiang, Jiusheng Chen, Ruofei Zhang, Houqiang Li, Nan Duan


  Access Paper or Ask Questions

AR-LSAT: Investigating Analytical Reasoning of Text


Apr 15, 2021
Wanjun Zhong, Siyuan Wang, Duyu Tang, Zenan Xu, Daya Guo, Jiahai Wang, Jian Yin, Ming Zhou, Nan Duan

* 13 pages, 5 figures 

  Access Paper or Ask Questions

WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach


Apr 09, 2021
Junjie Huang, Duyu Tang, Wanjun Zhong, Shuai Lu, Linjun Shou, Ming Gong, Daxin Jiang, Nan Duan


  Access Paper or Ask Questions

Mask Attention Networks: Rethinking and Strengthen Transformer


Mar 25, 2021
Zhihao Fan, Yeyun Gong, Dayiheng Liu, Zhongyu Wei, Siyuan Wang, Jian Jiao, Nan Duan, Ruofei Zhang, Xuanjing Huang

* Accepted as a long paper to NAACL 2021 

  Access Paper or Ask Questions

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation


Feb 09, 2021
Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang, Duyu Tang, Ge Li, Lidong Zhou, Linjun Shou, Long Zhou, Michele Tufano, Ming Gong, Ming Zhou, Nan Duan, Neel Sundaresan, Shao Kun Deng, Shengyu Fu, Shujie Liu


  Access Paper or Ask Questions

BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining


Dec 31, 2020
Weizhen Qi, Yeyun Gong, Jian Jiao, Yu Yan, Dayiheng Liu, Weizhu Chen, Kewen Tang, Houqiang Li, Jiusheng Chen, Ruofei Zhang, Ming Zhou, Nan Duan


  Access Paper or Ask Questions

Syntax-Enhanced Pre-trained Model


Dec 28, 2020
Zenan Xu, Daya Guo, Duyu Tang, Qinliang Su, Linjun Shou, Ming Gong, Wanjun Zhong, Xiaojun Quan, Nan Duan, Daxin Jiang


  Access Paper or Ask Questions

An Enhanced Knowledge Injection Model for Commonsense Generation


Dec 01, 2020
Zhihao Fan, Yeyun Gong, Zhongyu Wei, Siyuan Wang, Yameng Huang, Jian Jiao, Xuanjing Huang, Nan Duan, Ruofei Zhang

* Accepted to COLING 2020 

  Access Paper or Ask Questions