Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Weizhu Chen

What Makes Good In-Context Examples for GPT-$3$?


Jan 17, 2021
Jiachang Liu, Dinghan Shen, Yizhe Zhang, Bill Dolan, Lawrence Carin, Weizhu Chen


  Access Paper or Ask Questions

Reader-Guided Passage Reranking for Open-Domain Question Answering


Jan 01, 2021
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen

* TLDR: Reranking retrieved passages by reader predictions can achieve 10~20 gains in top-1 retrieval accuracy and 1~4 gains in Exact Match (EM) without any training 

  Access Paper or Ask Questions

UnitedQA: A Hybrid Approach for Open Domain Question Answering


Jan 01, 2021
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao


  Access Paper or Ask Questions

NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned


Jan 01, 2021
Sewon Min, Jordan Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih

* 26 pages 

  Access Paper or Ask Questions

BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining


Dec 31, 2020
Weizhen Qi, Yeyun Gong, Jian Jiao, Yu Yan, Dayiheng Liu, Weizhu Chen, Kewen Tang, Houqiang Li, Jiusheng Chen, Ruofei Zhang, Ming Zhou, Nan Duan


  Access Paper or Ask Questions

Few-Shot Named Entity Recognition: A Comprehensive Study


Dec 29, 2020
Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, Jiawei Han


  Access Paper or Ask Questions

GLGE: A New General Language Generation Evaluation Benchmark


Nov 24, 2020
Dayiheng Liu, Yu Yan, Yeyun Gong, Weizhen Qi, Hang Zhang, Jian Jiao, Weizhu Chen, Jie Fu, Linjun Shou, Ming Gong, Pengcheng Wang, Jiusheng Chen, Daxin Jiang, Jiancheng Lv, Ruofei Zhang, Winnie Wu, Ming Zhou, Nan Duan

* 11 pages 

  Access Paper or Ask Questions

MixKD: Towards Efficient Distillation of Large-scale Language Models


Nov 01, 2020
Kevin J Liang, Weituo Hao, Dinghan Shen, Yufan Zhou, Weizhu Chen, Changyou Chen, Lawrence Carin


  Access Paper or Ask Questions

A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and Generation


Oct 23, 2020
Dinghan Shen, Mingzhi Zheng, Yelong Shen, Yanru Qu, Weizhu Chen

* Source code is available at: https://github.com/dinghanshen/cutoff 

  Access Paper or Ask Questions

CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understanding


Oct 16, 2020
Yanru Qu, Dinghan Shen, Yelong Shen, Sandra Sajeev, Jiawei Han, Weizhu Chen


  Access Paper or Ask Questions

Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model


Oct 14, 2020
Mingzhi Zheng, Dinghan Shen, Yelong Shen, Weizhu Chen, Lin Xiao


  Access Paper or Ask Questions

Generation-Augmented Retrieval for Open-domain Question Answering


Sep 17, 2020
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen


  Access Paper or Ask Questions

Example-Based Named Entity Recognition


Aug 24, 2020
Morteza Ziyadi, Yuting Sun, Abhishek Goswami, Jade Huang, Weizhu Chen

* 15 pages, 6 figures, 5 tables with appendix 

  Access Paper or Ask Questions

DeBERTa: Decoding-enhanced BERT with Disentangled Attention


Jun 05, 2020
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen

* 17 pages,4 figures, 8 tables 

  Access Paper or Ask Questions

Adversarial Training for Large Neural Language Models


Apr 29, 2020
Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao

* 13 pages, 9 tables, 2 figures 

  Access Paper or Ask Questions

Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning


Apr 29, 2020
Tao Shen, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, Weizhu Chen


  Access Paper or Ask Questions

Understanding the Difficulty of Training Transformers


Apr 17, 2020
Liyuan Liu, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Jiawei Han


  Access Paper or Ask Questions

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding


Feb 19, 2020
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao

* 9 pages, 3 figures and 3 tables 

  Access Paper or Ask Questions

Conditional Self-Attention for Query-based Summarization


Feb 18, 2020
Yujia Xie, Tianyi Zhou, Yi Mao, Weizhu Chen


  Access Paper or Ask Questions

SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization


Nov 08, 2019
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao


  Access Paper or Ask Questions

X-SQL: reinforce schema representation with context


Aug 21, 2019
Pengcheng He, Yi Mao, Kaushik Chakrabarti, Weizhu Chen


  Access Paper or Ask Questions

On the Variance of the Adaptive Learning Rate and Beyond


Aug 08, 2019
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han


  Access Paper or Ask Questions

A Hybrid Neural Network Model for Commonsense Reasoning


Jul 27, 2019
Pengcheng He, Xiaodong Liu, Weizhu Chen, Jianfeng Gao

* 9 pages, 3 figures, 6 tables 

  Access Paper or Ask Questions

Lessons from Real-World Reinforcement Learning in a Customer Support Bot


May 06, 2019
Nikos Karampatziakis, Sebastian Kochman, Jade Huang, Paul Mineiro, Kathy Osborne, Weizhu Chen

* Reinforcement Learning for Real Life Workshop 

  Access Paper or Ask Questions

Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding


Apr 20, 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

* 8 pages, 2 figures and 3 tables 

  Access Paper or Ask Questions

Multi-Task Deep Neural Networks for Natural Language Understanding


Jan 31, 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

* 10 pages, 2 figures and 5 tables 

  Access Paper or Ask Questions

Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering


Oct 02, 2018
Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley


  Access Paper or Ask Questions