Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed
MixKD: Towards Efficient Distillation of Large-scale Language Models

Nov 01, 2020
Kevin J Liang, Weituo Hao, Dinghan Shen, Yufan Zhou, Weizhu Chen, Changyou Chen, Lawrence Carin


  Access Paper or Ask Questions

A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and Generation

Oct 23, 2020
Dinghan Shen, Mingzhi Zheng, Yelong Shen, Yanru Qu, Weizhu Chen

* Source code is available at: https://github.com/dinghanshen/cutoff 

  Access Paper or Ask Questions

CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understanding

Oct 16, 2020
Yanru Qu, Dinghan Shen, Yelong Shen, Sandra Sajeev, Jiawei Han, Weizhu Chen


  Access Paper or Ask Questions

Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model

Oct 14, 2020
Mingzhi Zheng, Dinghan Shen, Yelong Shen, Weizhu Chen, Lin Xiao


  Access Paper or Ask Questions

Generation-Augmented Retrieval for Open-domain Question Answering

Sep 17, 2020
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen


  Access Paper or Ask Questions

Example-Based Named Entity Recognition

Aug 24, 2020
Morteza Ziyadi, Yuting Sun, Abhishek Goswami, Jade Huang, Weizhu Chen

* 15 pages, 6 figures, 5 tables with appendix 

  Access Paper or Ask Questions

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Jun 05, 2020
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen

* 17 pages,4 figures, 8 tables 

  Access Paper or Ask Questions

Adversarial Training for Large Neural Language Models

Apr 29, 2020
Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao

* 13 pages, 9 tables, 2 figures 

  Access Paper or Ask Questions

Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning

Apr 29, 2020
Tao Shen, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, Weizhu Chen


  Access Paper or Ask Questions

Understanding the Difficulty of Training Transformers

Apr 17, 2020
Liyuan Liu, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Jiawei Han


  Access Paper or Ask Questions

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding

Feb 19, 2020
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao

* 9 pages, 3 figures and 3 tables 

  Access Paper or Ask Questions

Conditional Self-Attention for Query-based Summarization

Feb 18, 2020
Yujia Xie, Tianyi Zhou, Yi Mao, Weizhu Chen


  Access Paper or Ask Questions

SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization

Nov 08, 2019
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao


  Access Paper or Ask Questions

X-SQL: reinforce schema representation with context

Aug 21, 2019
Pengcheng He, Yi Mao, Kaushik Chakrabarti, Weizhu Chen


  Access Paper or Ask Questions

On the Variance of the Adaptive Learning Rate and Beyond

Aug 08, 2019
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han


  Access Paper or Ask Questions

A Hybrid Neural Network Model for Commonsense Reasoning

Jul 27, 2019
Pengcheng He, Xiaodong Liu, Weizhu Chen, Jianfeng Gao

* 9 pages, 3 figures, 6 tables 

  Access Paper or Ask Questions

Lessons from Real-World Reinforcement Learning in a Customer Support Bot

May 06, 2019
Nikos Karampatziakis, Sebastian Kochman, Jade Huang, Paul Mineiro, Kathy Osborne, Weizhu Chen

* Reinforcement Learning for Real Life Workshop 

  Access Paper or Ask Questions

Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding

Apr 20, 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

* 8 pages, 2 figures and 3 tables 

  Access Paper or Ask Questions

Multi-Task Deep Neural Networks for Natural Language Understanding

Jan 31, 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

* 10 pages, 2 figures and 5 tables 

  Access Paper or Ask Questions

Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering

Oct 02, 2018
Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley


  Access Paper or Ask Questions

IncSQL: Training Incremental Text-to-SQL Parsers with Non-Deterministic Oracles

Oct 01, 2018
Tianze Shi, Kedar Tatwawadi, Kaushik Chakrabarti, Yi Mao, Oleksandr Polozov, Weizhu Chen


  Access Paper or Ask Questions

Zero-training Sentence Embedding via Orthogonal Basis

Sep 30, 2018
Ziyi Yang, Chenguang Zhu, Weizhu Chen


  Access Paper or Ask Questions

FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension

Feb 04, 2018
Hsin-Yuan Huang, Chenguang Zhu, Yelong Shen, Weizhu Chen

* Published in Sixth International Conference on Learning Representations (ICLR), 2018 

  Access Paper or Ask Questions

DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization

Oct 13, 2017
Lin Xiao, Adams Wei Yu, Qihang Lin, Weizhu Chen


  Access Paper or Ask Questions

ReasoNet: Learning to Stop Reading in Machine Comprehension

Jun 20, 2017
Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen

* in KDD 2017 

  Access Paper or Ask Questions