Dual Learning: Theoretical Study and an Algorithmic Extension

May 17, 2020
Zhibing Zhao, Yingce Xia, Tao Qin, Lirong Xia, Tie-Yan Liu

* 11 pages, 2 figures 

  Access Model/Code and Paper
Invertible Image Rescaling

May 12, 2020
Mingqing Xiao, Shuxin Zheng, Chang Liu, Yaolong Wang, Di He, Guolin Ke, Jiang Bian, Zhouchen Lin, Tie-Yan Liu


  Access Model/Code and Paper
A Study of Non-autoregressive Model for Sequence Generation

May 11, 2020
Yi Ren, Jinglin Liu, Xu Tan, Zhou Zhao, Sheng Zhao, Tie-Yan Liu

* Accepted by ACL 2020 

  Access Model/Code and Paper
SEEK: Segmented Embedding of Knowledge Graphs

May 02, 2020
Wentao Xu, Shun Zheng, Liang He, Bin Shao, Jian Yin, Tie-Yan Liu


  Access Model/Code and Paper
LightPAFF: A Two-Stage Distillation Framework for Pre-training and Fine-tuning

Apr 27, 2020
Kaitao Song, Hao Sun, Xu Tan, Tao Qin, Jianfeng Lu, Hongzhi Liu, Tie-Yan Liu


  Access Model/Code and Paper
MPNet: Masked and Permuted Pre-training for Language Understanding

Apr 20, 2020
Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu, Tie-Yan Liu


  Access Model/Code and Paper
Discriminator Contrastive Divergence: Semi-Amortized Generative Modeling by Exploring Energy of the Discriminator

Apr 05, 2020
Yuxuan Song, Qiwei Ye, Minkai Xu, Tie-Yan Liu

* 17 pages, 9 figures, pre-submmited to cvpr2019 

  Access Model/Code and Paper
Suphx: Mastering Mahjong with Deep Reinforcement Learning

Apr 01, 2020
Junjie Li, Sotetsu Koyamada, Qiwei Ye, Guoqing Liu, Chao Wang, Ruihan Yang, Li Zhao, Tao Qin, Tie-Yan Liu, Hsiao-Wuen Hon


  Access Model/Code and Paper
Semi-Supervised Neural Architecture Search

Mar 09, 2020
Renqian Luo, Xu Tan, Rui Wang, Tao Qin, Enhong Chen, Tie-Yan Liu

* Code available at https://github.com/renqianluo/SemiNAS 

  Access Model/Code and Paper
Incorporating BERT into Neural Machine Translation

Feb 17, 2020
Jinhua Zhu, Yingce Xia, Lijun Wu, Di He, Tao Qin, Wengang Zhou, Houqiang Li, Tie-Yan Liu

* Accepted to ICLR-2020 

  Access Model/Code and Paper
On Layer Normalization in the Transformer Architecture

Feb 12, 2020
Ruibin Xiong, Yunchang Yang, Di He, Kai Zheng, Shuxin Zheng, Chen Xing, Huishuai Zhang, Yanyan Lan, Liwei Wang, Tie-Yan Liu


  Access Model/Code and Paper
A Study of Multilingual Neural Machine Translation

Dec 25, 2019
Xu Tan, Yichong Leng, Jiale Chen, Yi Ren, Tao Qin, Tie-Yan Liu


  Access Model/Code and Paper
Gradient Perturbation is Underrated for Differentially Private Convex Optimization

Nov 26, 2019
Da Yu, Huishuai Zhang, Wei Chen, Tie-Yan Liu, Jian Yin


  Access Model/Code and Paper
Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation

Nov 21, 2019
Junliang Guo, Xu Tan, Linli Xu, Tao Qin, Enhong Chen, Tie-Yan Liu

* AAAI 2020 

  Access Model/Code and Paper
Microsoft Research Asia's Systems for WMT19

Nov 07, 2019
Yingce Xia, Xu Tan, Fei Tian, Fei Gao, Weicong Chen, Yang Fan, Linyuan Gong, Yichong Leng, Renqian Luo, Yiren Wang, Lijun Wu, Jinhua Zhu, Tao Qin, Tie-Yan Liu

* Accepted to "Fourth Conference on Machine Translation (WMT19)" 

  Access Model/Code and Paper
Distributional Reward Decomposition for Reinforcement Learning

Nov 06, 2019
Zichuan Lin, Li Zhao, Derek Yang, Tao Qin, Guangwen Yang, Tie-Yan Liu

* NeurlPS 2019 

  Access Model/Code and Paper
Hint-Based Training for Non-Autoregressive Machine Translation

Sep 15, 2019
Zhuohan Li, Zi Lin, Di He, Fei Tian, Tao Qin, Liwei Wang, Tie-Yan Liu

* EMNLP-IJCNLP 2019 

  Access Model/Code and Paper
Self-paced Ensemble for Highly Imbalanced Massive Data Classification

Sep 10, 2019
Zhining Liu, Wei Cao, Zhifeng Gao, Jiang Bian, Hechang Chen, Yi Chang, Tie-Yan Liu


  Access Model/Code and Paper
Multilingual Neural Machine Translation with Language Clustering

Aug 25, 2019
Xu Tan, Jiale Chen, Di He, Yingce Xia, Tao Qin, Tie-Yan Liu

* Accepted by EMNLP 2019 

  Access Model/Code and Paper
Representation Degeneration Problem in Training Natural Language Generation Models

Jul 28, 2019
Jun Gao, Di He, Xu Tan, Tao Qin, Liwei Wang, Tie-Yan Liu

* ICLR 2019 

  Access Model/Code and Paper
Light Multi-segment Activation for Model Compression

Jul 16, 2019
Zhenhui Xu, Guolin Ke, Jia Zhang, Jiang Bian, Tie-Yan Liu


  Access Model/Code and Paper
Depth Growing for Neural Machine Translation

Jul 03, 2019
Lijun Wu, Yiren Wang, Yingce Xia, Fei Tian, Fei Gao, Tao Qin, Jianhuang Lai, Tie-Yan Liu

* Accepted by ACL 2019 

  Access Model/Code and Paper
Unsupervised Pivot Translation for Distant Languages

Jun 25, 2019
Yichong Leng, Xu Tan, Tao Qin, Xiang-Yang Li, Tie-Yan Liu

* Accepted by ACL-2019 

  Access Model/Code and Paper
Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View

Jun 06, 2019
Yiping Lu, Zhuohan Li, Di He, Zhiqing Sun, Bin Dong, Tao Qin, Liwei Wang, Tie-Yan Liu


  Access Model/Code and Paper