Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Ruofei Zhang

EL-Attention: Memory Efficient Lossless Attention for Generation


May 11, 2021
Yu Yan, Jiusheng Chen, Weizhen Qi, Nikhil Bhendawade, Yeyun Gong, Nan Duan, Ruofei Zhang

* ICML 2021 

  Access Paper or Ask Questions

ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation


Apr 16, 2021
Weizhen Qi, Yeyun Gong, Yu Yan, Can Xu, Bolun Yao, Bartuer Zhou, Biao Cheng, Daxin Jiang, Jiusheng Chen, Ruofei Zhang, Houqiang Li, Nan Duan


  Access Paper or Ask Questions

Mask Attention Networks: Rethinking and Strengthen Transformer


Mar 25, 2021
Zhihao Fan, Yeyun Gong, Dayiheng Liu, Zhongyu Wei, Siyuan Wang, Jian Jiao, Nan Duan, Ruofei Zhang, Xuanjing Huang

* Accepted as a long paper to NAACL 2021 

  Access Paper or Ask Questions

TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search


Feb 09, 2021
Jason Yue Zhu, Yanling Cui, Yuming Liu, Hao Sun, Xue Li, Markus Pelger, Tianqi Yang, Liangjie Zhang, Ruofei Zhang, Huasha Zhao

* Jason Yue Zhu, Yanling Cui, Yuming Liu, Hao Sun, Xue Li, Markus Pelger, Tianqi Yang, Liangjie Zhang, Ruofei Zhang, and Huasha Zhao. 2021. TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search. In Proceedings of the Web Conference 2021 (WWW 21), April 19-23, 2021, Ljubljana, Slovenia. ACM, New York, NY, USA, 10 pages. https: //doi.org/10.1145/3442381.3449842 

  Access Paper or Ask Questions

BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining


Dec 31, 2020
Weizhen Qi, Yeyun Gong, Jian Jiao, Yu Yan, Dayiheng Liu, Weizhu Chen, Kewen Tang, Houqiang Li, Jiusheng Chen, Ruofei Zhang, Ming Zhou, Nan Duan


  Access Paper or Ask Questions

An Enhanced Knowledge Injection Model for Commonsense Generation


Dec 01, 2020
Zhihao Fan, Yeyun Gong, Zhongyu Wei, Siyuan Wang, Yameng Huang, Jian Jiao, Xuanjing Huang, Nan Duan, Ruofei Zhang

* Accepted to COLING 2020 

  Access Paper or Ask Questions

GLGE: A New General Language Generation Evaluation Benchmark


Nov 24, 2020
Dayiheng Liu, Yu Yan, Yeyun Gong, Weizhen Qi, Hang Zhang, Jian Jiao, Weizhu Chen, Jie Fu, Linjun Shou, Ming Gong, Pengcheng Wang, Jiusheng Chen, Daxin Jiang, Jiancheng Lv, Ruofei Zhang, Winnie Wu, Ming Zhou, Nan Duan

* 11 pages 

  Access Paper or Ask Questions

ProphetNet-Ads: A Looking Ahead Strategy for Generative Retrieval Models in Sponsored Search Engine


Oct 21, 2020
Weizhen Qi, Yeyun Gong, Yu Yan, Jian Jiao, Bo Shao, Ruofei Zhang, Houqiang Li, Nan Duan, Ming Zhou

* Accepted to NLPCC 2020 

  Access Paper or Ask Questions

AutoADR: Automatic Model Design for Ad Relevance


Oct 14, 2020
Yiren Chen, Yaming Yang, Hong Sun, Yujing Wang, Yu Xu, Wei Shen, Rong Zhou, Yunhai Tong, Jing Bai, Ruofei Zhang

* CIKM 2020 

  Access Paper or Ask Questions

HittER: Hierarchical Transformers for Knowledge Graph Embeddings


Aug 28, 2020
Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji


  Access Paper or Ask Questions

ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training


Feb 22, 2020
Yu Yan, Weizhen Qi, Yeyun Gong, Dayiheng Liu, Nan Duan, Jiusheng Chen, Ruofei Zhang, Ming Zhou


  Access Paper or Ask Questions

TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval


Feb 14, 2020
Wenhao Lu, Jian Jiao, Ruofei Zhang


  Access Paper or Ask Questions

DeepProbe: Information Directed Sequence Understanding and Chatbot Design via Recurrent Neural Networks


Mar 01, 2018
Zi Yin, Keng-hao Chang, Ruofei Zhang

* Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2017 

  Access Paper or Ask Questions

Large-Scale Multi-Label Learning with Incomplete Label Assignments


Jul 06, 2014
Xiangnan Kong, Zhaoming Wu, Li-Jia Li, Ruofei Zhang, Philip S. Yu, Hang Wu, Wei Fan


  Access Paper or Ask Questions

A Lipschitz Exploration-Exploitation Scheme for Bayesian Optimization


Jul 16, 2013
Ali Jalali, Javad Azimi, Xiaoli Fern, Ruofei Zhang

* ECML 2013 

  Access Paper or Ask Questions