Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Junyang Lin

M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining


Oct 13, 2021
Junyang Lin, An Yang, Jinze Bai, Chang Zhou, Le Jiang, Xianyan Jia, Ang Wang, Jie Zhang, Yong Li, Wei Lin, Jingren Zhou, Hongxia Yang

* 14 pages, 4 figures 

  Access Paper or Ask Questions

Exploring Sparse Expert Models and Beyond


Jun 14, 2021
An Yang, Junyang Lin, Rui Men, Chang Zhou, Le Jiang, Xianyan Jia, Ang Wang, Jie Zhang, Jiamang Wang, Yong Li, Di Zhang, Wei Lin, Lin Qu, Jingren Zhou, Hongxia Yang

* 16 pages, 8 figures 

  Access Paper or Ask Questions

Learning Relation Alignment for Calibrated Cross-modal Retrieval


Jun 01, 2021
Shuhuai Ren, Junyang Lin, Guangxiang Zhao, Rui Men, An Yang, Jingren Zhou, Xu Sun, Hongxia Yang

* Accepted by ACL-IJCNLP 2021 main conference (Long Paper) 

  Access Paper or Ask Questions

Connecting Language and Vision for Natural Language-Based Vehicle Retrieval


May 31, 2021
Shuai Bai, Zhedong Zheng, Xiaohan Wang, Junyang Lin, Zhu Zhang, Chang Zhou, Yi Yang, Hongxia Yang

* CVPR 2021 AI CITY CHALLENGE Natural Language-Based Vehicle Retrieval Top 1 

  Access Paper or Ask Questions

Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation


May 31, 2021
Peng Wang, Junyang Lin, An Yang, Chang Zhou, Yichang Zhang, Jingren Zhou, Hongxia Yang

* 13 pages, 2 figures. Accepted in ACL2021 Findings 

  Access Paper or Ask Questions

CogView: Mastering Text-to-Image Generation via Transformers


May 28, 2021
Ming Ding, Zhuoyi Yang, Wenyi Hong, Wendi Zheng, Chang Zhou, Da Yin, Junyang Lin, Xu Zou, Zhou Shao, Hongxia Yang, Jie Tang


  Access Paper or Ask Questions

M6: A Chinese Multimodal Pretrainer


Mar 02, 2021
Junyang Lin, Rui Men, An Yang, Chang Zhou, Ming Ding, Yichang Zhang, Peng Wang, Ang Wang, Le Jiang, Xianyan Jia, Jie Zhang, Jianwei Zhang, Xu Zou, Zhikang Li, Xiaodong Deng, Jie Liu, Jinbao Xue, Huiling Zhou, Jianxin Ma, Jin Yu, Yong Li, Wei Lin, Jingren Zhou, Jie Tang, Hongxia Yang

* 12 pages, technical report 

  Access Paper or Ask Questions

Graph-based Multi-hop Reasoning for Long Text Generation


Sep 28, 2020
Liang Zhao, Jingjing Xu, Junyang Lin, Yichang Zhang, Hongxia Yang, Xu Sun


  Access Paper or Ask Questions

InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining


Mar 30, 2020
Junyang Lin, An Yang, Yichang Zhang, Jie Liu, Jingren Zhou, Hongxia Yang

* 11 pages, 4 figures 

  Access Paper or Ask Questions

Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection


Dec 25, 2019
Guangxiang Zhao, Junyang Lin, Zhiyuan Zhang, Xuancheng Ren, Qi Su, Xu Sun


  Access Paper or Ask Questions

Understanding and Improving Layer Normalization


Nov 16, 2019
Jingjing Xu, Xu Sun, Zhiyuan Zhang, Guangxiang Zhao, Junyang Lin

* Accepted by NeurIPS 2019 

  Access Paper or Ask Questions

Towards Knowledge-Based Recommender Dialog System


Sep 03, 2019
Qibin Chen, Junyang Lin, Yichang Zhang, Ming Ding, Yukuo Cen, Hongxia Yang, Jie Tang

* To appear in EMNLP 2019 

  Access Paper or Ask Questions

Imitation Learning for Non-Autoregressive Neural Machine Translation


Jul 18, 2019
Bingzhen Wei, Mingxuan Wang, Hao Zhou, Junyang Lin, Jun Xie, Xu Sun

* Accepted by ACL 2019. arXiv admin note: text overlap with arXiv:1902.10245, arXiv:1812.09664 by other authors 

  Access Paper or Ask Questions

Towards Knowledge-Based Personalized Product Description Generation in E-commerce


Apr 30, 2019
Qibin Chen, Junyang Lin, Yichang Zhang, Hongxia Yang, Jingren Zhou, Jie Tang

* Accepted to KDD 2019. Website: https://sites.google.com/view/kobe2019 

  Access Paper or Ask Questions

A Deep Reinforced Sequence-to-Set Model for Multi-Label Text Classification


Sep 10, 2018
Pengcheng Yang, Shuming Ma, Yi Zhang, Junyang Lin, Qi Su, Xu Sun


  Access Paper or Ask Questions

Future-Prediction-Based Model for Neural Machine Translation


Sep 02, 2018
Bingzhen Wei, Junyang Lin


  Access Paper or Ask Questions

An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation


Aug 27, 2018
Liangchen Luo, Jingjing Xu, Junyang Lin, Qi Zeng, Xu Sun

* Accepted by EMNLP 2018 

  Access Paper or Ask Questions

Learning When to Concentrate or Divert Attention: Self-Adaptive Attention Temperature for Neural Machine Translation


Aug 26, 2018
Junyang Lin, Xu Sun, Xuancheng Ren, Muyu Li, Qi Su

* To appear in EMNLP 2018 

  Access Paper or Ask Questions

Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification


Aug 26, 2018
Junyang Lin, Qi Su, Pengcheng Yang, Shuming Ma, Xu Sun

* To appear in EMNLP 2018 

  Access Paper or Ask Questions

DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text


Aug 21, 2018
Jingjing Xu, Xuancheng Ren, Junyang Lin, Xu Sun

* Accepted by EMNLP 2018 

  Access Paper or Ask Questions

Deconvolution-Based Global Decoding for Neural Machine Translation


Jun 10, 2018
Junyang Lin, Xu Sun, Xuancheng Ren, Shuming Ma, Jinsong Su, Qi Su

* Accepted by COLING 2018 

  Access Paper or Ask Questions

Global Encoding for Abstractive Summarization


Jun 10, 2018
Junyang Lin, Xu Sun, Shuming Ma, Qi Su

* Accepted by ACL 2018 

  Access Paper or Ask Questions

A Hierarchical End-to-End Model for Jointly Improving Text Summarization and Sentiment Classification


May 30, 2018
Shuming Ma, Xu Sun, Junyang Lin, Xuancheng Ren

* accepted by IJCAI-18 

  Access Paper or Ask Questions

Bag-of-Words as Target for Neural Machine Translation


May 13, 2018
Shuming Ma, Xu Sun, Yizhong Wang, Junyang Lin

* accepted by ACL 2018 

  Access Paper or Ask Questions

Autoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization


May 13, 2018
Shuming Ma, Xu Sun, Junyang Lin, Houfeng Wang

* accepted by ACL 2018 

  Access Paper or Ask Questions

Decoding-History-Based Adaptive Control of Attention for Neural Machine Translation


Feb 06, 2018
Junyang Lin, Shuming Ma, Qi Su, Xu Sun


  Access Paper or Ask Questions