Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Junyang Lin

Junyang Lin

M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining


Oct 13, 2021
Junyang Lin, An Yang, Jinze Bai, Chang Zhou, Le Jiang, Xianyan Jia, Ang Wang, Jie Zhang, Yong Li, Wei Lin, Jingren Zhou, Hongxia Yang

Figure 1 for M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining
Figure 2 for M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining
Figure 3 for M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining
Figure 4 for M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining
* 14 pages, 4 figures 
  Access Paper or Ask Questions

Exploring Sparse Expert Models and Beyond


Jun 14, 2021
An Yang, Junyang Lin, Rui Men, Chang Zhou, Le Jiang, Xianyan Jia, Ang Wang, Jie Zhang, Jiamang Wang, Yong Li, Di Zhang, Wei Lin, Lin Qu, Jingren Zhou, Hongxia Yang

Figure 1 for Exploring Sparse Expert Models and Beyond
Figure 2 for Exploring Sparse Expert Models and Beyond
Figure 3 for Exploring Sparse Expert Models and Beyond
Figure 4 for Exploring Sparse Expert Models and Beyond
* 16 pages, 8 figures 
  Access Paper or Ask Questions

Learning Relation Alignment for Calibrated Cross-modal Retrieval


Jun 01, 2021
Shuhuai Ren, Junyang Lin, Guangxiang Zhao, Rui Men, An Yang, Jingren Zhou, Xu Sun, Hongxia Yang

Figure 1 for Learning Relation Alignment for Calibrated Cross-modal Retrieval
Figure 2 for Learning Relation Alignment for Calibrated Cross-modal Retrieval
Figure 3 for Learning Relation Alignment for Calibrated Cross-modal Retrieval
Figure 4 for Learning Relation Alignment for Calibrated Cross-modal Retrieval
* Accepted by ACL-IJCNLP 2021 main conference (Long Paper) 
  Access Paper or Ask Questions

Connecting Language and Vision for Natural Language-Based Vehicle Retrieval


May 31, 2021
Shuai Bai, Zhedong Zheng, Xiaohan Wang, Junyang Lin, Zhu Zhang, Chang Zhou, Yi Yang, Hongxia Yang

Figure 1 for Connecting Language and Vision for Natural Language-Based Vehicle Retrieval
Figure 2 for Connecting Language and Vision for Natural Language-Based Vehicle Retrieval
Figure 3 for Connecting Language and Vision for Natural Language-Based Vehicle Retrieval
Figure 4 for Connecting Language and Vision for Natural Language-Based Vehicle Retrieval
* CVPR 2021 AI CITY CHALLENGE Natural Language-Based Vehicle Retrieval Top 1 
  Access Paper or Ask Questions

Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation


May 31, 2021
Peng Wang, Junyang Lin, An Yang, Chang Zhou, Yichang Zhang, Jingren Zhou, Hongxia Yang

Figure 1 for Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation
Figure 2 for Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation
Figure 3 for Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation
Figure 4 for Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation
* 13 pages, 2 figures. Accepted in ACL2021 Findings 
  Access Paper or Ask Questions

CogView: Mastering Text-to-Image Generation via Transformers


May 28, 2021
Ming Ding, Zhuoyi Yang, Wenyi Hong, Wendi Zheng, Chang Zhou, Da Yin, Junyang Lin, Xu Zou, Zhou Shao, Hongxia Yang, Jie Tang

Figure 1 for CogView: Mastering Text-to-Image Generation via Transformers
Figure 2 for CogView: Mastering Text-to-Image Generation via Transformers
Figure 3 for CogView: Mastering Text-to-Image Generation via Transformers
Figure 4 for CogView: Mastering Text-to-Image Generation via Transformers

  Access Paper or Ask Questions

M6: A Chinese Multimodal Pretrainer


Mar 02, 2021
Junyang Lin, Rui Men, An Yang, Chang Zhou, Ming Ding, Yichang Zhang, Peng Wang, Ang Wang, Le Jiang, Xianyan Jia, Jie Zhang, Jianwei Zhang, Xu Zou, Zhikang Li, Xiaodong Deng, Jie Liu, Jinbao Xue, Huiling Zhou, Jianxin Ma, Jin Yu, Yong Li, Wei Lin, Jingren Zhou, Jie Tang, Hongxia Yang

Figure 1 for M6: A Chinese Multimodal Pretrainer
Figure 2 for M6: A Chinese Multimodal Pretrainer
Figure 3 for M6: A Chinese Multimodal Pretrainer
Figure 4 for M6: A Chinese Multimodal Pretrainer
* 12 pages, technical report 
  Access Paper or Ask Questions

Graph-based Multi-hop Reasoning for Long Text Generation


Sep 28, 2020
Liang Zhao, Jingjing Xu, Junyang Lin, Yichang Zhang, Hongxia Yang, Xu Sun

Figure 1 for Graph-based Multi-hop Reasoning for Long Text Generation
Figure 2 for Graph-based Multi-hop Reasoning for Long Text Generation
Figure 3 for Graph-based Multi-hop Reasoning for Long Text Generation
Figure 4 for Graph-based Multi-hop Reasoning for Long Text Generation

  Access Paper or Ask Questions

InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining


Mar 30, 2020
Junyang Lin, An Yang, Yichang Zhang, Jie Liu, Jingren Zhou, Hongxia Yang

Figure 1 for InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining
Figure 2 for InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining
Figure 3 for InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining
Figure 4 for InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining
* 11 pages, 4 figures 
  Access Paper or Ask Questions

Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection


Dec 25, 2019
Guangxiang Zhao, Junyang Lin, Zhiyuan Zhang, Xuancheng Ren, Qi Su, Xu Sun

Figure 1 for Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection
Figure 2 for Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection
Figure 3 for Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection
Figure 4 for Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection

  Access Paper or Ask Questions

Understanding and Improving Layer Normalization


Nov 16, 2019
Jingjing Xu, Xu Sun, Zhiyuan Zhang, Guangxiang Zhao, Junyang Lin

Figure 1 for Understanding and Improving Layer Normalization
Figure 2 for Understanding and Improving Layer Normalization
Figure 3 for Understanding and Improving Layer Normalization
Figure 4 for Understanding and Improving Layer Normalization
* Accepted by NeurIPS 2019 
  Access Paper or Ask Questions

Towards Knowledge-Based Recommender Dialog System


Sep 03, 2019
Qibin Chen, Junyang Lin, Yichang Zhang, Ming Ding, Yukuo Cen, Hongxia Yang, Jie Tang

Figure 1 for Towards Knowledge-Based Recommender Dialog System
Figure 2 for Towards Knowledge-Based Recommender Dialog System
Figure 3 for Towards Knowledge-Based Recommender Dialog System
Figure 4 for Towards Knowledge-Based Recommender Dialog System
* To appear in EMNLP 2019 
  Access Paper or Ask Questions

Imitation Learning for Non-Autoregressive Neural Machine Translation


Jul 18, 2019
Bingzhen Wei, Mingxuan Wang, Hao Zhou, Junyang Lin, Jun Xie, Xu Sun

Figure 1 for Imitation Learning for Non-Autoregressive Neural Machine Translation
Figure 2 for Imitation Learning for Non-Autoregressive Neural Machine Translation
Figure 3 for Imitation Learning for Non-Autoregressive Neural Machine Translation
Figure 4 for Imitation Learning for Non-Autoregressive Neural Machine Translation
* Accepted by ACL 2019. arXiv admin note: text overlap with arXiv:1902.10245, arXiv:1812.09664 by other authors 
  Access Paper or Ask Questions

Towards Knowledge-Based Personalized Product Description Generation in E-commerce


Apr 30, 2019
Qibin Chen, Junyang Lin, Yichang Zhang, Hongxia Yang, Jingren Zhou, Jie Tang

Figure 1 for Towards Knowledge-Based Personalized Product Description Generation in E-commerce
Figure 2 for Towards Knowledge-Based Personalized Product Description Generation in E-commerce
Figure 3 for Towards Knowledge-Based Personalized Product Description Generation in E-commerce
Figure 4 for Towards Knowledge-Based Personalized Product Description Generation in E-commerce
* Accepted to KDD 2019. Website: https://sites.google.com/view/kobe2019 
  Access Paper or Ask Questions

A Deep Reinforced Sequence-to-Set Model for Multi-Label Text Classification


Sep 10, 2018
Pengcheng Yang, Shuming Ma, Yi Zhang, Junyang Lin, Qi Su, Xu Sun

Figure 1 for A Deep Reinforced Sequence-to-Set Model for Multi-Label Text Classification
Figure 2 for A Deep Reinforced Sequence-to-Set Model for Multi-Label Text Classification
Figure 3 for A Deep Reinforced Sequence-to-Set Model for Multi-Label Text Classification
Figure 4 for A Deep Reinforced Sequence-to-Set Model for Multi-Label Text Classification

  Access Paper or Ask Questions

Future-Prediction-Based Model for Neural Machine Translation


Sep 02, 2018
Bingzhen Wei, Junyang Lin

Figure 1 for Future-Prediction-Based Model for Neural Machine Translation
Figure 2 for Future-Prediction-Based Model for Neural Machine Translation
Figure 3 for Future-Prediction-Based Model for Neural Machine Translation
Figure 4 for Future-Prediction-Based Model for Neural Machine Translation

  Access Paper or Ask Questions

An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation


Aug 27, 2018
Liangchen Luo, Jingjing Xu, Junyang Lin, Qi Zeng, Xu Sun

Figure 1 for An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation
Figure 2 for An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation
Figure 3 for An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation
Figure 4 for An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation
* Accepted by EMNLP 2018 
  Access Paper or Ask Questions

Learning When to Concentrate or Divert Attention: Self-Adaptive Attention Temperature for Neural Machine Translation


Aug 26, 2018
Junyang Lin, Xu Sun, Xuancheng Ren, Muyu Li, Qi Su

Figure 1 for Learning When to Concentrate or Divert Attention: Self-Adaptive Attention Temperature for Neural Machine Translation
Figure 2 for Learning When to Concentrate or Divert Attention: Self-Adaptive Attention Temperature for Neural Machine Translation
Figure 3 for Learning When to Concentrate or Divert Attention: Self-Adaptive Attention Temperature for Neural Machine Translation
Figure 4 for Learning When to Concentrate or Divert Attention: Self-Adaptive Attention Temperature for Neural Machine Translation
* To appear in EMNLP 2018 
  Access Paper or Ask Questions

Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification


Aug 26, 2018
Junyang Lin, Qi Su, Pengcheng Yang, Shuming Ma, Xu Sun

Figure 1 for Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification
Figure 2 for Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification
Figure 3 for Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification
Figure 4 for Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification
* To appear in EMNLP 2018 
  Access Paper or Ask Questions

DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text


Aug 21, 2018
Jingjing Xu, Xuancheng Ren, Junyang Lin, Xu Sun

Figure 1 for DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text
Figure 2 for DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text
Figure 3 for DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text
Figure 4 for DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text
* Accepted by EMNLP 2018 
  Access Paper or Ask Questions

Deconvolution-Based Global Decoding for Neural Machine Translation


Jun 10, 2018
Junyang Lin, Xu Sun, Xuancheng Ren, Shuming Ma, Jinsong Su, Qi Su

Figure 1 for Deconvolution-Based Global Decoding for Neural Machine Translation
Figure 2 for Deconvolution-Based Global Decoding for Neural Machine Translation
Figure 3 for Deconvolution-Based Global Decoding for Neural Machine Translation
Figure 4 for Deconvolution-Based Global Decoding for Neural Machine Translation
* Accepted by COLING 2018 
  Access Paper or Ask Questions

Global Encoding for Abstractive Summarization


Jun 10, 2018
Junyang Lin, Xu Sun, Shuming Ma, Qi Su

Figure 1 for Global Encoding for Abstractive Summarization
Figure 2 for Global Encoding for Abstractive Summarization
Figure 3 for Global Encoding for Abstractive Summarization
Figure 4 for Global Encoding for Abstractive Summarization
* Accepted by ACL 2018 
  Access Paper or Ask Questions

A Hierarchical End-to-End Model for Jointly Improving Text Summarization and Sentiment Classification


May 30, 2018
Shuming Ma, Xu Sun, Junyang Lin, Xuancheng Ren

Figure 1 for A Hierarchical End-to-End Model for Jointly Improving Text Summarization and Sentiment Classification
Figure 2 for A Hierarchical End-to-End Model for Jointly Improving Text Summarization and Sentiment Classification
Figure 3 for A Hierarchical End-to-End Model for Jointly Improving Text Summarization and Sentiment Classification
Figure 4 for A Hierarchical End-to-End Model for Jointly Improving Text Summarization and Sentiment Classification
* accepted by IJCAI-18 
  Access Paper or Ask Questions

Bag-of-Words as Target for Neural Machine Translation


May 13, 2018
Shuming Ma, Xu Sun, Yizhong Wang, Junyang Lin

Figure 1 for Bag-of-Words as Target for Neural Machine Translation
Figure 2 for Bag-of-Words as Target for Neural Machine Translation
Figure 3 for Bag-of-Words as Target for Neural Machine Translation
Figure 4 for Bag-of-Words as Target for Neural Machine Translation
* accepted by ACL 2018 
  Access Paper or Ask Questions

Autoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization


May 13, 2018
Shuming Ma, Xu Sun, Junyang Lin, Houfeng Wang

Figure 1 for Autoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization
Figure 2 for Autoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization
Figure 3 for Autoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization
Figure 4 for Autoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization
* accepted by ACL 2018 
  Access Paper or Ask Questions

Decoding-History-Based Adaptive Control of Attention for Neural Machine Translation


Feb 06, 2018
Junyang Lin, Shuming Ma, Qi Su, Xu Sun

Figure 1 for Decoding-History-Based Adaptive Control of Attention for Neural Machine Translation
Figure 2 for Decoding-History-Based Adaptive Control of Attention for Neural Machine Translation
Figure 3 for Decoding-History-Based Adaptive Control of Attention for Neural Machine Translation
Figure 4 for Decoding-History-Based Adaptive Control of Attention for Neural Machine Translation

  Access Paper or Ask Questions