Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Xin Jiang

PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation


Apr 26, 2021
Wei Zeng, Xiaozhe Ren, Teng Su, Hui Wang, Yi Liao, Zhiwei Wang, Xin Jiang, ZhenZhang Yang, Kaisheng Wang, Xiaoda Zhang, Chen Li, Ziyan Gong, Yifan Yao, Xinjing Huang, Jun Wang, Jianfeng Yu, Qi Guo, Yue Yu, Yan Zhang, Jin Wang, Hengtao Tao, Dasen Yan, Zexuan Yi, Fang Peng, Fangqing Jiang, Han Zhang, Lingfeng Deng, Yehong Zhang, Zhe Lin, Chao Zhang, Shaojie Zhang, Mingyue Guo, Shanzhi Gu, Gaojun Fan, Yaowei Wang, Xuefeng Jin, Qun Liu, Yonghong Tian

* The technique report for PanGu-$\alpha$ 

  Access Paper or Ask Questions

Extract then Distill: Efficient and Effective Task-Agnostic BERT Distillation


Apr 24, 2021
Cheng Chen, Yichun Yin, Lifeng Shang, Zhi Wang, Xin Jiang, Xiao Chen, Qun Liu


  Access Paper or Ask Questions

An Approach to Improve Robustness of NLP Systems against ASR Errors


Mar 25, 2021
Tong Cui, Jinghui Xiao, Liangyou Li, Xin Jiang, Qun Liu

* 9 pages, 3 figures 

  Access Paper or Ask Questions

Reweighting Augmented Samples by Minimizing the Maximal Expected Loss


Mar 16, 2021
Mingyang Yi, Lu Hou, Lifeng Shang, Xin Jiang, Qun Liu, Zhi-Ming Ma

* published in ICLR2021 
* 14 pages 

  Access Paper or Ask Questions

LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation


Mar 11, 2021
Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu


  Access Paper or Ask Questions

Training Multilingual Pre-trained Language Model with Byte-level Subwords


Jan 23, 2021
Junqiu Wei, Qun Liu, Yinpeng Guo, Xin Jiang


  Access Paper or Ask Questions

Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks


Jan 19, 2021
Zhengyan Zhang, Guangxuan Xiao, Yongwei Li, Tian Lv, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Xin Jiang, Maosong Sun


  Access Paper or Ask Questions

BinaryBERT: Pushing the Limit of BERT Quantization


Dec 31, 2020
Haoli Bai, Wei Zhang, Lu Hou, Lifeng Shang, Jing Jin, Xin Jiang, Qun Liu, Michael Lyu, Irwin King


  Access Paper or Ask Questions

HopRetriever: Retrieve Hops over Wikipedia to Answer Complex Questions


Dec 31, 2020
Shaobo Li, Xiaoguang Li, Lifeng Shang, Xin Jiang, Qun Liu, Chengjie Sun, Zhenzhou Ji, Bingquan Liu

* Accepted at AAAI 2021 

  Access Paper or Ask Questions

Query-free Black-box Adversarial Attacks on Graphs


Dec 12, 2020
Jiarong Xu, Yizhou Sun, Xin Jiang, Yanhao Wang, Yang Yang, Chunping Wang, Jiangang Lu


  Access Paper or Ask Questions

Improving Task-Agnostic BERT Distillation with Layer Mapping Search


Dec 11, 2020
Xiaoqi Jiao, Huating Chang, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu


  Access Paper or Ask Questions

PPKE: Knowledge Representation Learning by Path-based Pre-training


Dec 07, 2020
Bin He, Di Zhou, Jing Xie, Jinghui Xiao, Xin Jiang, Qun Liu


  Access Paper or Ask Questions

KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning


Dec 07, 2020
Bin He, Xin Jiang, Jinghui Xiao, Qun Liu

* 10 pages, 3 figures 

  Access Paper or Ask Questions

HyperText: Endowing FastText with Hyperbolic Geometry


Oct 30, 2020
Yudong Zhu, Di Zhou, Jinghui Xiao, Xin Jiang, Xiao Chen, Qun Liu

* Findings of EMNLP 2020 

  Access Paper or Ask Questions

TernaryBERT: Distillation-aware Ultra-low Bit BERT


Oct 10, 2020
Wei Zhang, Lu Hou, Yichun Yin, Lifeng Shang, Xiao Chen, Xin Jiang, Qun Liu

* Accepted by EMNLP 2020 

  Access Paper or Ask Questions

Unsupervised Text Generation by Learning from Search


Jul 09, 2020
Jingjing Li, Zichao Li, Lili Mou, Xin Jiang, Michael R. Lyu, Irwin King


  Access Paper or Ask Questions

Learning to Detect Unacceptable Machine Translations for Downstream Tasks


May 08, 2020
Meng Zhang, Xin Jiang, Yang Liu, Qun Liu


  Access Paper or Ask Questions

Accurate Word Alignment Induction from Neural Machine Translation


Apr 30, 2020
Yun Chen, Yang Liu, Guanhua Chen, Xin Jiang, Qun Liu


  Access Paper or Ask Questions

On the Importance of Word and Sentence Representation Learning in Implicit Discourse Relation Classification


Apr 28, 2020
Xin Liu, Jiefu Ou, Yangqiu Song, Xin Jiang

* Accepted by IJCAI 2020 

  Access Paper or Ask Questions

Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order


Apr 24, 2020
Yi Liao, Xin Jiang, Qun Liu

* Accepted by ACL 2020 

  Access Paper or Ask Questions

DynaBERT: Dynamic BERT with Adaptive Width and Depth


Apr 08, 2020
Lu Hou, Lifeng Shang, Xin Jiang, Qun Liu


  Access Paper or Ask Questions

Neural Subgraph Isomorphism Counting


Dec 25, 2019
Xin Liu, Haojie Pan, Mutian He, Yangqiu Song, Xin Jiang


  Access Paper or Ask Questions

Personalizing Graph Neural Networks with Attention Mechanism for Session-based Recommendation


Dec 02, 2019
Shu Wu, Mengqi Zhang, Xin Jiang, Xu Ke, Liang Wang


  Access Paper or Ask Questions

HMTNet:3D Hand Pose Estimation from Single Depth Image Based on Hand Morphological Topology


Nov 12, 2019
Weiguo Zhou, Xin Jiang, Chen Chen, Sijia Mei, Yun-Hui Liu


  Access Paper or Ask Questions

Zero-Shot Paraphrase Generation with Multilingual Language Models


Nov 09, 2019
Yinpeng Guo, Yi Liao, Xin Jiang, Qing Zhang, Yibo Zhang, Qun Liu


  Access Paper or Ask Questions

How to Do Simultaneous Translation Better with Consecutive Neural Machine Translation?


Nov 08, 2019
Yun Chen, Liangyou Li, Xin Jiang, Xiao Chen, Qun Liu


  Access Paper or Ask Questions

Pretrained Language Models for Document-Level Neural Machine Translation


Nov 08, 2019
Liangyou Li, Xin Jiang, Qun Liu


  Access Paper or Ask Questions

TinyBERT: Distilling BERT for Natural Language Understanding


Sep 24, 2019
Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu

* 13 pages, 2 figures, 9 tables 

  Access Paper or Ask Questions