Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Junxian He

Junxian He

Mega: Moving Average Equipped Gated Attention

Sep 26, 2022
Xuezhe Ma, Chunting Zhou, Xiang Kong, Junxian He, Liangke Gui, Graham Neubig, Jonathan May, Luke Zettlemoyer

Figure 1 for Mega: Moving Average Equipped Gated Attention

Figure 2 for Mega: Moving Average Equipped Gated Attention

Figure 3 for Mega: Moving Average Equipped Gated Attention

Figure 4 for Mega: Moving Average Equipped Gated Attention

* 13 pages, 4 figures and 7 tables. Fixed typos and added source code link

Access Paper or Ask Questions

Prompt Consistency for Zero-Shot Task Generalization

Apr 29, 2022
Chunting Zhou, Junxian He, Xuezhe Ma, Taylor Berg-Kirkpatrick, Graham Neubig

Figure 1 for Prompt Consistency for Zero-Shot Task Generalization

Figure 2 for Prompt Consistency for Zero-Shot Task Generalization

Figure 3 for Prompt Consistency for Zero-Shot Task Generalization

Figure 4 for Prompt Consistency for Zero-Shot Task Generalization

* Preprint. Code is available at https://github.com/violet-zct/swarm-distillation-zero-shot

Access Paper or Ask Questions

Capturing Structural Locality in Non-parametric Language Models

Oct 06, 2021
Frank F. Xu, Junxian He, Graham Neubig, Vincent J. Hellendoorn

Figure 1 for Capturing Structural Locality in Non-parametric Language Models

Figure 2 for Capturing Structural Locality in Non-parametric Language Models

Figure 3 for Capturing Structural Locality in Non-parametric Language Models

Figure 4 for Capturing Structural Locality in Non-parametric Language Models

Access Paper or Ask Questions

Dependency Induction Through the Lens of Visual Perception

Sep 20, 2021
Ruisi Su, Shruti Rijhwani, Hao Zhu, Junxian He, Xinyu Wang, Yonatan Bisk, Graham Neubig

Figure 1 for Dependency Induction Through the Lens of Visual Perception

Figure 2 for Dependency Induction Through the Lens of Visual Perception

Figure 3 for Dependency Induction Through the Lens of Visual Perception

Figure 4 for Dependency Induction Through the Lens of Visual Perception

* Accepted to CoNLL 2021

Access Paper or Ask Questions

Efficient Nearest Neighbor Language Models

Sep 09, 2021
Junxian He, Graham Neubig, Taylor Berg-Kirkpatrick

Figure 1 for Efficient Nearest Neighbor Language Models

Figure 2 for Efficient Nearest Neighbor Language Models

Figure 3 for Efficient Nearest Neighbor Language Models

Figure 4 for Efficient Nearest Neighbor Language Models

* EMNLP 2021

Access Paper or Ask Questions

On the Sentence Embeddings from Pre-trained Language Models

Nov 02, 2020
Bohan Li, Hao Zhou, Junxian He, Mingxuan Wang, Yiming Yang, Lei Li

Figure 1 for On the Sentence Embeddings from Pre-trained Language Models

Figure 2 for On the Sentence Embeddings from Pre-trained Language Models

Figure 3 for On the Sentence Embeddings from Pre-trained Language Models

Figure 4 for On the Sentence Embeddings from Pre-trained Language Models

* EMNLP 2020

Access Paper or Ask Questions