Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Omer Levy

Cryptonite: A Cryptic Crossword Benchmark for Extreme Ambiguity in Language


Mar 01, 2021
Avia Efrat, Uri Shaham, Dan Kilman, Omer Levy

* 6 pages, 3 figures 

  Access Paper or Ask Questions

Few-Shot Question Answering by Pretraining Span Selection


Jan 02, 2021
Ori Ram, Yuval Kirstain, Jonathan Berant, Amir Globerson, Omer Levy


  Access Paper or Ask Questions

Coreference Resolution without Span Representations


Jan 02, 2021
Yuval Kirstain, Ori Ram, Omer Levy


  Access Paper or Ask Questions

Transformer Feed-Forward Layers Are Key-Value Memories


Dec 29, 2020
Mor Geva, Roei Schuster, Jonathan Berant, Omer Levy


  Access Paper or Ask Questions

The Turking Test: Can Language Models Understand Instructions?


Oct 22, 2020
Avia Efrat, Omer Levy


  Access Paper or Ask Questions

Neural Machine Translation without Embeddings


Aug 21, 2020
Uri Shaham, Omer Levy


  Access Paper or Ask Questions

Aligned Cross Entropy for Non-Autoregressive Machine Translation


Apr 03, 2020
Marjan Ghazvininejad, Vladimir Karpukhin, Luke Zettlemoyer, Omer Levy


  Access Paper or Ask Questions

Semi-Autoregressive Training Improves Mask-Predict Decoding


Jan 23, 2020
Marjan Ghazvininejad, Omer Levy, Luke Zettlemoyer


  Access Paper or Ask Questions

Improving Transformer Models by Reordering their Sublayers


Nov 10, 2019
Ofir Press, Noah A. Smith, Omer Levy


  Access Paper or Ask Questions

Blockwise Self-Attention for Long Document Understanding


Nov 07, 2019
Jiezhong Qiu, Hao Ma, Omer Levy, Scott Wen-tau Yih, Sinong Wang, Jie Tang


  Access Paper or Ask Questions

Generalization through Memorization: Nearest Neighbor Language Models


Nov 01, 2019
Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis


  Access Paper or Ask Questions

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension


Oct 29, 2019
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, Luke Zettlemoyer


  Access Paper or Ask Questions

Structural Language Models for Any-Code Generation


Sep 30, 2019
Uri Alon, Roy Sadaka, Omer Levy, Eran Yahav


  Access Paper or Ask Questions

BERT for Coreference Resolution: Baselines and Analysis


Sep 01, 2019
Mandar Joshi, Omer Levy, Daniel S. Weld, Luke Zettlemoyer

* EMNLP 2019 camera ready version 

  Access Paper or Ask Questions

SpanBERT: Improving Pre-training by Representing and Predicting Spans


Jul 31, 2019
Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. Weld, Luke Zettlemoyer, Omer Levy


  Access Paper or Ask Questions

RoBERTa: A Robustly Optimized BERT Pretraining Approach


Jul 26, 2019
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov


  Access Paper or Ask Questions

What Does BERT Look At? An Analysis of BERT's Attention


Jun 11, 2019
Kevin Clark, Urvashi Khandelwal, Omer Levy, Christopher D. Manning

* BlackBoxNLP 2019 

  Access Paper or Ask Questions

Are Sixteen Heads Really Better than One?


May 25, 2019
Paul Michel, Omer Levy, Graham Neubig


  Access Paper or Ask Questions

SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems


May 02, 2019
Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman

* super.gluebenchmark.com 

  Access Paper or Ask Questions

Constant-Time Machine Translation with Conditional Masked Language Models


Apr 19, 2019
Marjan Ghazvininejad, Omer Levy, Yinhan Liu, Luke Zettlemoyer


  Access Paper or Ask Questions

Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation


Feb 05, 2019
Vladimir Karpukhin, Omer Levy, Jacob Eisenstein, Marjan Ghazvininejad


  Access Paper or Ask Questions

code2vec: Learning Distributed Representations of Code


Oct 30, 2018
Uri Alon, Meital Zilberstein, Omer Levy, Eran Yahav

* Accepted in POPL 2019 

  Access Paper or Ask Questions

pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference


Oct 20, 2018
Mandar Joshi, Eunsol Choi, Omer Levy, Daniel S. Weld, Luke Zettlemoyer


  Access Paper or Ask Questions

code2seq: Generating Sequences from Structured Representations of Code


Oct 10, 2018
Uri Alon, Omer Levy, Eran Yahav


  Access Paper or Ask Questions

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding


Sep 18, 2018
Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman

* https://gluebenchmark.com/ 

  Access Paper or Ask Questions

Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling


Aug 13, 2018
Luheng He, Kenton Lee, Omer Levy, Luke Zettlemoyer

* 5 pages, ACL 2018 

  Access Paper or Ask Questions

Ultra-Fine Entity Typing


Jul 13, 2018
Eunsol Choi, Omer Levy, Yejin Choi, Luke Zettlemoyer

* ACL 18 

  Access Paper or Ask Questions

LSTMs Exploit Linguistic Attributes of Data


May 29, 2018
Nelson F. Liu, Omer Levy, Roy Schwartz, Chenhao Tan, Noah A. Smith

* 7 pages, 4 figures; accepted to ACL 2018 RepL4NLP workshop 

  Access Paper or Ask Questions

Simulating Action Dynamics with Neural Process Networks


May 15, 2018
Antoine Bosselut, Omer Levy, Ari Holtzman, Corin Ennis, Dieter Fox, Yejin Choi


  Access Paper or Ask Questions