Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models



Kushal Tirumala , Aram H. Markosyan , Luke Zettlemoyer , Armen Aghajanyan


   Access Paper or Ask Questions

InCoder: A Generative Model for Code Infilling and Synthesis



Daniel Fried , Armen Aghajanyan , Jessy Lin , Sida Wang , Eric Wallace , Freda Shi , Ruiqi Zhong , Wen-tau Yih , Luke Zettlemoyer , Mike Lewis

* 25 pages, 13 figures. v2: added NeoX-20B results & StackOverflow corpus info 

   Access Paper or Ask Questions

Improving Passage Retrieval with Zero-Shot Question Generation



Devendra Singh Sachan , Mike Lewis , Mandar Joshi , Armen Aghajanyan , Wen-tau Yih , Joelle Pineau , Luke Zettlemoyer


   Access Paper or Ask Questions

CM3: A Causal Masked Multimodal Model of the Internet



Armen Aghajanyan , Bernie Huang , Candace Ross , Vladimir Karpukhin , Hu Xu , Naman Goyal , Dmytro Okhonko , Mandar Joshi , Gargi Ghosh , Mike Lewis , Luke Zettlemoyer


   Access Paper or Ask Questions

CCQA: A New Web-Scale Question Answering Dataset for Model Pre-Training



Patrick Huber , Armen Aghajanyan , Barlas Oğuz , Dmytro Okhonko , Wen-tau Yih , Sonal Gupta , Xilun Chen


   Access Paper or Ask Questions

VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding



Hu Xu , Gargi Ghosh , Po-Yao Huang , Dmytro Okhonko , Armen Aghajanyan , Florian Metze , Luke Zettlemoyer , Christoph Feichtenhofer

* EMNLP 2021 

   Access Paper or Ask Questions

RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing



Vivek Gupta , Akshat Shrivastava , Adithya Sagar , Armen Aghajanyan , Denis Savenkov

* 12 pages, 9 figures, 5 Tables 

   Access Paper or Ask Questions

HTLM: Hyper-Text Pre-Training and Prompting of Language Models



Armen Aghajanyan , Dmytro Okhonko , Mike Lewis , Mandar Joshi , Hu Xu , Gargi Ghosh , Luke Zettlemoyer


   Access Paper or Ask Questions

Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog



Arun Babu , Akshat Shrivastava , Armen Aghajanyan , Ahmed Aly , Angela Fan , Marjan Ghazvininejad


   Access Paper or Ask Questions

1
2
>>