Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Ian Tenney

The MultiBERTs: BERT Reproductions for Robustness Analysis


Jun 30, 2021
Thibault Sellam, Steve Yadlowsky, Jason Wei, Naomi Saphra, Alexander D'Amour, Tal Linzen, Jasmijn Bastings, Iulia Turc, Jacob Eisenstein, Dipanjan Das, Ian Tenney, Ellie Pavlick

* Checkpoints and example analyses: http://goo.gle/multiberts 

  Access Paper or Ask Questions

Measuring and Reducing Gendered Correlations in Pre-trained Models


Oct 12, 2020
Kellie Webster, Xuezhi Wang, Ian Tenney, Alex Beutel, Emily Pitler, Ellie Pavlick, Jilin Chen, Slav Petrov


  Access Paper or Ask Questions

Do Language Embeddings Capture Scales?


Oct 11, 2020
Xikun Zhang, Deepak Ramachandran, Ian Tenney, Yanai Elazar, Dan Roth

* Accepted at EMNLP Findings 2020 and EMNLP BlackboxNLP workshop 2020 

  Access Paper or Ask Questions

The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models


Aug 12, 2020
Ian Tenney, James Wexler, Jasmijn Bastings, Tolga Bolukbasi, Andy Coenen, Sebastian Gehrmann, Ellen Jiang, Mahima Pushkarna, Carey Radebaugh, Emily Reif, Ann Yuan


  Access Paper or Ask Questions

Asking without Telling: Exploring Latent Ontologies in Contextual Representations


Apr 29, 2020
Julian Michael, Jan A. Botha, Ian Tenney

* 18 pages, 6 figures, 11 tables 

  Access Paper or Ask Questions

What Happens To BERT Embeddings During Fine-tuning?


Apr 29, 2020
Amil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, Ian Tenney

* 9 pages (not including references), 5 figures 

  Access Paper or Ask Questions

jiant: A Software Toolkit for Research on General-Purpose Text Understanding Models


Mar 04, 2020
Yada Pruksachatkun, Phil Yeres, Haokun Liu, Jason Phang, Phu Mon Htut, Alex Wang, Ian Tenney, Samuel R. Bowman


  Access Paper or Ask Questions

What do you learn from context? Probing for sentence structure in contextualized word representations


May 15, 2019
Ian Tenney, Patrick Xia, Berlin Chen, Alex Wang, Adam Poliak, R Thomas McCoy, Najoung Kim, Benjamin Van Durme, Samuel R. Bowman, Dipanjan Das, Ellie Pavlick

* ICLR 2019 camera-ready version, 17 pages including appendices 

  Access Paper or Ask Questions

BERT Rediscovers the Classical NLP Pipeline


May 15, 2019
Ian Tenney, Dipanjan Das, Ellie Pavlick

* Accepted to ACL 2019 

  Access Paper or Ask Questions

Probing What Different NLP Tasks Teach Machines about Function Word Comprehension


Apr 25, 2019
Najoung Kim, Roma Patel, Adam Poliak, Alex Wang, Patrick Xia, R. Thomas McCoy, Ian Tenney, Alexis Ross, Tal Linzen, Benjamin Van Durme, Samuel R. Bowman, Ellie Pavlick

* Accepted to *SEM 2019 

  Access Paper or Ask Questions

Looking for ELMo's friends: Sentence-Level Pretraining Beyond Language Modeling


Dec 28, 2018
Samuel R. Bowman, Ellie Pavlick, Edouard Grave, Benjamin Van Durme, Alex Wang, Jan Hula, Patrick Xia, Raghavendra Pappagari, R. Thomas McCoy, Roma Patel, Najoung Kim, Ian Tenney, Yinghui Huang, Katherin Yu, Shuning Jin, Berlin Chen


  Access Paper or Ask Questions

WikiAtomicEdits: A Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse


Aug 28, 2018
Manaal Faruqui, Ellie Pavlick, Ian Tenney, Dipanjan Das

* Proc. of EMNLP 2018 

  Access Paper or Ask Questions