Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Ryan Cotterell

Naturalistic Causal Probing for Morpho-Syntax


May 14, 2022
Afra Amini, Tiago Pimentel, Clara Meister, Ryan Cotterell

* To appear in TACL 2022. The arXiv version is a pre-MIT Press publication version 

  Access Paper or Ask Questions

UniMorph 4.0: Universal Morphology


May 10, 2022
Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina J. Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya Samame, Delio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier López Francis, Arturo Oncevay, Juan López Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean-Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóǧa, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovskaya, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Wolinski, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko, Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud'hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova

* LREC 2022; The first two authors made equal contributions 

  Access Paper or Ask Questions

A Structured Span Selector


May 08, 2022
Tianyu Liu, Yuchen Eleanor Jiang, Ryan Cotterell, Mrinmaya Sachan

* NAACL 2022 camera-ready 

  Access Paper or Ask Questions

Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models


May 08, 2022
Karolina Stańczak, Edoardo Ponti, Lucas Torroba Hennigen, Ryan Cotterell, Isabelle Augenstein

* Accepted at NAACL 2022 (Main Conference) 

  Access Paper or Ask Questions

Exact Paired-Permutation Testing for Structured Test Statistics


May 04, 2022
Ran Zmigrod, Tim Vieira, Ryan Cotterell


  Access Paper or Ask Questions

Probing for the Usage of Grammatical Number


Apr 21, 2022
Karim Lasri, Tiago Pimentel, Alessandro Lenci, Thierry Poibeau, Ryan Cotterell

* ACL 2022 (Main Conference) The discussion section had been inadvertently removed before the article was published on arxiv 

  Access Paper or Ask Questions

Estimating the Entropy of Linguistic Distributions


Apr 05, 2022
Aryaman Arora, Clara Meister, Ryan Cotterell

* 21 pages (5 pages main text). 4 figures. Accepted to ACL 2022 

  Access Paper or Ask Questions

On the probability-quality paradox in language generation


Mar 31, 2022
Clara Meister, Gian Wiher, Tiago Pimentel, Ryan Cotterell

* ACL 2022 (main conference) 

  Access Paper or Ask Questions

Analyzing Wrap-Up Effects through an Information-Theoretic Lens


Mar 31, 2022
Clara Meister, Tiago Pimentel, Thomas Hikaru Clark, Ryan Cotterell, Roger Levy

* ACL 2022 (main conference) 

  Access Paper or Ask Questions

On Decoding Strategies for Neural Text Generators


Mar 29, 2022
Gian Wiher, Clara Meister, Ryan Cotterell


  Access Paper or Ask Questions

Typical Decoding for Natural Language Generation


Feb 10, 2022
Clara Meister, Tiago Pimentel, Gian Wiher, Ryan Cotterell


  Access Paper or Ask Questions

Adversarial Concept Erasure in Kernel Space


Jan 28, 2022
Shauli Ravfogel, Francisco Vargas, Yoav Goldberg, Ryan Cotterell

* Preprint 

  Access Paper or Ask Questions

Linear Adversarial Concept Erasure


Jan 28, 2022
Shauli Ravfogel, Michael Twiton, Yoav Goldberg, Ryan Cotterell

* Preprint 

  Access Paper or Ask Questions

A Latent-Variable Model for Intrinsic Probing


Jan 20, 2022
Karolina Stańczak, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell, Isabelle Augenstein


  Access Paper or Ask Questions

A Word on Machine Ethics: A Response to Jiang et al. (2021)


Nov 07, 2021
Zeerak Talat, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, Adina Williams

* 11 pages, 2 figures, submitting soon to ACL Rolling Review 

  Access Paper or Ask Questions

Probing as Quantifying the Inductive Bias of Pre-trained Representations


Oct 15, 2021
Alexander Immer, Lucas Torroba Hennigen, Vincent Fortuin, Ryan Cotterell


  Access Paper or Ask Questions

A surprisal--duration trade-off across and within the world's languages


Sep 30, 2021
Tiago Pimentel, Clara Meister, Elizabeth Salesky, Simone Teufel, Damián Blasi, Ryan Cotterell

* Accepted for publication in EMNLP 2021. Code available in https://github.com/rycolab/surprisal-duration-tradeoff 

  Access Paper or Ask Questions

On Homophony and Rényi Entropy


Sep 28, 2021
Tiago Pimentel, Clara Meister, Simone Teufel, Ryan Cotterell

* Accepted for publication in EMNLP 2021. Code available in https://github.com/rycolab/homophony-as-renyi-entropy 

  Access Paper or Ask Questions

Classifying Dyads for Militarized Conflict Analysis


Sep 27, 2021
Niklas Stoehr, Lucas Torroba Hennigen, Samin Ahbab, Robert West, Ryan Cotterell

* Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP) 

  Access Paper or Ask Questions

Revisiting the Uniform Information Density Hypothesis


Sep 23, 2021
Clara Meister, Tiago Pimentel, Patrick Haller, Lena Jäger, Ryan Cotterell, Roger Levy

* Proceedings of EMNLP 2021 

  Access Paper or Ask Questions

Conditional Poisson Stochastic Beam Search


Sep 22, 2021
Clara Meister, Afra Amini, Tim Viera, Ryan Cotterell

* Proceedings of EMNLP 2021 

  Access Paper or Ask Questions

A Plug-and-Play Method for Controlled Text Generation


Sep 20, 2021
Damian Pascual, Beni Egressy, Clara Meister, Ryan Cotterell, Roger Wattenhofer

* Findings of EMNLP 2021 

  Access Paper or Ask Questions

Searching for More Efficient Dynamic Programs


Sep 14, 2021
Tim Vieira, Ryan Cotterell, Jason Eisner


  Access Paper or Ask Questions

Efficient Sampling of Dependency Structures


Sep 14, 2021
Ran Zmigrod, Tim Vieira, Ryan Cotterell


  Access Paper or Ask Questions

A Bayesian Framework for Information-Theoretic Probing


Sep 08, 2021
Tiago Pimentel, Ryan Cotterell

* Accepted for publication in EMNLP 2021. Code available in https://github.com/rycolab/bayesian-mi 

  Access Paper or Ask Questions

Differentiable Subset Pruning of Transformer Heads


Aug 22, 2021
Jiaoda Li, Ryan Cotterell, Mrinmaya Sachan

* TACL 2021 

  Access Paper or Ask Questions

Towards Zero-shot Language Modeling


Aug 06, 2021
Edoardo Maria Ponti, Ivan Vulić, Ryan Cotterell, Roi Reichart, Anna Korhonen


  Access Paper or Ask Questions

Determinantal Beam Search


Jun 21, 2021
Clara Meister, Martina Forster, Ryan Cotterell

* Proceedings of ACL-IJCNLP 2021 

  Access Paper or Ask Questions