Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Lucas Torroba Hennigen

Lucas Torroba Hennigen

Learning to Grow Pretrained Models for Efficient Transformer Training

Mar 02, 2023
Peihao Wang, Rameswar Panda, Lucas Torroba Hennigen, Philip Greengard, Leonid Karlinsky, Rogerio Feris, David Daniel Cox, Zhangyang Wang, Yoon Kim

Figure 1 for Learning to Grow Pretrained Models for Efficient Transformer Training

Figure 2 for Learning to Grow Pretrained Models for Efficient Transformer Training

Figure 3 for Learning to Grow Pretrained Models for Efficient Transformer Training

Figure 4 for Learning to Grow Pretrained Models for Efficient Transformer Training

* International Conference on Learning Representations (ICLR), 2023

Access Paper or Ask Questions

UniMorph 4.0: Universal Morphology

May 10, 2022
Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina J. Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya Samame, Delio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier López Francis, Arturo Oncevay, Juan López Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean-Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóǧa, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovskaya, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Wolinski, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko, Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud'hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova

Figure 1 for UniMorph 4.0: Universal Morphology

Figure 2 for UniMorph 4.0: Universal Morphology

Figure 3 for UniMorph 4.0: Universal Morphology

Figure 4 for UniMorph 4.0: Universal Morphology

* LREC 2022; The first two authors made equal contributions

Access Paper or Ask Questions

Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models

May 08, 2022
Karolina Stańczak, Edoardo Ponti, Lucas Torroba Hennigen, Ryan Cotterell, Isabelle Augenstein

Figure 1 for Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models

Figure 2 for Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models

Figure 3 for Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models

Figure 4 for Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models

* Accepted at NAACL 2022 (Main Conference)

Access Paper or Ask Questions

Probing as Quantifying the Inductive Bias of Pre-trained Representations

Oct 15, 2021
Alexander Immer, Lucas Torroba Hennigen, Vincent Fortuin, Ryan Cotterell

Access Paper or Ask Questions

Classifying Dyads for Militarized Conflict Analysis

Sep 27, 2021
Niklas Stoehr, Lucas Torroba Hennigen, Samin Ahbab, Robert West, Ryan Cotterell

Figure 1 for Classifying Dyads for Militarized Conflict Analysis

Figure 2 for Classifying Dyads for Militarized Conflict Analysis

Figure 3 for Classifying Dyads for Militarized Conflict Analysis

Figure 4 for Classifying Dyads for Militarized Conflict Analysis

* Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP)

Access Paper or Ask Questions

Intrinsic Probing through Dimension Selection

Oct 06, 2020
Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell

Figure 1 for Intrinsic Probing through Dimension Selection

Figure 2 for Intrinsic Probing through Dimension Selection

Figure 3 for Intrinsic Probing through Dimension Selection

Figure 4 for Intrinsic Probing through Dimension Selection

* To appear EMNLP 2020

Access Paper or Ask Questions