Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting



Tomasz Korbak , Hady Elsahar , Germán Kruszewski , Marc Dymetman


   Access Paper or Ask Questions

Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources



Angelina McMillan-Major , Zaid Alyafeai , Stella Biderman , Kimbo Chen , Francesco De Toni , Gérard Dupont , Hady Elsahar , Chris Emezue , Alham Fikri Aji , Suzana Ilić , Nurulaqilla Khamis , Colin Leong , Maraim Masoud , Aitor Soroa , Pedro Ortiz Suarez , Zeerak Talat , Daniel van Strien , Yacine Jernite

* 8 pages plus appendix and references 

   Access Paper or Ask Questions

Sampling from Discrete Energy-Based Models with Quality/Efficiency Trade-offs



Bryan Eikema , Germán Kruszewski , Hady Elsahar , Marc Dymetman


   Access Paper or Ask Questions

Controlling Conditional Language Models with Distributional Policy Gradients



Tomasz Korbak , Hady Elsahar , German Kruszewski , Marc Dymetman

* CtrlGen: Controllable Generative Modeling in Language and Vision Workshop at NeurIPS 2021 

   Access Paper or Ask Questions

Unsupervised and Distributional Detection of Machine-Generated Text



Matthias Gallé , Jos Rozen , Germán Kruszewski , Hady Elsahar

* 10 pages 

   Access Paper or Ask Questions

Energy-Based Models for Code Generation under Compilability Constraints



Tomasz Korbak , Hady Elsahar , Marc Dymetman , Germán Kruszewski

* Accepted for the First Workshop on Natural Language Processing for Programming, ACL 2021 

   Access Paper or Ask Questions

References in Wikipedia: The Editors' Perspective



Lucie-Aimée Kaffee , Hady Elsahar


   Access Paper or Ask Questions

A Distributional Approach to Controlled Text Generation



Muhammad Khalifa , Hady Elsahar , Marc Dymetman

* Under review at ICLR 2021 

   Access Paper or Ask Questions

Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages



Wilhelmina Nekoto , Vukosi Marivate , Tshinondiwa Matsila , Timi Fasubaa , Tajudeen Kolawole , Taiwo Fagbohungbe , Solomon Oluwole Akinola , Shamsuddee Hassan Muhammad , Salomon Kabongo , Salomey Osei , Sackey Freshia , Rubungo Andre Niyongabo , Ricky Macharm , Perez Ogayo , Orevaoghene Ahia , Musie Meressa , Mofe Adeyemi , Masabata Mokgesi-Selinga , Lawrence Okegbemi , Laura Jane Martinus , Kolawole Tajudeen , Kevin Degila , Kelechi Ogueji , Kathleen Siminyu , Julia Kreutzer , Jason Webster , Jamiil Toure Ali , Jade Abbott , Iroro Orife , Ignatius Ezeani , Idris Abdulkabir Dangana , Herman Kamper , Hady Elsahar , Goodness Duru , Ghollah Kioko , Espoir Murhabazi , Elan van Biljon , Daniel Whitenack , Christopher Onyefuluchi , Chris Emezue , Bonaventure Dossou , Blessing Sibanda , Blessing Itoro Bassey , Ayodele Olabiyi , Arshath Ramkilowan , Alp Ă–ktem , Adewale Akinfaderin , Abdallah Bashir

* Findings of EMNLP 2020 

   Access Paper or Ask Questions

1
2
>>