Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Alexis Conneau

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale


Nov 19, 2021
Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli


  Access Paper or Ask Questions

SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training


Oct 20, 2021
Ankur Bapna, Yu-an Chung, Nan Wu, Anmol Gulati, Ye Jia, Jonathan H. Clark, Melvin Johnson, Jason Riesa, Alexis Conneau, Yu Zhang


  Access Paper or Ask Questions

Improved Language Identification Through Cross-Lingual Self-Supervised Learning


Aug 04, 2021
Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang, Kritika Singh, Alexis Conneau, Alexei Baevski, Assaf Sela, Yatharth Saraf, Michael Auli

* Submitted to ASRU 2021 

  Access Paper or Ask Questions

Unsupervised Speech Recognition


May 24, 2021
Alexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael Auli


  Access Paper or Ask Questions

Larger-Scale Transformers for Multilingual Masked Language Modeling


May 02, 2021
Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau

* 4 pages 

  Access Paper or Ask Questions

Large-Scale Self- and Semi-Supervised Learning for Speech Translation


Apr 14, 2021
Changhan Wang, Anne Wu, Juan Pino, Alexei Baevski, Michael Auli, Alexis Conneau


  Access Paper or Ask Questions

Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning


Nov 12, 2020
Beliz Gunel, Jingfei Du, Alexis Conneau, Ves Stoyanov


  Access Paper or Ask Questions

Self-training and Pre-training are Complementary for Speech Recognition


Oct 22, 2020
Qiantong Xu, Alexei Baevski, Tatiana Likhomanenko, Paden Tomasello, Alexis Conneau, Ronan Collobert, Gabriel Synnaeve, Michael Auli


  Access Paper or Ask Questions

Self-training Improves Pre-training for Natural Language Understanding


Oct 05, 2020
Jingfei Du, Edouard Grave, Beliz Gunel, Vishrav Chaudhary, Onur Celebi, Michael Auli, Ves Stoyanov, Alexis Conneau

* 8 pages 

  Access Paper or Ask Questions

Unsupervised Cross-lingual Representation Learning for Speech Recognition


Jun 24, 2020
Alexis Conneau, Alexei Baevski, Ronan Collobert, Abdelrahman Mohamed, Michael Auli


  Access Paper or Ask Questions

CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data


Nov 15, 2019
Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, Vishrav Chaudhary, Francisco Guzmán, Armand Joulin, Edouard Grave


  Access Paper or Ask Questions

Emerging Cross-lingual Structure in Pretrained Language Models


Nov 10, 2019
Shijie Wu, Alexis Conneau, Haoran Li, Luke Zettlemoyer, Veselin Stoyanov

* 10 pages, 7 figures, add contextual word-level alignment of monolingual BERT (v1 -> v2) 

  Access Paper or Ask Questions

Unsupervised Cross-lingual Representation Learning at Scale


Nov 05, 2019
Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov

* 12 pages, 7 figures 

  Access Paper or Ask Questions

Cross-lingual Language Model Pretraining


Jan 22, 2019
Guillaume Lample, Alexis Conneau


  Access Paper or Ask Questions

XNLI: Evaluating Cross-lingual Sentence Representations


Sep 13, 2018
Alexis Conneau, Guillaume Lample, Ruty Rinott, Adina Williams, Samuel R. Bowman, Holger Schwenk, Veselin Stoyanov

* EMNLP 2018 

  Access Paper or Ask Questions

Phrase-Based & Neural Unsupervised Machine Translation


Aug 13, 2018
Guillaume Lample, Myle Ott, Alexis Conneau, Ludovic Denoyer, Marc'Aurelio Ranzato

* EMNLP 2018 

  Access Paper or Ask Questions

What you can cram into a single vector: Probing sentence embeddings for linguistic properties


Jul 08, 2018
Alexis Conneau, German Kruszewski, Guillaume Lample, Loïc Barrault, Marco Baroni

* ACL 2018 

  Access Paper or Ask Questions

Supervised Learning of Universal Sentence Representations from Natural Language Inference Data


Jul 08, 2018
Alexis Conneau, Douwe Kiela, Holger Schwenk, Loic Barrault, Antoine Bordes

* EMNLP 2017 

  Access Paper or Ask Questions

Learning Visually Grounded Sentence Representations


Jun 04, 2018
Douwe Kiela, Alexis Conneau, Allan Jabri, Maximilian Nickel

* Published at NAACL-18 

  Access Paper or Ask Questions

Unsupervised Machine Translation Using Monolingual Corpora Only


Apr 13, 2018
Guillaume Lample, Alexis Conneau, Ludovic Denoyer, Marc'Aurelio Ranzato

* ICLR 2018 

  Access Paper or Ask Questions

SentEval: An Evaluation Toolkit for Universal Sentence Representations


Mar 14, 2018
Alexis Conneau, Douwe Kiela

* LREC 2018 

  Access Paper or Ask Questions

Word Translation Without Parallel Data


Jan 30, 2018
Alexis Conneau, Guillaume Lample, Marc'Aurelio Ranzato, Ludovic Denoyer, Hervé Jégou

* ICLR 2018 

  Access Paper or Ask Questions

Very Deep Convolutional Networks for Text Classification


Jan 27, 2017
Alexis Conneau, Holger Schwenk, Loïc Barrault, Yann Lecun

* 10 pages, EACL 2017, camera-ready 

  Access Paper or Ask Questions

Meta-Prod2Vec - Product Embeddings Using Side-Information for Recommendation


Jul 25, 2016
Flavian Vasile, Elena Smirnova, Alexis Conneau


  Access Paper or Ask Questions