Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Alexei Baevski

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale

Nov 19, 2021
Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli

  Access Paper or Ask Questions

Simple and Effective Zero-shot Cross-lingual Phoneme Recognition

Sep 23, 2021
Qiantong Xu, Alexei Baevski, Michael Auli

  Access Paper or Ask Questions

Improved Language Identification Through Cross-Lingual Self-Supervised Learning

Aug 04, 2021
Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang, Kritika Singh, Alexis Conneau, Alexei Baevski, Assaf Sela, Yatharth Saraf, Michael Auli

* Submitted to ASRU 2021 

  Access Paper or Ask Questions

Unsupervised Speech Recognition

May 24, 2021
Alexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael Auli

  Access Paper or Ask Questions

Large-Scale Self- and Semi-Supervised Learning for Speech Translation

Apr 14, 2021
Changhan Wang, Anne Wu, Juan Pino, Alexei Baevski, Michael Auli, Alexis Conneau

  Access Paper or Ask Questions

Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training

Apr 02, 2021
Wei-Ning Hsu, Anuroop Sriram, Alexei Baevski, Tatiana Likhomanenko, Qiantong Xu, Vineel Pratap, Jacob Kahn, Ann Lee, Ronan Collobert, Gabriel Synnaeve, Michael Auli

  Access Paper or Ask Questions

Generative Spoken Language Modeling from Raw Audio

Feb 01, 2021
Kushal Lakhotia, Evgeny Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu-Anh Nguyen, Jade Copet, Alexei Baevski, Adelrahman Mohamed, Emmanuel Dupoux

  Access Paper or Ask Questions

Reservoir Transformer

Dec 30, 2020
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela

  Access Paper or Ask Questions

The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling

Dec 01, 2020
Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Evgeny Kharitonov, Alexei Baevski, Ewan Dunbar, Emmanuel Dupoux

* 14 pages, including references and supplementary material 

  Access Paper or Ask Questions

A Comparison of Discrete Latent Variable Models for Speech Representation Learning

Oct 24, 2020
Henry Zhou, Alexei Baevski, Michael Auli

* 7 pages, 4 figures 

  Access Paper or Ask Questions

Self-training and Pre-training are Complementary for Speech Recognition

Oct 22, 2020
Qiantong Xu, Alexei Baevski, Tatiana Likhomanenko, Paden Tomasello, Alexis Conneau, Ronan Collobert, Gabriel Synnaeve, Michael Auli

  Access Paper or Ask Questions

Unsupervised Cross-lingual Representation Learning for Speech Recognition

Jun 24, 2020
Alexis Conneau, Alexei Baevski, Ronan Collobert, Abdelrahman Mohamed, Michael Auli

  Access Paper or Ask Questions

wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations

Jun 20, 2020
Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, Michael Auli

  Access Paper or Ask Questions

Effectiveness of self-supervised pre-training for speech recognition

Nov 10, 2019
Alexei Baevski, Michael Auli, Abdelrahman Mohamed

  Access Paper or Ask Questions

vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations

Oct 12, 2019
Alexei Baevski, Steffen Schneider, Michael Auli

  Access Paper or Ask Questions

Facebook FAIR's WMT19 News Translation Task Submission

Jul 15, 2019
Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, Sergey Edunov

* 7 pages; WMT 

  Access Paper or Ask Questions

wav2vec: Unsupervised Pre-training for Speech Recognition

May 24, 2019
Steffen Schneider, Alexei Baevski, Ronan Collobert, Michael Auli

  Access Paper or Ask Questions

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

Apr 01, 2019
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli

* NAACL 2019 Demo paper 

  Access Paper or Ask Questions

Pre-trained Language Model Representations for Language Generation

Apr 01, 2019
Sergey Edunov, Alexei Baevski, Michael Auli

* NAACL 2019 

  Access Paper or Ask Questions

Cloze-driven Pretraining of Self-attention Networks

Mar 19, 2019
Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli

  Access Paper or Ask Questions

Pay Less Attention with Lightweight and Dynamic Convolutions

Jan 29, 2019
Felix Wu, Angela Fan, Alexei Baevski, Yann N. Dauphin, Michael Auli

* 14 pages, ICLR oral 

  Access Paper or Ask Questions

Adaptive Input Representations for Neural Language Modeling

Oct 01, 2018
Alexei Baevski, Michael Auli

* 12 pages 

  Access Paper or Ask Questions