Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Abdelrahman Mohamed

Text-Free Prosody-Aware Generative Spoken Language Modeling


Sep 07, 2021
Eugene Kharitonov, Ann Lee, Adam Polyak, Yossi Adi, Jade Copet, Kushal Lakhotia, Tu-Anh Nguyen, Morgane Rivière, Abdelrahman Mohamed, Emmanuel Dupoux, Wei-Ning Hsu


  Access Paper or Ask Questions

Kaizen: Continuously improving teacher using Exponential Moving Average for semi-supervised speech recognition


Jun 14, 2021
Vimal Manohar, Tatiana Likhomanenko, Qiantong Xu, Wei-Ning Hsu, Ronan Collobert, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed

* 4 figures, 7 pages; fixed author list going out of margin 

  Access Paper or Ask Questions

HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units


Jun 14, 2021
Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed


  Access Paper or Ask Questions

SUPERB: Speech processing Universal PERformance Benchmark


May 03, 2021
Shu-wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-Wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee

* Submitted to Interspeech 2021 

  Access Paper or Ask Questions

Speech Resynthesis from Discrete Disentangled Self-Supervised Representations


Apr 02, 2021
Adam Polyak, Yossi Adi, Jade Copet, Eugene Kharitonov, Kushal Lakhotia, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux


  Access Paper or Ask Questions

Contrastive Semi-supervised Learning for ASR


Mar 09, 2021
Alex Xiao, Christian Fuegen, Abdelrahman Mohamed


  Access Paper or Ask Questions

Unsupervised Cross-lingual Representation Learning for Speech Recognition


Jun 24, 2020
Alexis Conneau, Alexei Baevski, Ronan Collobert, Abdelrahman Mohamed, Michael Auli


  Access Paper or Ask Questions

wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations


Jun 20, 2020
Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, Michael Auli


  Access Paper or Ask Questions

Large scale weakly and semi-supervised learning for low-resource video ASR


May 16, 2020
Kritika Singh, Vimal Manohar, Alex Xiao, Sergey Edunov, Ross Girshick, Vitaliy Liptchinsky, Christian Fuegen, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed


  Access Paper or Ask Questions

Libri-Light: A Benchmark for ASR with Limited or No Supervision


Dec 17, 2019
Jacob Kahn, Morgane Rivière, Weiyi Zheng, Evgeny Kharitonov, Qiantong Xu, Pierre-Emmanuel Mazaré, Julien Karadayi, Vitaliy Liptchinsky, Ronan Collobert, Christian Fuegen, Tatiana Likhomanenko, Gabriel Synnaeve, Armand Joulin, Abdelrahman Mohamed, Emmanuel Dupoux


  Access Paper or Ask Questions

Effectiveness of self-supervised pre-training for speech recognition


Nov 10, 2019
Alexei Baevski, Michael Auli, Abdelrahman Mohamed


  Access Paper or Ask Questions

Enforcing Encoder-Decoder Modularity in Sequence-to-Sequence Models


Nov 09, 2019
Siddharth Dalmia, Abdelrahman Mohamed, Mike Lewis, Florian Metze, Luke Zettlemoyer


  Access Paper or Ask Questions

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension


Oct 29, 2019
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, Luke Zettlemoyer


  Access Paper or Ask Questions

Training ASR models by Generation of Contextual Information


Oct 27, 2019
Kritika Singh, Dmytro Okhonko, Jun Liu, Yongqiang Wang, Frank Zhang, Ross Girshick, Sergey Edunov, Fuchun Peng, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed


  Access Paper or Ask Questions

Transformer-based Acoustic Modeling for Hybrid Speech Recognition


Oct 22, 2019
Yongqiang Wang, Abdelrahman Mohamed, Duc Le, Chunxi Liu, Alex Xiao, Jay Mahadeokar, Hongzhao Huang, Andros Tjandra, Xiaohui Zhang, Frank Zhang, Christian Fuegen, Geoffrey Zweig, Michael L. Seltzer


  Access Paper or Ask Questions

Transformers with convolutional context for ASR


Apr 26, 2019
Abdelrahman Mohamed, Dmytro Okhonko, Luke Zettlemoyer


  Access Paper or Ask Questions

Sequence Modeling via Segmentations


Jul 18, 2018
Chong Wang, Yining Wang, Po-Sen Huang, Abdelrahman Mohamed, Dengyong Zhou, Li Deng

* recurrent neural networks, dynamic programming, structured prediction 

  Access Paper or Ask Questions

Do Deep Convolutional Nets Really Need to be Deep and Convolutional?


Mar 04, 2017
Gregor Urban, Krzysztof J. Geras, Samira Ebrahimi Kahou, Ozlem Aslan, Shengjie Wang, Rich Caruana, Abdelrahman Mohamed, Matthai Philipose, Matt Richardson


  Access Paper or Ask Questions