Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Jonathan Le Roux

Jonathan Le Roux

Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers


Apr 19, 2021
Takaaki Hori, Niko Moritz, Chiori Hori, Jonathan Le Roux

Figure 1 for Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers
Figure 2 for Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers
Figure 3 for Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers
* Submitted to INTERSPEECH 2021 
  Access Paper or Ask Questions

Capturing Multi-Resolution Context by Dilated Self-Attention


Apr 07, 2021
Niko Moritz, Takaaki Hori, Jonathan Le Roux

Figure 1 for Capturing Multi-Resolution Context by Dilated Self-Attention
Figure 2 for Capturing Multi-Resolution Context by Dilated Self-Attention
Figure 3 for Capturing Multi-Resolution Context by Dilated Self-Attention
* In Proc. ICASSP 2021 
  Access Paper or Ask Questions

Unsupervised Domain Adaptation for Speech Recognition via Uncertainty Driven Self-Training


Nov 26, 2020
Sameer Khurana, Niko Moritz, Takaaki Hori, Jonathan Le Roux

Figure 1 for Unsupervised Domain Adaptation for Speech Recognition via Uncertainty Driven Self-Training
Figure 2 for Unsupervised Domain Adaptation for Speech Recognition via Uncertainty Driven Self-Training
Figure 3 for Unsupervised Domain Adaptation for Speech Recognition via Uncertainty Driven Self-Training
Figure 4 for Unsupervised Domain Adaptation for Speech Recognition via Uncertainty Driven Self-Training
* Submitted to ICASSP 2021 
  Access Paper or Ask Questions

Semi-Supervised Speech Recognition via Graph-based Temporal Classification


Oct 29, 2020
Niko Moritz, Takaaki Hori, Jonathan Le Roux

Figure 1 for Semi-Supervised Speech Recognition via Graph-based Temporal Classification
Figure 2 for Semi-Supervised Speech Recognition via Graph-based Temporal Classification
Figure 3 for Semi-Supervised Speech Recognition via Graph-based Temporal Classification
Figure 4 for Semi-Supervised Speech Recognition via Graph-based Temporal Classification
* Submitted to ICASSP 2021 
  Access Paper or Ask Questions

Transcription Is All You Need: Learning to Separate Musical Mixtures with Score as Supervision


Oct 22, 2020
Yun-Ning Hung, Gordon Wichern, Jonathan Le Roux

Figure 1 for Transcription Is All You Need: Learning to Separate Musical Mixtures with Score as Supervision
Figure 2 for Transcription Is All You Need: Learning to Separate Musical Mixtures with Score as Supervision
Figure 3 for Transcription Is All You Need: Learning to Separate Musical Mixtures with Score as Supervision
Figure 4 for Transcription Is All You Need: Learning to Separate Musical Mixtures with Score as Supervision

  Access Paper or Ask Questions

Multi-Pass Transformer for Machine Translation


Sep 23, 2020
Peng Gao, Chiori Hori, Shijie Geng, Takaaki Hori, Jonathan Le Roux

Figure 1 for Multi-Pass Transformer for Machine Translation
Figure 2 for Multi-Pass Transformer for Machine Translation
Figure 3 for Multi-Pass Transformer for Machine Translation
Figure 4 for Multi-Pass Transformer for Machine Translation
* 10 pages, 5 figures and 2 tables 
  Access Paper or Ask Questions

AutoClip: Adaptive Gradient Clipping for Source Separation Networks


Jul 25, 2020
Prem Seetharaman, Gordon Wichern, Bryan Pardo, Jonathan Le Roux

Figure 1 for AutoClip: Adaptive Gradient Clipping for Source Separation Networks
Figure 2 for AutoClip: Adaptive Gradient Clipping for Source Separation Networks
* Accepted at 2020 IEEE International Workshop on Machine Learning for Signal Processing, Sept.\ 21--24, 2020, Espoo, Finland 
  Access Paper or Ask Questions

Spatio-Temporal Scene Graphs for Video Dialog


Jul 08, 2020
Shijie Geng, Peng Gao, Chiori Hori, Jonathan Le Roux, Anoop Cherian

Figure 1 for Spatio-Temporal Scene Graphs for Video Dialog
Figure 2 for Spatio-Temporal Scene Graphs for Video Dialog
Figure 3 for Spatio-Temporal Scene Graphs for Video Dialog
Figure 4 for Spatio-Temporal Scene Graphs for Video Dialog

  Access Paper or Ask Questions

Detecting Audio Attacks on ASR Systems with Dropout Uncertainty


Jun 02, 2020
Tejas Jayashankar, Jonathan Le Roux, Pierre Moulin

Figure 1 for Detecting Audio Attacks on ASR Systems with Dropout Uncertainty
Figure 2 for Detecting Audio Attacks on ASR Systems with Dropout Uncertainty

  Access Paper or Ask Questions

Unsupervised Speaker Adaptation using Attention-based Speaker Memory for End-to-End ASR


Feb 14, 2020
Leda SarΔ±, Niko Moritz, Takaaki Hori, Jonathan Le Roux

Figure 1 for Unsupervised Speaker Adaptation using Attention-based Speaker Memory for End-to-End ASR
Figure 2 for Unsupervised Speaker Adaptation using Attention-based Speaker Memory for End-to-End ASR
Figure 3 for Unsupervised Speaker Adaptation using Attention-based Speaker Memory for End-to-End ASR
Figure 4 for Unsupervised Speaker Adaptation using Attention-based Speaker Memory for End-to-End ASR
* To appear in Proc. ICASSP 2020 
  Access Paper or Ask Questions

End-to-End Multi-speaker Speech Recognition with Transformer


Feb 13, 2020
Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe

Figure 1 for End-to-End Multi-speaker Speech Recognition with Transformer
Figure 2 for End-to-End Multi-speaker Speech Recognition with Transformer
Figure 3 for End-to-End Multi-speaker Speech Recognition with Transformer
Figure 4 for End-to-End Multi-speaker Speech Recognition with Transformer
* To appear in ICASSP 2020 
  Access Paper or Ask Questions

Streaming automatic speech recognition with the transformer model


Jan 09, 2020
Niko Moritz, Takaaki Hori, Jonathan Le Roux

Figure 1 for Streaming automatic speech recognition with the transformer model
Figure 2 for Streaming automatic speech recognition with the transformer model
Figure 3 for Streaming automatic speech recognition with the transformer model

  Access Paper or Ask Questions

Finding Strength in Weakness: Learning to Separate Sounds with Weak Supervision


Nov 06, 2019
Fatemeh Pishdadian, Gordon Wichern, Jonathan Le Roux

Figure 1 for Finding Strength in Weakness: Learning to Separate Sounds with Weak Supervision
Figure 2 for Finding Strength in Weakness: Learning to Separate Sounds with Weak Supervision
Figure 3 for Finding Strength in Weakness: Learning to Separate Sounds with Weak Supervision
Figure 4 for Finding Strength in Weakness: Learning to Separate Sounds with Weak Supervision

  Access Paper or Ask Questions

Bootstrapping deep music separation from primitive auditory grouping principles


Oct 23, 2019
Prem Seetharaman, Gordon Wichern, Jonathan Le Roux, Bryan Pardo

Figure 1 for Bootstrapping deep music separation from primitive auditory grouping principles
Figure 2 for Bootstrapping deep music separation from primitive auditory grouping principles
Figure 3 for Bootstrapping deep music separation from primitive auditory grouping principles
Figure 4 for Bootstrapping deep music separation from primitive auditory grouping principles

  Access Paper or Ask Questions

MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition


Oct 16, 2019
Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe

Figure 1 for MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition
Figure 2 for MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition
Figure 3 for MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition
Figure 4 for MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition
* Accepted at ASRU 2019 
  Access Paper or Ask Questions

Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity


Sep 18, 2019
Ethan Manilow, Gordon Wichern, Prem Seetharaman, Jonathan Le Roux

Figure 1 for Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity
Figure 2 for Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity
Figure 3 for Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity
Figure 4 for Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity
* Accepted for publication at WASPAA 2019 
  Access Paper or Ask Questions

WHAM!: Extending Speech Separation to Noisy Environments


Jul 02, 2019
Gordon Wichern, Joe Antognini, Michael Flynn, Licheng Richard Zhu, Emmett McQuinn, Dwight Crow, Ethan Manilow, Jonathan Le Roux

Figure 1 for WHAM!: Extending Speech Separation to Noisy Environments
Figure 2 for WHAM!: Extending Speech Separation to Noisy Environments
Figure 3 for WHAM!: Extending Speech Separation to Noisy Environments
Figure 4 for WHAM!: Extending Speech Separation to Noisy Environments
* Accepted for publication at Interspeech 2019 
  Access Paper or Ask Questions

Universal Sound Separation


May 08, 2019
Ilya Kavalerov, Scott Wisdom, Hakan Erdogan, Brian Patton, Kevin Wilson, Jonathan Le Roux, John R. Hershey

Figure 1 for Universal Sound Separation
Figure 2 for Universal Sound Separation
Figure 3 for Universal Sound Separation
Figure 4 for Universal Sound Separation
* 5 pages, submitted to WASPAA 2019 
  Access Paper or Ask Questions

Class-conditional embeddings for music source separation


Nov 07, 2018
Prem Seetharaman, Gordon Wichern, Shrikant Venkataramani, Jonathan Le Roux

Figure 1 for Class-conditional embeddings for music source separation
Figure 2 for Class-conditional embeddings for music source separation
Figure 3 for Class-conditional embeddings for music source separation
Figure 4 for Class-conditional embeddings for music source separation
* 5 pages 
  Access Paper or Ask Questions

Bootstrapping single-channel source separation via unsupervised spatial clustering on stereo mixtures


Nov 06, 2018
Prem Seetharaman, Gordon Wichern, Jonathan Le Roux, Bryan Pardo

Figure 1 for Bootstrapping single-channel source separation via unsupervised spatial clustering on stereo mixtures
Figure 2 for Bootstrapping single-channel source separation via unsupervised spatial clustering on stereo mixtures
Figure 3 for Bootstrapping single-channel source separation via unsupervised spatial clustering on stereo mixtures
Figure 4 for Bootstrapping single-channel source separation via unsupervised spatial clustering on stereo mixtures
* 5 pages, 2 figures 
  Access Paper or Ask Questions

Cycle-consistency training for end-to-end speech recognition


Nov 02, 2018
Takaaki Hori, Ramon Astudillo, Tomoki Hayashi, Yu Zhang, Shinji Watanabe, Jonathan Le Roux

Figure 1 for Cycle-consistency training for end-to-end speech recognition
Figure 2 for Cycle-consistency training for end-to-end speech recognition
Figure 3 for Cycle-consistency training for end-to-end speech recognition
Figure 4 for Cycle-consistency training for end-to-end speech recognition
* Submitted to ICASSP'19 
  Access Paper or Ask Questions

Phasebook and Friends: Leveraging Discrete Representations for Source Separation


Oct 02, 2018
Jonathan Le Roux, Gordon Wichern, Shinji Watanabe, Andy Sarroff, John R. Hershey

Figure 1 for Phasebook and Friends: Leveraging Discrete Representations for Source Separation
Figure 2 for Phasebook and Friends: Leveraging Discrete Representations for Source Separation
Figure 3 for Phasebook and Friends: Leveraging Discrete Representations for Source Separation
Figure 4 for Phasebook and Friends: Leveraging Discrete Representations for Source Separation

  Access Paper or Ask Questions

A Purely End-to-end System for Multi-speaker Speech Recognition


May 15, 2018
Hiroshi Seki, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux, John R. Hershey

Figure 1 for A Purely End-to-end System for Multi-speaker Speech Recognition
Figure 2 for A Purely End-to-end System for Multi-speaker Speech Recognition
Figure 3 for A Purely End-to-end System for Multi-speaker Speech Recognition
Figure 4 for A Purely End-to-end System for Multi-speaker Speech Recognition
* ACL 2018 
  Access Paper or Ask Questions

End-to-End Speech Separation with Unfolded Iterative Phase Reconstruction


Apr 26, 2018
Zhong-Qiu Wang, Jonathan Le Roux, DeLiang Wang, John R. Hershey

Figure 1 for End-to-End Speech Separation with Unfolded Iterative Phase Reconstruction
Figure 2 for End-to-End Speech Separation with Unfolded Iterative Phase Reconstruction
Figure 3 for End-to-End Speech Separation with Unfolded Iterative Phase Reconstruction
* Submitted to Interspeech 2018 
  Access Paper or Ask Questions

Deep Clustering and Conventional Networks for Music Separation: Stronger Together


Jun 15, 2017
Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Nima Mesgarani

Figure 1 for Deep Clustering and Conventional Networks for Music Separation: Stronger Together
Figure 2 for Deep Clustering and Conventional Networks for Music Separation: Stronger Together
Figure 3 for Deep Clustering and Conventional Networks for Music Separation: Stronger Together
* Published in ICASSP 2017 
  Access Paper or Ask Questions

Full-Capacity Unitary Recurrent Neural Networks


Oct 31, 2016
Scott Wisdom, Thomas Powers, John R. Hershey, Jonathan Le Roux, Les Atlas

* 9 pages, to appear in NIPS 
  Access Paper or Ask Questions

Single-Channel Multi-Speaker Separation using Deep Clustering


Jul 07, 2016
Yusuf Isik, Jonathan Le Roux, Zhuo Chen, Shinji Watanabe, John R. Hershey

Figure 1 for Single-Channel Multi-Speaker Separation using Deep Clustering
Figure 2 for Single-Channel Multi-Speaker Separation using Deep Clustering
Figure 3 for Single-Channel Multi-Speaker Separation using Deep Clustering
Figure 4 for Single-Channel Multi-Speaker Separation using Deep Clustering

  Access Paper or Ask Questions

Deep clustering: Discriminative embeddings for segmentation and separation


Aug 18, 2015
John R. Hershey, Zhuo Chen, Jonathan Le Roux, Shinji Watanabe

Figure 1 for Deep clustering: Discriminative embeddings for segmentation and separation
Figure 2 for Deep clustering: Discriminative embeddings for segmentation and separation
Figure 3 for Deep clustering: Discriminative embeddings for segmentation and separation
* Originally submitted on June 5, 2015 
  Access Paper or Ask Questions

Deep Unfolding: Model-Based Inspiration of Novel Deep Architectures


Nov 20, 2014
John R. Hershey, Jonathan Le Roux, Felix Weninger

Figure 1 for Deep Unfolding: Model-Based Inspiration of Novel Deep Architectures
Figure 2 for Deep Unfolding: Model-Based Inspiration of Novel Deep Architectures
* Added sections on reducing belief propagation to network activation functions, and on conversion between conventional network parameters and BP potentials for binary MRFs. Some bugs and typos were also fixed, and notation made a bit clearer 
  Access Paper or Ask Questions