Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Shinji Watanabe

Shinji Watanabe

On Prosody Modeling for ASR+TTS based Voice Conversion


Jul 20, 2021
Wen-Chin Huang, Tomoki Hayashi, Xinjian Li, Shinji Watanabe, Tomoki Toda

Figure 1 for On Prosody Modeling for ASR+TTS based Voice Conversion
Figure 2 for On Prosody Modeling for ASR+TTS based Voice Conversion
Figure 3 for On Prosody Modeling for ASR+TTS based Voice Conversion
Figure 4 for On Prosody Modeling for ASR+TTS based Voice Conversion
* Submitted to ASRU2021. Under review 
  Access Paper or Ask Questions

Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models


Jul 20, 2021
Tianzi Wang, Yuya Fujita, Xuankai Chang, Shinji Watanabe

Figure 1 for Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models
Figure 2 for Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models
Figure 3 for Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models
Figure 4 for Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models
* 5 pages, 1 figures, Interspeech21 conference 
  Access Paper or Ask Questions

Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021


Jul 13, 2021
Takashi Maekaku, Xuankai Chang, Yuya Fujita, Li-Wei Chen, Shinji Watanabe, Alexander Rudnicky

Figure 1 for Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021
Figure 2 for Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021
Figure 3 for Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021
Figure 4 for Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021

  Access Paper or Ask Questions

ESPnet-ST IWSLT 2021 Offline Speech Translation System


Jul 06, 2021
Hirofumi Inaguma, Brian Yan, Siddharth Dalmia, Pengcheng Guo, Jiatong Shi, Kevin Duh, Shinji Watanabe

Figure 1 for ESPnet-ST IWSLT 2021 Offline Speech Translation System
Figure 2 for ESPnet-ST IWSLT 2021 Offline Speech Translation System
Figure 3 for ESPnet-ST IWSLT 2021 Offline Speech Translation System
Figure 4 for ESPnet-ST IWSLT 2021 Offline Speech Translation System
* IWSLT 2021 
  Access Paper or Ask Questions

Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractors


Jul 04, 2021
Shota Horiguchi, Shinji Watanabe, Paola Garcia, Yawen Xue, Yuki Takashima, Yohei Kawaguchi

Figure 1 for Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractors
Figure 2 for Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractors
Figure 3 for Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractors
Figure 4 for Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractors

  Access Paper or Ask Questions

Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding


Jun 29, 2021
Siddhant Arora, Alissa Ostapenko, Vijay Viswanathan, Siddharth Dalmia, Florian Metze, Shinji Watanabe, Alan W Black

Figure 1 for Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding
Figure 2 for Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding
Figure 3 for Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding
Figure 4 for Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding
* INTERSPEECH 2021 
  Access Paper or Ask Questions

Encoder-Decoder Based Attractor Calculation for End-to-End Neural Diarization


Jun 20, 2021
Shota Horiguchi, Yusuke Fujita, Shinji Watanabe, Yawen Xue, Paola Garcia

Figure 1 for Encoder-Decoder Based Attractor Calculation for End-to-End Neural Diarization
Figure 2 for Encoder-Decoder Based Attractor Calculation for End-to-End Neural Diarization
Figure 3 for Encoder-Decoder Based Attractor Calculation for End-to-End Neural Diarization
Figure 4 for Encoder-Decoder Based Attractor Calculation for End-to-End Neural Diarization
* Submitted to IEEE TASLP. This article is based on our previous conference paper arxiv:2005.09921 
  Access Paper or Ask Questions

Multi-mode Transformer Transducer with Stochastic Future Context


Jun 17, 2021
Kwangyoun Kim, Felix Wu, Prashant Sridhar, Kyu J. Han, Shinji Watanabe

Figure 1 for Multi-mode Transformer Transducer with Stochastic Future Context
Figure 2 for Multi-mode Transformer Transducer with Stochastic Future Context
Figure 3 for Multi-mode Transformer Transducer with Stochastic Future Context
* Accepted to Interspeech 2021 
  Access Paper or Ask Questions

Layer Pruning on Demand with Intermediate CTC


Jun 17, 2021
Jaesong Lee, Jingu Kang, Shinji Watanabe

Figure 1 for Layer Pruning on Demand with Intermediate CTC
Figure 2 for Layer Pruning on Demand with Intermediate CTC
Figure 3 for Layer Pruning on Demand with Intermediate CTC
Figure 4 for Layer Pruning on Demand with Intermediate CTC
* Interspeech 2021 
  Access Paper or Ask Questions

Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain


Jun 16, 2021
Pengcheng Guo, Xuankai Chang, Shinji Watanabe, Lei Xie

Figure 1 for Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain
Figure 2 for Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain
Figure 3 for Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain
Figure 4 for Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain
* Accepted by Interspeech 2021 
  Access Paper or Ask Questions

GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio


Jun 13, 2021
Guoguo Chen, Shuzhou Chai, Guanbo Wang, Jiayu Du, Wei-Qiang Zhang, Chao Weng, Dan Su, Daniel Povey, Jan Trmal, Junbo Zhang, Mingjie Jin, Sanjeev Khudanpur, Shinji Watanabe, Shuaijiang Zhao, Wei Zou, Xiangang Li, Xuchen Yao, Yongqing Wang, Yujun Wang, Zhao You, Zhiyong Yan

Figure 1 for GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio
Figure 2 for GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio
Figure 3 for GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio
Figure 4 for GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio

  Access Paper or Ask Questions

Leveraging Pre-trained Language Model for Speech Sentiment Analysis


Jun 11, 2021
Suwon Shon, Pablo Brusco, Jing Pan, Kyu J. Han, Shinji Watanabe

Figure 1 for Leveraging Pre-trained Language Model for Speech Sentiment Analysis
Figure 2 for Leveraging Pre-trained Language Model for Speech Sentiment Analysis
Figure 3 for Leveraging Pre-trained Language Model for Speech Sentiment Analysis
Figure 4 for Leveraging Pre-trained Language Model for Speech Sentiment Analysis
* To appear in Interspeech 2021 
  Access Paper or Ask Questions

Semi-Supervised Training with Pseudo-Labeling for End-to-End Neural Diarization


Jun 09, 2021
Yuki Takashima, Yusuke Fujita, Shota Horiguchi, Shinji Watanabe, Paola GarcΓ­a, Kenji Nagamatsu

Figure 1 for Semi-Supervised Training with Pseudo-Labeling for End-to-End Neural Diarization
Figure 2 for Semi-Supervised Training with Pseudo-Labeling for End-to-End Neural Diarization
Figure 3 for Semi-Supervised Training with Pseudo-Labeling for End-to-End Neural Diarization
Figure 4 for Semi-Supervised Training with Pseudo-Labeling for End-to-End Neural Diarization
* Accepted for Interspeech 2021 
  Access Paper or Ask Questions

End-to-End Speaker Diarization Conditioned on Speech Activity and Overlap Detection


Jun 08, 2021
Yuki Takashima, Yusuke Fujita, Shinji Watanabe, Shota Horiguchi, Paola GarcΓ­a, Kenji Nagamatsu

Figure 1 for End-to-End Speaker Diarization Conditioned on Speech Activity and Overlap Detection
Figure 2 for End-to-End Speaker Diarization Conditioned on Speech Activity and Overlap Detection
Figure 3 for End-to-End Speaker Diarization Conditioned on Speech Activity and Overlap Detection
Figure 4 for End-to-End Speaker Diarization Conditioned on Speech Activity and Overlap Detection
* IEEE Spoken Language Technology Workshop (SLT), 2021, pp. 849-856 
 * Accepted for SLT 2021 
  Access Paper or Ask Questions

Data Augmentation Methods for End-to-end Speech Recognition on Distant-Talk Scenarios


Jun 07, 2021
Emiru Tsunoo, Kentaro Shibata, Chaitanya Narisetty, Yosuke Kashiwagi, Shinji Watanabe

Figure 1 for Data Augmentation Methods for End-to-end Speech Recognition on Distant-Talk Scenarios
Figure 2 for Data Augmentation Methods for End-to-end Speech Recognition on Distant-Talk Scenarios
Figure 3 for Data Augmentation Methods for End-to-end Speech Recognition on Distant-Talk Scenarios
Figure 4 for Data Augmentation Methods for End-to-end Speech Recognition on Distant-Talk Scenarios
* Accepted for Interspeech2021 
  Access Paper or Ask Questions

Self-Guided Curriculum Learning for Neural Machine Translation


May 15, 2021
Lei Zhou, Liang Ding, Kevin Duh, Shinji Watanabe, Ryohei Sasano, Koichi Takeda

Figure 1 for Self-Guided Curriculum Learning for Neural Machine Translation
Figure 2 for Self-Guided Curriculum Learning for Neural Machine Translation
Figure 3 for Self-Guided Curriculum Learning for Neural Machine Translation
Figure 4 for Self-Guided Curriculum Learning for Neural Machine Translation
* Work in progress 
  Access Paper or Ask Questions

End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings


May 05, 2021
Soumi Maiti, Hakan Erdogan, Kevin Wilson, Scott Wisdom, Shinji Watanabe, John R. Hershey

Figure 1 for End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings
Figure 2 for End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings
Figure 3 for End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings
Figure 4 for End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings
* ICASSP 2021, SPE-54.1 
 * 5 pages, 2 figures, ICASSP 2021 
  Access Paper or Ask Questions

SUPERB: Speech processing Universal PERformance Benchmark


May 03, 2021
Shu-wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-Wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee

Figure 1 for SUPERB: Speech processing Universal PERformance Benchmark
Figure 2 for SUPERB: Speech processing Universal PERformance Benchmark
* Submitted to Interspeech 2021 
  Access Paper or Ask Questions

Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks


May 02, 2021
Siddharth Dalmia, Brian Yan, Vikas Raunak, Florian Metze, Shinji Watanabe

Figure 1 for Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks
Figure 2 for Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks
Figure 3 for Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks
Figure 4 for Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks
* NAACL 2021. All code and models are released as part of the ESPnet toolkit: https://github.com/espnet/espnet 
  Access Paper or Ask Questions

EAT: Enhanced ASR-TTS for Self-supervised Speech Recognition


Apr 13, 2021
Murali Karthick Baskar, LukÑő Burget, Shinji Watanabe, Ramon Fernandez Astudillo, Jan "Honza'' Černocký

Figure 1 for EAT: Enhanced ASR-TTS for Self-supervised Speech Recognition
Figure 2 for EAT: Enhanced ASR-TTS for Self-supervised Speech Recognition
Figure 3 for EAT: Enhanced ASR-TTS for Self-supervised Speech Recognition
Figure 4 for EAT: Enhanced ASR-TTS for Self-supervised Speech Recognition

  Access Paper or Ask Questions

Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation


Apr 13, 2021
Hirofumi Inaguma, Tatsuya Kawahara, Shinji Watanabe

Figure 1 for Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation
Figure 2 for Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation
Figure 3 for Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation
Figure 4 for Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation
* Accepted at NAACL-HLT 2021 (short paper) 
  Access Paper or Ask Questions

SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognition


Apr 06, 2021
Patrick K. O'Neill, Vitaly Lavrukhin, Somshubra Majumdar, Vahid Noroozi, Yuekai Zhang, Oleksii Kuchaiev, Jagadeesh Balam, Yuliya Dovzhenko, Keenan Freyberg, Michael D. Shulman, Boris Ginsburg, Shinji Watanabe, Georg Kucsko

Figure 1 for SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognition
Figure 2 for SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognition
Figure 3 for SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognition
Figure 4 for SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognition
* 5 pages, 1 figure. Submitted to INTERSPEECH 2021 
  Access Paper or Ask Questions

INTERSPEECH 2021 ConferencingSpeech Challenge: Towards Far-field Multi-Channel Speech Enhancement for Video Conferencing


Apr 02, 2021
Wei Rao, Yihui Fu, Yanxin Hu, Xin Xu, Yvkai Jv, Jiangyu Han, Zhongjie Jiang, Lei Xie, Yannan Wang, Shinji Watanabe, Zheng-Hua Tan, Hui Bu, Tao Yu, Shidong Shang

Figure 1 for INTERSPEECH 2021 ConferencingSpeech Challenge: Towards Far-field Multi-Channel Speech Enhancement for Video Conferencing
Figure 2 for INTERSPEECH 2021 ConferencingSpeech Challenge: Towards Far-field Multi-Channel Speech Enhancement for Video Conferencing
Figure 3 for INTERSPEECH 2021 ConferencingSpeech Challenge: Towards Far-field Multi-Channel Speech Enhancement for Video Conferencing
* 5 pages, submitted to INTERSPEECH 2021 
  Access Paper or Ask Questions

Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on YoloxΓ³chitl Mixtec


Feb 26, 2021
Jiatong Shi. Jonathan D. Amith, Rey Castillo GarcΓ­a, Esteban Guadalupe Sierra, Kevin Duh, Shinji Watanabe

Figure 1 for Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on YoloxΓ³chitl Mixtec
Figure 2 for Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on YoloxΓ³chitl Mixtec
Figure 3 for Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on YoloxΓ³chitl Mixtec
Figure 4 for Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on YoloxΓ³chitl Mixtec
* Accepted by EACL2021 
  Access Paper or Ask Questions

Dual-Path Modeling for Long Recording Speech Separation in Meetings


Feb 23, 2021
Chenda Li, Zhuo Chen, Yi Luo, Cong Han, Tianyan Zhou, Keisuke Kinoshita, Marc Delcroix, Shinji Watanabe, Yanmin Qian

Figure 1 for Dual-Path Modeling for Long Recording Speech Separation in Meetings
Figure 2 for Dual-Path Modeling for Long Recording Speech Separation in Meetings
Figure 3 for Dual-Path Modeling for Long Recording Speech Separation in Meetings
Figure 4 for Dual-Path Modeling for Long Recording Speech Separation in Meetings
* Accepted by ICASSP 2021 
  Access Paper or Ask Questions

End-to-End Dereverberation, Beamforming, and Speech Recognition with Improved Numerical Stability and Advanced Frontend


Feb 23, 2021
Wangyou Zhang, Christoph Boeddeker, Shinji Watanabe, Tomohiro Nakatani, Marc Delcroix, Keisuke Kinoshita, Tsubasa Ochiai, Naoyuki Kamo, Reinhold Haeb-Umbach, Yanmin Qian

Figure 1 for End-to-End Dereverberation, Beamforming, and Speech Recognition with Improved Numerical Stability and Advanced Frontend
Figure 2 for End-to-End Dereverberation, Beamforming, and Speech Recognition with Improved Numerical Stability and Advanced Frontend
Figure 3 for End-to-End Dereverberation, Beamforming, and Speech Recognition with Improved Numerical Stability and Advanced Frontend
* 5 pages, 1 figure, accepted by ICASSP 2021 
  Access Paper or Ask Questions

Gaussian Kernelized Self-Attention for Long Sequence Data and Its Application to CTC-based Speech Recognition


Feb 18, 2021
Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe

Figure 1 for Gaussian Kernelized Self-Attention for Long Sequence Data and Its Application to CTC-based Speech Recognition
Figure 2 for Gaussian Kernelized Self-Attention for Long Sequence Data and Its Application to CTC-based Speech Recognition
Figure 3 for Gaussian Kernelized Self-Attention for Long Sequence Data and Its Application to CTC-based Speech Recognition
Figure 4 for Gaussian Kernelized Self-Attention for Long Sequence Data and Its Application to CTC-based Speech Recognition
* Accepted to ICASSP2021 
  Access Paper or Ask Questions

Deep Learning based Multi-Source Localization with Source Splitting and its Effectiveness in Multi-Talker Speech Recognition


Feb 16, 2021
Aswin Shanmugam Subramanian, Chao Weng, Shinji Watanabe, Meng Yu, Dong Yu

Figure 1 for Deep Learning based Multi-Source Localization with Source Splitting and its Effectiveness in Multi-Talker Speech Recognition
Figure 2 for Deep Learning based Multi-Source Localization with Source Splitting and its Effectiveness in Multi-Talker Speech Recognition
Figure 3 for Deep Learning based Multi-Source Localization with Source Splitting and its Effectiveness in Multi-Talker Speech Recognition
Figure 4 for Deep Learning based Multi-Source Localization with Source Splitting and its Effectiveness in Multi-Talker Speech Recognition
* Submitted to Computer Speech & Language 
  Access Paper or Ask Questions

Intermediate Loss Regularization for CTC-based Speech Recognition


Feb 05, 2021
Jaesong Lee, Shinji Watanabe

Figure 1 for Intermediate Loss Regularization for CTC-based Speech Recognition
Figure 2 for Intermediate Loss Regularization for CTC-based Speech Recognition
Figure 3 for Intermediate Loss Regularization for CTC-based Speech Recognition
Figure 4 for Intermediate Loss Regularization for CTC-based Speech Recognition
* Accepted at ICASSP 2021 
  Access Paper or Ask Questions

The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lap


Feb 02, 2021
Shota Horiguchi, Nelson Yalta, Paola Garcia, Yuki Takashima, Yawen Xue, Desh Raj, Zili Huang, Yusuke Fujita, Shinji Watanabe, Sanjeev Khudanpur

Figure 1 for The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lap
Figure 2 for The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lap
Figure 3 for The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lap
Figure 4 for The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lap

  Access Paper or Ask Questions