Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Jiatong Shi

Jiatong Shi

Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesis

May 09, 2022
Jiatong Shi , Shuai Guo , Tao Qian , Nan Huo , Tomoki Hayashi , Yuning Wu , Frank Xu , Xuankai Chang , Huazhe Li , Peter Wu , Shinji Watanabe , Qin Jin

Figure 1 for Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesis

Figure 2 for Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesis

Figure 3 for Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesis

Figure 4 for Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesis

* Interspeech submission

Access Paper or Ask Questions

Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translation

Apr 19, 2022
Keqi Deng , Shinji Watanabe , Jiatong Shi , Siddhant Arora

Figure 1 for Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translation

Figure 2 for Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translation

Figure 3 for Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translation

Figure 4 for Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translation

* Submitted to Interspeech2022

Access Paper or Ask Questions

Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation

Apr 18, 2022
Dan Berrebbi , Jiatong Shi , Brian Yan , Osbel Lopez-Francisco , Jonathan D. Amith , Shinji Watanabe

Figure 1 for Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation

Figure 2 for Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation

Figure 3 for Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation

Figure 4 for Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation

* 5 pages, 2 figures, submitted to Interspeech 2022

Access Paper or Ask Questions

SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities

Mar 14, 2022
Hsiang-Sheng Tsai , Heng-Jui Chang , Wen-Chin Huang , Zili Huang , Kushal Lakhotia , Shu-wen Yang , Shuyan Dong , Andy T. Liu , Cheng-I Jeff Lai , Jiatong Shi , Xuankai Chang , Phil Hall , Hsuan-Jui Chen , Shang-Wen Li , Shinji Watanabe , Abdelrahman Mohamed , Hung-yi Lee

Figure 1 for SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities

Figure 2 for SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities

Figure 3 for SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities

Figure 4 for SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities

* ACL 2022 main conference

Access Paper or Ask Questions

ESPnet2-TTS: Extending the Edge of TTS Research

Oct 15, 2021
Tomoki Hayashi , Ryuichi Yamamoto , Takenori Yoshimura , Peter Wu , Jiatong Shi , Takaaki Saeki , Yooncheol Ju , Yusuke Yasuda , Shinnosuke Takamichi , Shinji Watanabe

Figure 1 for ESPnet2-TTS: Extending the Edge of TTS Research

Figure 2 for ESPnet2-TTS: Extending the Edge of TTS Research

Figure 3 for ESPnet2-TTS: Extending the Edge of TTS Research

Figure 4 for ESPnet2-TTS: Extending the Edge of TTS Research

* Submitted to ICASSP2022. Demo HP: https://espnet.github.io/icassp2022-tts/

Access Paper or Ask Questions

ESPnet-ST IWSLT 2021 Offline Speech Translation System

Jul 06, 2021
Hirofumi Inaguma , Brian Yan , Siddharth Dalmia , Pengcheng Guo , Jiatong Shi , Kevin Duh , Shinji Watanabe

Figure 1 for ESPnet-ST IWSLT 2021 Offline Speech Translation System

Figure 2 for ESPnet-ST IWSLT 2021 Offline Speech Translation System

Figure 3 for ESPnet-ST IWSLT 2021 Offline Speech Translation System

Figure 4 for ESPnet-ST IWSLT 2021 Offline Speech Translation System

* IWSLT 2021

Access Paper or Ask Questions

SUPERB: Speech processing Universal PERformance Benchmark

May 03, 2021
Shu-wen Yang , Po-Han Chi , Yung-Sung Chuang , Cheng-I Jeff Lai , Kushal Lakhotia , Yist Y. Lin , Andy T. Liu , Jiatong Shi , Xuankai Chang , Guan-Ting Lin , Tzu-Hsien Huang , Wei-Cheng Tseng , Ko-tik Lee , Da-Rong Liu , Zili Huang , Shuyan Dong , Shang-Wen Li , Shinji Watanabe , Abdelrahman Mohamed , Hung-yi Lee

Figure 1 for SUPERB: Speech processing Universal PERformance Benchmark

Figure 2 for SUPERB: Speech processing Universal PERformance Benchmark

* Submitted to Interspeech 2021

Access Paper or Ask Questions