Picture for Shujie Liu

Shujie Liu

VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation

May 25, 2023
Tianrui Wang, Long Zhou, Ziqiang Zhang, Yu Wu, Shujie Liu, Yashesh Gaur, Zhuo Chen, Jinyu Li, Furu Wei

Figure 1 for VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation

Figure 2 for VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation

Figure 3 for VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation

Figure 4 for VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation

* Working in progress

Access Paper or Ask Questions

Code-Switching Text Generation and Injection in Mandarin-English ASR

Mar 20, 2023
Haibin Yu, Yuxuan Hu, Yao Qian, Ma Jin, Linquan Liu, Shujie Liu, Yu Shi, Yanmin Qian, Edward Lin, Michael Zeng

Figure 1 for Code-Switching Text Generation and Injection in Mandarin-English ASR

Figure 2 for Code-Switching Text Generation and Injection in Mandarin-English ASR

Figure 3 for Code-Switching Text Generation and Injection in Mandarin-English ASR

Figure 4 for Code-Switching Text Generation and Injection in Mandarin-English ASR

* Accepted by ICASSP 2023

Access Paper or Ask Questions

Target Sound Extraction with Variable Cross-modality Clues

Mar 15, 2023
Chenda Li, Yao Qian, Zhuo Chen, Dongmei Wang, Takuya Yoshioka, Shujie Liu, Yanmin Qian, Michael Zeng

Figure 1 for Target Sound Extraction with Variable Cross-modality Clues

Figure 2 for Target Sound Extraction with Variable Cross-modality Clues

Figure 3 for Target Sound Extraction with Variable Cross-modality Clues

Figure 4 for Target Sound Extraction with Variable Cross-modality Clues

* Accepted by ICASSP 2023

Access Paper or Ask Questions

Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

Mar 07, 2023
Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei

Figure 1 for Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

Figure 2 for Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

Figure 3 for Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

Figure 4 for Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

* We encourage readers to listen to the audio samples on our demo page: \url{https://aka.ms/vallex}

Access Paper or Ask Questions

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

Jan 05, 2023
Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei

Figure 1 for Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

Figure 2 for Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

Figure 3 for Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

Figure 4 for Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

* Working in progress

Access Paper or Ask Questions

Exploring WavLM on Speech Enhancement

Nov 18, 2022
Hyungchan Song, Sanyuan Chen, Zhuo Chen, Yu Wu, Takuya Yoshioka, Min Tang, Jong Won Shin, Shujie Liu

Figure 1 for Exploring WavLM on Speech Enhancement

Figure 2 for Exploring WavLM on Speech Enhancement

Figure 3 for Exploring WavLM on Speech Enhancement

* Accepted by IEEE SLT 2022

Access Paper or Ask Questions