Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Hung-yi Lee

Hung-yi Lee

An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition


Oct 09, 2021
Xuankai Chang, Takashi Maekaku, Pengcheng Guo, Jing Shi, Yen-Ju Lu, Aswin Shanmugam Subramanian, Tianzi Wang, Shu-wen Yang, Yu Tsao, Hung-yi Lee, Shinji Watanabe

Figure 1 for An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition
Figure 2 for An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition
Figure 3 for An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition
Figure 4 for An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition
* To appear in ASRU2021 
  Access Paper or Ask Questions

Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models


Oct 07, 2021
Liang-Hsuan Tseng, Yu-Kuan Fu, Heng-Jui Chang, Hung-yi Lee

Figure 1 for Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models
Figure 2 for Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models
Figure 3 for Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models
Figure 4 for Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models
* Submitted to ICASSP 2022 
  Access Paper or Ask Questions

DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT


Oct 06, 2021
Heng-Jui Chang, Shu-wen Yang, Hung-yi Lee

Figure 1 for DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT
Figure 2 for DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT
Figure 3 for DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT
Figure 4 for DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT
* Submitted to ICASSP 2022 
  Access Paper or Ask Questions

On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets


Sep 08, 2021
Cheng-Han Chiang, Hung-yi Lee

Figure 1 for On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets
Figure 2 for On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets
Figure 3 for On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets
Figure 4 for On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets
* Preprint, under review. 10 pages, 3 figures, 2 tables 
  Access Paper or Ask Questions

Parallelized Reverse Curriculum Generation


Aug 04, 2021
Zih-Yun Chiu, Yi-Lin Tuan, Hung-yi Lee, Li-Chen Fu

Figure 1 for Parallelized Reverse Curriculum Generation
Figure 2 for Parallelized Reverse Curriculum Generation
Figure 3 for Parallelized Reverse Curriculum Generation
Figure 4 for Parallelized Reverse Curriculum Generation

  Access Paper or Ask Questions

Spotting adversarial samples for speaker verification by neural vocoders


Jul 02, 2021
Haibin Wu, Po-chun Hsu, Ji Gao, Shanshan Zhang, Shen Huang, Jian Kang, Zhiyong Wu, Helen Meng, Hung-yi Lee

Figure 1 for Spotting adversarial samples for speaker verification by neural vocoders
Figure 2 for Spotting adversarial samples for speaker verification by neural vocoders
Figure 3 for Spotting adversarial samples for speaker verification by neural vocoders
Figure 4 for Spotting adversarial samples for speaker verification by neural vocoders
* Submitted to ASRU 2021 
  Access Paper or Ask Questions

Multi-accent Speech Separation with One Shot Learning


Jun 28, 2021
Kuan-Po Huang, Yuan-Kuei Wu, Hung-yi Lee

Figure 1 for Multi-accent Speech Separation with One Shot Learning
Figure 2 for Multi-accent Speech Separation with One Shot Learning
Figure 3 for Multi-accent Speech Separation with One Shot Learning
Figure 4 for Multi-accent Speech Separation with One Shot Learning
* Accepted at ACL 2021 Meta Learning for NLP 
  Access Paper or Ask Questions

Voting for the right answer: Adversarial defense for speaker verification


Jun 15, 2021
Haibin Wu, Yang Zhang, Zhiyong Wu, Dong Wang, Hung-yi Lee

Figure 1 for Voting for the right answer: Adversarial defense for speaker verification
Figure 2 for Voting for the right answer: Adversarial defense for speaker verification
Figure 3 for Voting for the right answer: Adversarial defense for speaker verification
Figure 4 for Voting for the right answer: Adversarial defense for speaker verification
* Accepted by Interspeech 2021. Code is available at https://github.com/thuhcsi/adsv_voting 
  Access Paper or Ask Questions

Mitigating Biases in Toxic Language Detection through Invariant Rationalization


Jun 14, 2021
Yung-Sung Chuang, Mingye Gao, Hongyin Luo, James Glass, Hung-yi Lee, Yun-Nung Chen, Shang-Wen Li

Figure 1 for Mitigating Biases in Toxic Language Detection through Invariant Rationalization
Figure 2 for Mitigating Biases in Toxic Language Detection through Invariant Rationalization
Figure 3 for Mitigating Biases in Toxic Language Detection through Invariant Rationalization
* The 5th Workshop on Online Abuse and Harms at ACL 2021 
  Access Paper or Ask Questions

Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning


Jun 14, 2021
Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-yi Lee

Figure 1 for Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning
Figure 2 for Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning
Figure 3 for Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning
Figure 4 for Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning
* Submitted to TASLP on 19 April 2021 
  Access Paper or Ask Questions

Adversarial Defense for Automatic Speaker Verification by Self-Supervised Learning


Jun 01, 2021
Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-yi Lee

Figure 1 for Adversarial Defense for Automatic Speaker Verification by Self-Supervised Learning
Figure 2 for Adversarial Defense for Automatic Speaker Verification by Self-Supervised Learning
Figure 3 for Adversarial Defense for Automatic Speaker Verification by Self-Supervised Learning
Figure 4 for Adversarial Defense for Automatic Speaker Verification by Self-Supervised Learning
* Submitted to TASLP on 03 May 2021 
  Access Paper or Ask Questions

SpeechNet: A Universal Modularized Model for Speech Processing Tasks


May 31, 2021
Yi-Chen Chen, Po-Han Chi, Shu-wen Yang, Kai-Wei Chang, Jheng-hao Lin, Sung-Feng Huang, Da-Rong Liu, Chi-Liang Liu, Cheng-Kuang Lee, Hung-yi Lee

Figure 1 for SpeechNet: A Universal Modularized Model for Speech Processing Tasks
Figure 2 for SpeechNet: A Universal Modularized Model for Speech Processing Tasks
Figure 3 for SpeechNet: A Universal Modularized Model for Speech Processing Tasks
Figure 4 for SpeechNet: A Universal Modularized Model for Speech Processing Tasks

  Access Paper or Ask Questions

Investigating the Reordering Capability in CTC-based Non-Autoregressive End-to-End Speech Translation


May 11, 2021
Shun-Po Chuang, Yung-Sung Chuang, Chih-Chiang Chang, Hung-yi Lee

Figure 1 for Investigating the Reordering Capability in CTC-based Non-Autoregressive End-to-End Speech Translation
Figure 2 for Investigating the Reordering Capability in CTC-based Non-Autoregressive End-to-End Speech Translation
Figure 3 for Investigating the Reordering Capability in CTC-based Non-Autoregressive End-to-End Speech Translation
Figure 4 for Investigating the Reordering Capability in CTC-based Non-Autoregressive End-to-End Speech Translation
* Accepted in Findings of ACL-IJCNLP 2021 
  Access Paper or Ask Questions

Improving Cross-Lingual Reading Comprehension with Self-Training


May 08, 2021
Wei-Cheng Huang, Chien-yu Huang, Hung-yi Lee

Figure 1 for Improving Cross-Lingual Reading Comprehension with Self-Training
Figure 2 for Improving Cross-Lingual Reading Comprehension with Self-Training
Figure 3 for Improving Cross-Lingual Reading Comprehension with Self-Training
Figure 4 for Improving Cross-Lingual Reading Comprehension with Self-Training
* 8 pages, 4 figures 
  Access Paper or Ask Questions

SUPERB: Speech processing Universal PERformance Benchmark


May 03, 2021
Shu-wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-Wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee

Figure 1 for SUPERB: Speech processing Universal PERformance Benchmark
Figure 2 for SUPERB: Speech processing Universal PERformance Benchmark
* Submitted to Interspeech 2021 
  Access Paper or Ask Questions

Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention


Apr 23, 2021
Hsuan Su, Jiun-Hao Jhan, Fan-yun Sun, Saurav Sahay, Hung-yi Lee

Figure 1 for Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention
Figure 2 for Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention
Figure 3 for Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention
Figure 4 for Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention
* Accepted at NAACL-HLT 2021 
  Access Paper or Ask Questions

Utilizing Self-supervised Representations for MOS Prediction


Apr 21, 2021
Wei-Cheng Tseng, Chien-yu Huang, Wei-Tsung Kao, Yist Y. Lin, Hung-yi Lee

Figure 1 for Utilizing Self-supervised Representations for MOS Prediction
Figure 2 for Utilizing Self-supervised Representations for MOS Prediction
Figure 3 for Utilizing Self-supervised Representations for MOS Prediction
Figure 4 for Utilizing Self-supervised Representations for MOS Prediction
* Submitted to Interspeech 2021. We acknowledge the support of AWS Machine Learning Research Awards program 
  Access Paper or Ask Questions

S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations


Apr 07, 2021
Jheng-hao Lin, Yist Y. Lin, Chung-Ming Chien, Hung-yi Lee

Figure 1 for S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations
Figure 2 for S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations
Figure 3 for S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations
Figure 4 for S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations
* Submitted to INTERSPEECH 2021 
  Access Paper or Ask Questions

Non-autoregressive Mandarin-English Code-switching Speech Recognition with Pinyin Mask-CTC and Word Embedding Regularization


Apr 06, 2021
Shun-Po Chuang, Heng-Jui Chang, Sung-Feng Huang, Hung-yi Lee

Figure 1 for Non-autoregressive Mandarin-English Code-switching Speech Recognition with Pinyin Mask-CTC and Word Embedding Regularization
Figure 2 for Non-autoregressive Mandarin-English Code-switching Speech Recognition with Pinyin Mask-CTC and Word Embedding Regularization
Figure 3 for Non-autoregressive Mandarin-English Code-switching Speech Recognition with Pinyin Mask-CTC and Word Embedding Regularization
Figure 4 for Non-autoregressive Mandarin-English Code-switching Speech Recognition with Pinyin Mask-CTC and Word Embedding Regularization
* 5 pages, 1 figure, submitted to INTERSPEECH2021 
  Access Paper or Ask Questions

Towards Lifelong Learning of End-to-end ASR


Apr 04, 2021
Heng-Jui Chang, Hung-yi Lee, Lin-shan Lee

Figure 1 for Towards Lifelong Learning of End-to-end ASR
Figure 2 for Towards Lifelong Learning of End-to-end ASR
Figure 3 for Towards Lifelong Learning of End-to-end ASR
Figure 4 for Towards Lifelong Learning of End-to-end ASR
* Submitted to INTERSPEECH 2021 
  Access Paper or Ask Questions

Auto-KWS 2021 Challenge: Task, Datasets, and Baselines


Mar 31, 2021
Jingsong Wang, Yuxuan He, Chunyu Zhao, Qijie Shao, Wei-Wei Tu, Tom Ko, Hung-yi Lee, Lei Xie

Figure 1 for Auto-KWS 2021 Challenge: Task, Datasets, and Baselines
Figure 2 for Auto-KWS 2021 Challenge: Task, Datasets, and Baselines
Figure 3 for Auto-KWS 2021 Challenge: Task, Datasets, and Baselines
Figure 4 for Auto-KWS 2021 Challenge: Task, Datasets, and Baselines
* 5 pages, 2 figures 
  Access Paper or Ask Questions

Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech


Mar 20, 2021
Chung-Ming Chien, Jheng-Hao Lin, Chien-yu Huang, Po-chun Hsu, Hung-yi Lee

Figure 1 for Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech
Figure 2 for Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech
Figure 3 for Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech
Figure 4 for Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech
* Accepted by ICASSP 2021, in the special session of ICASSP 2021 M2VoC Challenge 
  Access Paper or Ask Questions

Adversarial defense for automatic speaker verification by cascaded self-supervised learning models


Feb 14, 2021
Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-yi Lee

Figure 1 for Adversarial defense for automatic speaker verification by cascaded self-supervised learning models
Figure 2 for Adversarial defense for automatic speaker verification by cascaded self-supervised learning models
Figure 3 for Adversarial defense for automatic speaker verification by cascaded self-supervised learning models
Figure 4 for Adversarial defense for automatic speaker verification by cascaded self-supervised learning models
* Accepted to ICASSP 2021 
  Access Paper or Ask Questions