Alert button
Picture for Hung-yi Lee

Hung-yi Lee

Alert button

Language Representation in Multilingual BERT and its applications to improve Cross-lingual Generalization

Oct 21, 2020
Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Hung-yi Lee

Figure 1 for Language Representation in Multilingual BERT and its applications to improve Cross-lingual Generalization
Figure 2 for Language Representation in Multilingual BERT and its applications to improve Cross-lingual Generalization
Figure 3 for Language Representation in Multilingual BERT and its applications to improve Cross-lingual Generalization
Figure 4 for Language Representation in Multilingual BERT and its applications to improve Cross-lingual Generalization
Viaarxiv icon

What makes multilingual BERT multilingual?

Oct 20, 2020
Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Hung-yi Lee

Figure 1 for What makes multilingual BERT multilingual?
Figure 2 for What makes multilingual BERT multilingual?
Figure 3 for What makes multilingual BERT multilingual?
Figure 4 for What makes multilingual BERT multilingual?
Viaarxiv icon

Language Representation in Multilingual BERTand its applications to improve Cross-lingual Generalization

Oct 20, 2020
Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Hung-yi Lee

Figure 1 for Language Representation in Multilingual BERTand its applications to improve Cross-lingual Generalization
Figure 2 for Language Representation in Multilingual BERTand its applications to improve Cross-lingual Generalization
Figure 3 for Language Representation in Multilingual BERTand its applications to improve Cross-lingual Generalization
Figure 4 for Language Representation in Multilingual BERTand its applications to improve Cross-lingual Generalization
Viaarxiv icon

Pretrained Language Model Embryology: The Birth of ALBERT

Oct 06, 2020
David C. Chiang, Sung-Feng Huang, Hung-yi Lee

Figure 1 for Pretrained Language Model Embryology: The Birth of ALBERT
Figure 2 for Pretrained Language Model Embryology: The Birth of ALBERT
Figure 3 for Pretrained Language Model Embryology: The Birth of ALBERT
Figure 4 for Pretrained Language Model Embryology: The Birth of ALBERT
Viaarxiv icon

TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech

Jul 12, 2020
Andy T. Liu, Shang-Wen Li, Hung-yi Lee

Figure 1 for TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
Figure 2 for TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
Figure 3 for TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
Figure 4 for TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
Viaarxiv icon

Investigation of Sentiment Controllable Chatbot

Jul 11, 2020
Hung-yi Lee, Cheng-Hao Ho, Chien-Fu Lin, Chiung-Chih Chang, Chih-Wei Lee, Yau-Shian Wang, Tsung-Yuan Hsu, Kuan-Yu Chen

Figure 1 for Investigation of Sentiment Controllable Chatbot
Figure 2 for Investigation of Sentiment Controllable Chatbot
Figure 3 for Investigation of Sentiment Controllable Chatbot
Figure 4 for Investigation of Sentiment Controllable Chatbot
Viaarxiv icon

Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer

Jun 09, 2020
Tsung-Han Wu, Chun-Chen Hsieh, Yen-Hao Chen, Po-Han Chi, Hung-yi Lee

Figure 1 for Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer
Figure 2 for Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer
Figure 3 for Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer
Figure 4 for Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer
Viaarxiv icon

Understanding Self-Attention of Self-Supervised Audio Transformers

Jun 05, 2020
Shu-wen Yang, Andy T. Liu, Hung-yi Lee

Figure 1 for Understanding Self-Attention of Self-Supervised Audio Transformers
Figure 2 for Understanding Self-Attention of Self-Supervised Audio Transformers
Figure 3 for Understanding Self-Attention of Self-Supervised Audio Transformers
Figure 4 for Understanding Self-Attention of Self-Supervised Audio Transformers
Viaarxiv icon

Defense for Black-box Attacks on Anti-spoofing Models by Self-Supervised Learning

Jun 05, 2020
Haibin Wu, Andy T. Liu, Hung-yi Lee

Figure 1 for Defense for Black-box Attacks on Anti-spoofing Models by Self-Supervised Learning
Figure 2 for Defense for Black-box Attacks on Anti-spoofing Models by Self-Supervised Learning
Figure 3 for Defense for Black-box Attacks on Anti-spoofing Models by Self-Supervised Learning
Viaarxiv icon

Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation

May 26, 2020
Po-Han Chi, Pei-Hung Chung, Tsung-Han Wu, Chun-Cheng Hsieh, Shang-Wen Li, Hung-yi Lee

Figure 1 for Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation
Figure 2 for Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation
Figure 3 for Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation
Figure 4 for Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation
Viaarxiv icon