Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Haizhou Li

Haizhou Li

Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection


Jul 14, 2021
Ruijie Tao, Zexu Pan, Rohan Kumar Das, Xinyuan Qian, Mike Zheng Shou, Haizhou Li

Figure 1 for Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection
Figure 2 for Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection
Figure 3 for Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection
Figure 4 for Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection
* ACM Multimedia 2021 
  Access Paper or Ask Questions

Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding


Jul 14, 2021
Hongning Zhu, Kong Aik Lee, Haizhou Li

Figure 1 for Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding
Figure 2 for Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding
Figure 3 for Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding
Figure 4 for Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding
* Accepted by Interspeech 2021 
  Access Paper or Ask Questions

Expressive Voice Conversion: A Joint Framework for Speaker Identity and Emotional Style Transfer


Jul 08, 2021
Zongyang Du, Berrak Sisman, Kun Zhou, Haizhou Li

Figure 1 for Expressive Voice Conversion: A Joint Framework for Speaker Identity and Emotional Style Transfer
Figure 2 for Expressive Voice Conversion: A Joint Framework for Speaker Identity and Emotional Style Transfer
Figure 3 for Expressive Voice Conversion: A Joint Framework for Speaker Identity and Emotional Style Transfer
Figure 4 for Expressive Voice Conversion: A Joint Framework for Speaker Identity and Emotional Style Transfer
* Submitted to ASRU 2021 
  Access Paper or Ask Questions

Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification


Jun 17, 2021
Li Zhang, Qing Wang, Kong Aik Lee, Lei Xie, Haizhou Li

Figure 1 for Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification
Figure 2 for Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification
Figure 3 for Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification
Figure 4 for Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification

  Access Paper or Ask Questions

Selective Hearing through Lip-reading


Jun 14, 2021
Zexu Pan, Ruijie Tao, Chenglin Xu, Haizhou Li

Figure 1 for Selective Hearing through Lip-reading
Figure 2 for Selective Hearing through Lip-reading
Figure 3 for Selective Hearing through Lip-reading
Figure 4 for Selective Hearing through Lip-reading

  Access Paper or Ask Questions

DynaEval: Unifying Turn and Dialogue Level Evaluation


Jun 06, 2021
Chen Zhang, Yiming Chen, Luis Fernando D'Haro, Yan Zhang, Thomas Friedrichs, Grandee Lee, Haizhou Li

Figure 1 for DynaEval: Unifying Turn and Dialogue Level Evaluation
Figure 2 for DynaEval: Unifying Turn and Dialogue Level Evaluation
Figure 3 for DynaEval: Unifying Turn and Dialogue Level Evaluation
Figure 4 for DynaEval: Unifying Turn and Dialogue Level Evaluation
* ACL-IJCNLP 2021 (Main conference, Long paper) 
  Access Paper or Ask Questions

Emotional Voice Conversion: Theory, Databases and ESD


May 31, 2021
Kun Zhou, Berrak Sisman, Rui Liu, Haizhou Li

Figure 1 for Emotional Voice Conversion: Theory, Databases and ESD
Figure 2 for Emotional Voice Conversion: Theory, Databases and ESD
Figure 3 for Emotional Voice Conversion: Theory, Databases and ESD
Figure 4 for Emotional Voice Conversion: Theory, Databases and ESD
* Submitted to Speech Communication 
  Access Paper or Ask Questions

Multi-target DoA Estimation with an Audio-visual Fusion Mechanism


May 13, 2021
Xinyuan Qian, Maulik Madhavi, Zexu Pan, Jiadong Wang, Haizhou Li

Figure 1 for Multi-target DoA Estimation with an Audio-visual Fusion Mechanism
Figure 2 for Multi-target DoA Estimation with an Audio-visual Fusion Mechanism
Figure 3 for Multi-target DoA Estimation with an Audio-visual Fusion Mechanism
Figure 4 for Multi-target DoA Estimation with an Audio-visual Fusion Mechanism
* ICASSP 2021 accepted 
  Access Paper or Ask Questions

The Multi-speaker Multi-style Voice Cloning Challenge 2021


Apr 05, 2021
Qicong Xie, Xiaohai Tian, Guanghou Liu, Kun Song, Lei Xie, Zhiyong Wu, Hai Li, Song Shi, Haizhou Li, Fen Hong, Hui Bu, Xin Xu

Figure 1 for The Multi-speaker Multi-style Voice Cloning Challenge 2021
Figure 2 for The Multi-speaker Multi-style Voice Cloning Challenge 2021
* has been accepted to ICASSP 2021 
  Access Paper or Ask Questions

Reinforcement Learning for Emotional Text-to-Speech Synthesis with Improved Emotion Discriminability


Apr 03, 2021
Rui Liu, Berrak Sisman, Haizhou Li

Figure 1 for Reinforcement Learning for Emotional Text-to-Speech Synthesis with Improved Emotion Discriminability
Figure 2 for Reinforcement Learning for Emotional Text-to-Speech Synthesis with Improved Emotion Discriminability
Figure 3 for Reinforcement Learning for Emotional Text-to-Speech Synthesis with Improved Emotion Discriminability
Figure 4 for Reinforcement Learning for Emotional Text-to-Speech Synthesis with Improved Emotion Discriminability
* 5 pages, 4 figures, Submitted to Interspeech 2021, Speech Samples: https://ttslr.github.io/i-ETTS 
  Access Paper or Ask Questions

Target Speaker Verification with Selective Auditory Attention for Single and Multi-talker Speech


Apr 02, 2021
Chenglin Xu, Wei Rao, Jibin Wu, Haizhou Li

Figure 1 for Target Speaker Verification with Selective Auditory Attention for Single and Multi-talker Speech
Figure 2 for Target Speaker Verification with Selective Auditory Attention for Single and Multi-talker Speech
Figure 3 for Target Speaker Verification with Selective Auditory Attention for Single and Multi-talker Speech
Figure 4 for Target Speaker Verification with Selective Auditory Attention for Single and Multi-talker Speech
* 13 pages, submitted to IEEE/ACM transaction on Audio, Speech and Language on 10 Jan. 2021 
  Access Paper or Ask Questions

Limited Data Emotional Voice Conversion Leveraging Text-to-Speech: Two-stage Sequence-to-Sequence Training


Mar 31, 2021
Kun Zhou, Berrak Sisman, Haizhou Li

Figure 1 for Limited Data Emotional Voice Conversion Leveraging Text-to-Speech: Two-stage Sequence-to-Sequence Training
Figure 2 for Limited Data Emotional Voice Conversion Leveraging Text-to-Speech: Two-stage Sequence-to-Sequence Training
Figure 3 for Limited Data Emotional Voice Conversion Leveraging Text-to-Speech: Two-stage Sequence-to-Sequence Training
Figure 4 for Limited Data Emotional Voice Conversion Leveraging Text-to-Speech: Two-stage Sequence-to-Sequence Training
* Submitted to Interspeech 2021 
  Access Paper or Ask Questions

Low-latency auditory spatial attention detection based on spectro-spatial features from EEG


Mar 05, 2021
Siqi Cai, Pengcheng Sun, Tanja Schultz, Haizhou Li

Figure 1 for Low-latency auditory spatial attention detection based on spectro-spatial features from EEG
Figure 2 for Low-latency auditory spatial attention detection based on spectro-spatial features from EEG
Figure 3 for Low-latency auditory spatial attention detection based on spectro-spatial features from EEG
* International Conference of the IEEE Engineering in Medicine and Biology Society 
  Access Paper or Ask Questions

Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification


Feb 15, 2021
Bidisha Sharma, Maulik Madhavi, Haizhou Li

Figure 1 for Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification
Figure 2 for Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification
Figure 3 for Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification
Figure 4 for Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification

  Access Paper or Ask Questions

Data Augmentation with Signal Companding for Detection of Logical Access Attacks


Feb 12, 2021
Rohan Kumar Das, Jichen Yang, Haizhou Li

Figure 1 for Data Augmentation with Signal Companding for Detection of Logical Access Attacks
Figure 2 for Data Augmentation with Signal Companding for Detection of Logical Access Attacks
Figure 3 for Data Augmentation with Signal Companding for Detection of Logical Access Attacks
Figure 4 for Data Augmentation with Signal Companding for Detection of Logical Access Attacks
* 5 pages, Accepted for publication in International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2021 
  Access Paper or Ask Questions

Multi-stage Speaker Extraction with Utterance and Frame-Level Reference Signals


Nov 19, 2020
Meng Ge, Chenglin Xu, Longbiao Wang, Eng Siong Chng, Jianwu Dang, Haizhou Li

Figure 1 for Multi-stage Speaker Extraction with Utterance and Frame-Level Reference Signals
Figure 2 for Multi-stage Speaker Extraction with Utterance and Frame-Level Reference Signals
Figure 3 for Multi-stage Speaker Extraction with Utterance and Frame-Level Reference Signals
Figure 4 for Multi-stage Speaker Extraction with Utterance and Frame-Level Reference Signals
* submit to ICASSP 2021 
  Access Paper or Ask Questions

VAW-GAN for Disentanglement and Recomposition of Emotional Elements in Speech


Nov 03, 2020
Kun Zhou, Berrak Sisman, Haizhou Li

Figure 1 for VAW-GAN for Disentanglement and Recomposition of Emotional Elements in Speech
Figure 2 for VAW-GAN for Disentanglement and Recomposition of Emotional Elements in Speech
Figure 3 for VAW-GAN for Disentanglement and Recomposition of Emotional Elements in Speech
Figure 4 for VAW-GAN for Disentanglement and Recomposition of Emotional Elements in Speech
* Accepted by IEEE SLT 2021. arXiv admin note: text overlap with arXiv:2005.07025 
  Access Paper or Ask Questions

Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset


Oct 28, 2020
Kun Zhou, Berrak Sisman, Rui Liu, Haizhou Li

Figure 1 for Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset
Figure 2 for Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset
Figure 3 for Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset
Figure 4 for Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset
* Submitted to ICASSP 2021 
  Access Paper or Ask Questions

GraphSpeech: Syntax-Aware Graph Attention Network For Neural Speech Synthesis


Oct 23, 2020
Rui Liu, Berrak Sisman, Haizhou Li

Figure 1 for GraphSpeech: Syntax-Aware Graph Attention Network For Neural Speech Synthesis
Figure 2 for GraphSpeech: Syntax-Aware Graph Attention Network For Neural Speech Synthesis
Figure 3 for GraphSpeech: Syntax-Aware Graph Attention Network For Neural Speech Synthesis
Figure 4 for GraphSpeech: Syntax-Aware Graph Attention Network For Neural Speech Synthesis
* This paper was submitted to ICASSP2021 
  Access Paper or Ask Questions

Speaker-Utterance Dual Attention for Speaker and Utterance Verification


Aug 20, 2020
Tianchi Liu, Rohan Kumar Das, Maulik Madhavi, Shengmei Shen, Haizhou Li

Figure 1 for Speaker-Utterance Dual Attention for Speaker and Utterance Verification
Figure 2 for Speaker-Utterance Dual Attention for Speaker and Utterance Verification
Figure 3 for Speaker-Utterance Dual Attention for Speaker and Utterance Verification
Figure 4 for Speaker-Utterance Dual Attention for Speaker and Utterance Verification
* Accepted by Interspeech 2020 
  Access Paper or Ask Questions

Spectrum and Prosody Conversion for Cross-lingual Voice Conversion with CycleGAN


Aug 12, 2020
Zongyang Du, Kun Zhou, Berrak Sisman, Haizhou Li

Figure 1 for Spectrum and Prosody Conversion for Cross-lingual Voice Conversion with CycleGAN
Figure 2 for Spectrum and Prosody Conversion for Cross-lingual Voice Conversion with CycleGAN
Figure 3 for Spectrum and Prosody Conversion for Cross-lingual Voice Conversion with CycleGAN
Figure 4 for Spectrum and Prosody Conversion for Cross-lingual Voice Conversion with CycleGAN
* Submitted to APSIPA ASC 2020 
  Access Paper or Ask Questions

VAW-GAN for Singing Voice Conversion with Non-parallel Training Data


Aug 12, 2020
Junchen Lu, Kun Zhou, Berrak Sisman, Haizhou Li

Figure 1 for VAW-GAN for Singing Voice Conversion with Non-parallel Training Data
Figure 2 for VAW-GAN for Singing Voice Conversion with Non-parallel Training Data
Figure 3 for VAW-GAN for Singing Voice Conversion with Non-parallel Training Data
Figure 4 for VAW-GAN for Singing Voice Conversion with Non-parallel Training Data
* Submitted to APSIPA ASC 2020 
  Access Paper or Ask Questions

Modeling Prosodic Phrasing with Multi-Task Learning in Tacotron-based TTS


Aug 11, 2020
Rui Liu, Berrak Sisman, Feilong Bao, Guanglai Gao, Haizhou Li

Figure 1 for Modeling Prosodic Phrasing with Multi-Task Learning in Tacotron-based TTS
Figure 2 for Modeling Prosodic Phrasing with Multi-Task Learning in Tacotron-based TTS
Figure 3 for Modeling Prosodic Phrasing with Multi-Task Learning in Tacotron-based TTS
Figure 4 for Modeling Prosodic Phrasing with Multi-Task Learning in Tacotron-based TTS
* To appear in IEEE Signal Processing Letters (SPL) 
  Access Paper or Ask Questions

Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network


Jul 07, 2020
Zihan Pan, Malu Zhang, Jibin Wu, Haizhou Li

Figure 1 for Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network
Figure 2 for Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network
Figure 3 for Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network
Figure 4 for Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network

  Access Paper or Ask Questions

Progressive Tandem Learning for Pattern Recognition with Deep Spiking Neural Networks


Jul 02, 2020
Jibin Wu, Chenglin Xu, Daquan Zhou, Haizhou Li, Kay Chen Tan

Figure 1 for Progressive Tandem Learning for Pattern Recognition with Deep Spiking Neural Networks
Figure 2 for Progressive Tandem Learning for Pattern Recognition with Deep Spiking Neural Networks
Figure 3 for Progressive Tandem Learning for Pattern Recognition with Deep Spiking Neural Networks
Figure 4 for Progressive Tandem Learning for Pattern Recognition with Deep Spiking Neural Networks

  Access Paper or Ask Questions

You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy


Jun 03, 2020
Srivatsa P, Kyle Timothy Ng Chu, Yaswanth Tavva, Jibin Wu, Malu Zhang, Haizhou Li, Trevor E. Carlson

Figure 1 for You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy
Figure 2 for You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy
Figure 3 for You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy
Figure 4 for You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy
* 10 pages, 4 figures, extended version of the paper accepted to the 2nd Workshop on Accelerated Machine Learning (AccML 2020) 
  Access Paper or Ask Questions