Alert button

Prosody Transfer in Neural Text to Speech Using Global Pitch and Loudness Features

Nov 21, 2019
Figure 1 for Prosody Transfer in Neural Text to Speech Using Global Pitch and Loudness Features
Figure 2 for Prosody Transfer in Neural Text to Speech Using Global Pitch and Loudness Features
Figure 3 for Prosody Transfer in Neural Text to Speech Using Global Pitch and Loudness Features
Figure 4 for Prosody Transfer in Neural Text to Speech Using Global Pitch and Loudness Features

Share this with someone who'll enjoy it:

This paper presents a simple yet effective method to achieve prosody transfer from a reference speech signal to synthesized speech. The main idea is to incorporate well-known acoustic correlates of prosody such as pitch and loudness contours of the reference speech into a modern neural text-to-speech (TTS) synthesizer such as Tacotron2 (TC2). More specifically, a small set of acoustic features are extracted from the reference audio and then used to condition a TC2 synthesizer. The trained model is evaluated using subjective listening tests and novel objective evaluations of prosody transfer are proposed. Listening tests show that the synthesized speech is rated as highly natural and that prosody is successfully transferred from the reference speech signal to the synthesized signal.

* 6 pages, in review for conference publication  

Share this with someone who'll enjoy it: