Zhen-Hua Ling, Korin Richmond, Junichi Yamagishi (2013). Articulatory Control of HMM-Based Parametric Speech Synthesis Using Feature-Space-Switched Multiple Regression. IEEE Transactions on Audio, Speech and Language Processing  21: 207-219.

Abstract  In previous work we proposed a method to control the characteristics of synthetic speech flexibly by integrating articulatory features into a hidden Markov model (HMM) based parametric speech synthesizer. In this method, a unified acoustic-articulatory model is trained, and context-dependent linear transforms are used to model the dependency between the two feature streams. In this paper, we go significantly further and propose a feature-space-switched multiple regression HMM to improve the performance of articulatory control. A multiple regression HMM (MRHMM) is adopted to model the distribution of acoustic features, with articulatory features used as exogenous “explanatory” variables. A separate Gaussian mixture model (GMM) is introduced to model the articulatory space, and articulatory-to-acoustic regression matrices are trained for each component of this GMM, instead of for the context-dependent states in the HMM. Further- more, we propose a task-specific context feature tailoring method to ensure compatibility between state context features and articulatory features that are manipulated at synthesis time. The proposed method is evaluated on two tasks, using a speech database with acoustic waveforms and articulatory movements recorded in parallel by electromagnetic articulography (EMA). In a vowel identity modification task, the new method achieves better performance when reconstructing target vowels by varying articulatory inputs than our previous approach. A second vowel creation task shows our new method is highly effective at producing a new vowel from appropriate articulatory representations which, even though no acoustic samples for this vowel are present in the training data, is shown to sound highly natural.


Warning: strtotime(): It is not safe to rely on the system's timezone settings. You are *required* to use the date.timezone setting or the date_default_timezone_set() function. In case you used any of those methods and you are still getting this warning, you most likely misspelled the timezone identifier. We selected the timezone 'UTC' for now, but please set date.timezone to select your timezone. in /home/laslab/3w/listening-talker.org/libraries/joomla/utilities/date.php on line 56

Warning: date(): It is not safe to rely on the system's timezone settings. You are *required* to use the date.timezone setting or the date_default_timezone_set() function. In case you used any of those methods and you are still getting this warning, you most likely misspelled the timezone identifier. We selected the timezone 'UTC' for now, but please set date.timezone to select your timezone. in /home/laslab/3w/listening-talker.org/libraries/joomla/utilities/date.php on line 198

Warning: Creating default object from empty value in /home/laslab/3w/listening-talker.org/modules/mod_latestnews/helper.php on line 109

Warning: Creating default object from empty value in /home/laslab/3w/listening-talker.org/modules/mod_latestnews/helper.php on line 109

Warning: Creating default object from empty value in /home/laslab/3w/listening-talker.org/modules/mod_latestnews/helper.php on line 109

Warning: Creating default object from empty value in /home/laslab/3w/listening-talker.org/modules/mod_latestnews/helper.php on line 109

Warning: Creating default object from empty value in /home/laslab/3w/listening-talker.org/modules/mod_latestnews/helper.php on line 109

EU Flag EU Flag 
Warning: strtotime(): It is not safe to rely on the system's timezone settings. You are *required* to use the date.timezone setting or the date_default_timezone_set() function. In case you used any of those methods and you are still getting this warning, you most likely misspelled the timezone identifier. We selected the timezone 'UTC' for now, but please set date.timezone to select your timezone. in /home/laslab/3w/listening-talker.org/libraries/joomla/utilities/date.php on line 56

Warning: strftime(): It is not safe to rely on the system's timezone settings. You are *required* to use the date.timezone setting or the date_default_timezone_set() function. In case you used any of those methods and you are still getting this warning, you most likely misspelled the timezone identifier. We selected the timezone 'UTC' for now, but please set date.timezone to select your timezone. in /home/laslab/3w/listening-talker.org/libraries/joomla/utilities/date.php on line 250
Copyright © 2017. The Listening Talker - LISTA  |  Technical Support