Continuous Noise Masking Based Vocoder for Statistical Parametric Speech Synthesis

Mohammed Salah AL-RADHI  Tamás Gábor CSAPÓ  Géza NÉMETH  

IEICE TRANSACTIONS on Information and Systems   Vol.E103-D   No.5   pp.1099-1107
Publication Date: 2020/05/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2019EDP7167
Type of Manuscript: PAPER
Category: Speech and Hearing
noise masking,  continuous vocoder,  speech synthesis,  phase distortion,  kernel density functions,  

Full Text: PDF(1.1MB)>>
Buy this Article

In this article, we propose a method called “continuous noise masking (cNM)” that allows eliminating residual buzziness in a continuous vocoder, i.e. of which all parameters are continuous and offers a simple and flexible speech analysis and synthesis system. Traditional parametric vocoders generally show a perceptible deterioration in the quality of the synthesized speech due to different processing algorithms. Furthermore, an inaccurate noise resynthesis (e.g. in breathiness or hoarseness) is also considered to be one of the main underlying causes of performance degradation, leading to noisy transients and temporal discontinuity in the synthesized speech. To overcome these issues, a new cNM is developed based on the phase distortion deviation in order to reduce the perceptual effect of the residual noise, allowing a proper reconstruction of noise characteristics, and model better the creaky voice segments that may happen in natural speech. To this end, the cNM is designed to keep only voice components under a condition of the cNM threshold while discarding others. We evaluate the proposed approach and compare with state-of-the-art vocoders using objective and subjective listening tests. Experimental results show that the proposed method can reduce the effect of residual noise and can reach the quality of other sophisticated approaches like STRAIGHT and log domain pulse model (PML).