Publication: A deep learning approach for data driven vocal tract area function estimation
Files
Program
KU-Authors
KU Authors
Co-Authors
Advisor
Publication Date
2018
Language
English
Type
Journal Article
Journal Title
Journal ISSN
Volume Title
Abstract
In this paper we present a data driven vocal tract area function (VTAF) estimation using Deep Neural Networks (DNN). We approach the VTAF estimation problem based on sequence to sequence learning neural networks, where regression over a sliding window is used to learn arbitrary non-linear one-to-many mapping from the input feature sequence to the target articulatory sequence. We propose two schemes for efficient estimation of the VTAF; (1) a direct estimation of the area function values and (2) an indirect estimation via predicting the vocal tract boundaries. We consider acoustic speech and phone sequence as two possible input modalities for the DNN estimators. Experimental evaluations are performed over a large data comprising acoustic and phonetic features with parallel articulatory information from the USC-TIMIT database. Our results show that the proposed direct and indirect schemes perform the VTAF estimation with mean absolute error (MAE) rates lower than 1.65 mm, where the direct estimation scheme is observed to perform better than the indirect scheme.
Description
Source:
2018 IEEE Workshop on Spoken Language Technology (SLT)
Publisher:
Institute of Electrical and Electronics Engineers (IEEE)
Keywords:
Subject
Computer science, Artificial intelligence, Engineering, electrical and electronic