Publication: Prosody-driven head-gesture animation
Program
KU Authors
Co-Authors
Erdem, A. T.
Erdem, C.
Özkan, M.
Publication Date
Language
Embargo Status
Journal Title
Journal ISSN
Volume Title
Alternative Title
Abstract
We present a new framework for joint analysis of head gesture and speech prosody patterns of a speaker towards automatic realistic synthesis of head gestures from speech prosody. The proposed two-stage analysis aims to "learn" both elementary prosody and head gesture patterns for a particular speaker, as well as the correlations between these head gesture and prosody patterns from a training video sequence. The resulting audio-visual mapping model is then employed to synthesize natural head gestures from arbitrary input test speech given a head model for the speaker. Objective and subjective evaluations indicate that the proposed synthesis by analysis scheme provides natural looking head gestures for the speaker with any input test speech.
Source
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Subject
Acoustics, Computer science
Citation
Has Part
Source
2007 IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol Ii, Pts 1-3