Department of Computer EngineeringDepartment of Electrical and Electronics Engineering2024-11-0920071520-6149N/A2-s2.0-34547506366https://hdl.handle.net/20.500.14288/11074We present a new framework for joint analysis of head gesture and speech prosody patterns of a speaker towards automatic realistic synthesis of head gestures from speech prosody. The proposed two-stage analysis aims to "learn" both elementary prosody and head gesture patterns for a particular speaker, as well as the correlations between these head gesture and prosody patterns from a training video sequence. The resulting audio-visual mapping model is then employed to synthesize natural head gestures from arbitrary input test speech given a head model for the speaker. Objective and subjective evaluations indicate that the proposed synthesis by analysis scheme provides natural looking head gestures for the speaker with any input test speech.AcousticsComputer scienceConference proceeding248908100170N/A7237