Publication: Multimodal speaker identification with audio-video processing
Loading...
Program
Organization Authors
Co-Authors
Date
Language
Embargo Status
No
Journal Title
Journal ISSN
Volume Title
Alternative Title
Abstract
In this paper we present a multimodal audio-visual speaker identification system. The objective is to improve the recognition performance over conventional unimodal schemes. The proposed system decomposes the information existing in a video stream into three components: speech, face texture and lip motion. Lip motion between successive frames is first computed in terms of optical row vectors and then encoded as a feature vector in a magnitude-direction histogram domain. The feature vectors obtained along the whole stream are then interpolated to match the rate of the speech signal and fused with mel frequency cepstral coeffcients (MFCC) of the corresponding speech signal. The resulting joint feature vectors are used to train and test a Hidden Markov Model (HMM) based identification system. Face texture images are treated separately in eigenface domain and integrated to the system through decision-fusion. Experimental results are also included for demonstration of the system performance.
Source
Publisher
Institute of Electrical and Electronics Engineers
Subject
Citation
item.page.haspartof
Source
2003 International Conference on Image Processing, Vol 3, Proceedings
item.page.ispartofseries
item.page.edition
DOI
item.page.datauri
item.page.link
Rights
Other
Copyrights Note
Rights and licensing
Other
Collections
Endorsement
Review
Supplemented By
Referenced By
Google Scholar
Scholar'da Ara ā Bu yayında DOI yok ā Altmetric/Dimensions/PlumX/BIP! rozetleri DOI gerektirir.
