Department of Computer EngineeringDepartment of Electrical and Electronics Engineering2024-11-0920030-7803-7965-9N/A2-s2.0-0141590222N/Ahttps://hdl.handle.net/20.500.14288/7831We present a bimodal audio-visual speaker identification system. The objective is to improve the recognition performance over conventional unimodal schemes. The proposed system exploits not only the temporal and spatial correlations existing in the speech and video signals of a speaker, but also the cross-correlation between these two modalities. Lip images extracted from each video frame are transformed onto an eigenspace. The obtained eigenlip coefficients are interpolated to match the rate of the speech signal and fused with Mel frequency cepstral coefficients (MFCC) of the corresponding speech signal. The resulting joint feature vectors are used to train and test a hidden Markov model (HMM) based identification system. Experimental results are included to demonstrate the system performance.Computer scienceArtificial intelligenceEngineeringElectrical and electronic engineeringImaging sciencePhotographic technologyConference proceeding185328600095N/A3996