Analysis of JestKOD database using affective state annotations

Abstract

Gesticulation, together with the speech, is an important part of natural and affective human-human interaction. Analysis of gesticulation and speech is expected to help designing more natural human-computer interaction (HCI) systems. We build the JestKOD database, which consists of speech and motion capture recordings of dyadic interactions. In this paper we describe our annotation efforts and present the evaluations that we performed on the annotations of the JestKOD database. These evaluations suggest important findings for usability of the JestKOD database in analysis and modeling of HCI systems.