Aarhus University Seal / Aarhus Universitets segl

Hans Gellersen

AutoBAP: automatic coding of body action and posture units from wearable sensors

Research output: Contribution to book/anthology/report/proceedingArticle in proceedingsResearchpeer-review


Manual annotation of human body movement is an integral part of research on non-verbal communication and computational behaviour analysis but also a very time-consuming and tedious task. In this paper we present AutoBAP, a systemthat automates the coding of bodily expressions according to the body action and posture (BAP) coding scheme. Our system takes continuous body motion and gaze behaviour data as its input. The data is recorded using a full body motion tracking suit and a wearable eye tracker. From the data our system automaticallygenerates a labelled XML file that can be visualised and edited with off-the-shelf video annotation tools. We evaluate our system in a laboratory-based user study with six participants performing scripted sequences of 184 actions. Results from the user study show that our prototype system is able to annotate 172 out of the274 labels of the full BAP coding scheme with good agreement with a manual annotator (Cohen’s kappa > 0.6).
Original languageEnglish
Title of host publicationProceedings of the 5th International Conference on Affective Computing and Intelligent Interaction (ACII’13)
Number of pages6
Publication year2013
ISBN (print)9780769550480
Publication statusPublished - 2013
Externally publishedYes

See relations at Aarhus University Citationformats

ID: 205585675