Gestural interaction in the kitchen: insights into designing an interactive display controlled by hand specific on-skin gestures

Abstract

The kitchen is one of the busiest and messiest hubs of a home, where the hands are usually spoiled with food. In this setting, gestural interaction can offer several advantages: efficient, intuitive, and touch-free orchestration of interactive devices. Yet, research scarcely investigates the user's perspective on gesture-based systems in the kitchen and lacks designs developed through a user-centred process. With the contribution of 234 participants, we conducted formative studies that investigated users' expectations, perceived benefits, and concerns of gesture-based control in the kitchen. These studies guided our conceptual design '2HandTouch', an information display controlled by Hand Specific On-Skin Gestures (HSoS). Then, we evaluated the user experience of this design through a summative user study. We introduced four perceived benefits of HSoS use in the kitchen that has not been visible in such detail. These are i) hygiene, (ii) time management, (iii) imminent control, and (iv) an uninterrupted cooking practice. We also provided broader implications of our work for designing gesture-controlled devices in the kitchen context.