Examining Joy of Use and Usability During Mobile Phone Interactions within a Multimodal Methods Approach

Abstract

We investigate experienced joy of use (JoU) and usability using a multimodal methods approach by systematically varying mobile phone interactions. We combined subjective and objective measures to investigate whether positive emotional experiences and moments of joy during the interaction can be distinguished from neutral and negative emotional experiences. In a study with 30 participants, electroencephalography (EEG), electrocardiography (ECG), electrodermal activity (EDA), facial emotion recognition, and questionnaires were used.The multimodal methods approach reveals great potential to investigate JoU and usability in naturalistic scenarios. The developed framework provides a groundwork to evaluate and improve interactions with technology. Thereby, users and their emotional experiences are placed at the centre when designing user interfaces. By detecting moments of joy, this approach can support a better understanding of how technology can be purposefully designed for joyful experiences.

M.Sc. Katharina Lingelbach

PhD student, Neuroscientist, and Psychologist (she/her/hers)

My research focuses on interacting neuronal dynamics of emotional and cognitive processes, decoding approaches of neuronal dynamics using machine learning using electrophysiology and neuroimaging methods