White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

An integrated approach to emotion recognition for advanced emotional intelligence

Bamidis, Panagiotis D., Frantzidis, Christos A., Konstantinidis, Evdokimos I., Luneski, Andrej, Lithari, Chrysa, Klados, Manousos A., Bratsas, Charalambos , Papadelis , Christos and Pappas, Costas (2009) An integrated approach to emotion recognition for advanced emotional intelligence. In: Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction. 13th International Conference on Human-Computer Interaction, 19-24 July 2009 , San Diego, CA, USA. Lecture Notes in Computer Science (5612/2). Springer , Berlin / Heidelberg , pp. 565-574. ISBN 978-3-642-02579-2

[img] Text

Download (302Kb)


Emotion identification is beginning to be considered as an essential feature in human-computer interaction. However, most of the studies are mainly focused on facial expression classifications and speech recognition and not much attention has been paid until recently to physiological pattern recognition. In this paper, an integrative approach is proposed to emotional interaction by fusing multi-modal signals. Subjects are exposed to pictures selected from the International Affective Picture System (IAPS). A feature extraction procedure is used to discriminate between four affective states by means of a Mahalanobis distance classifier. The average classifications rate (74.11%) was encouraging. Thus, the induced affective state is mirrored through an avatar by changing its facial characteristics and generating a voice message sympathising with the user’s mood. It is argued that multi-physiological patterning in combination with anthropomorphic avatars may contribute to the enhancement of affective multi-modal interfaces and the advancement of machine emotional intelligence..

Item Type: Proceedings Paper
Copyright, Publisher and Additional Information: © Copyright 2009 Springer. This is an author produced version of a paper published in 'Lecuture Notes in Computer Science.' Uploaded in accordance with the publisher's self-archiving policy. The final publication is available at springerlink.com.
Keywords: Emotion, Affective Computing, EEG, Skin Conductance, Avatar, Mahalanobis, classifier
Institution: The University of Sheffield
Academic Units: The University of Sheffield > University of Sheffield Research Centres and Institutes > South East European Research Centre (Sheffield)
Depositing User: Mr Andrej Luneski
Date Deposited: 15 Jul 2010 11:36
Last Modified: 08 Feb 2013 17:00
Published Version: http://dx.doi.org/10.1007/978-3-642-02580-8_62
Status: Published
Publisher: Springer
Refereed: Yes
Identification Number: 10.1007/978-3-642-02580-8
URI: http://eprints.whiterose.ac.uk/id/eprint/11042

Actions (repository staff only: login required)