Automatic inference of driving task demand from visual cues of emotion and attention

Soro, Alessandro & Rakotonirainy, Andry (2014) Automatic inference of driving task demand from visual cues of emotion and attention. In Ahram, T., Karwowski, W., & Marek, T. (Eds.) Proceedings of the 5th International Conference on Applied Human Factors and Ergonomics AHFE 2014, Kraków, Poland. (In Press)

[img] Published Version (PDF 245kB)
Available to QUT staff and students only | Request a copy from author


Sensing the mental, physical and emotional demand of a driving task is of primary importance in road safety research and for effectively designing in-vehicle information systems (IVIS). Particularly, the need of cars capable of sensing and reacting to the emotional state of the driver has been repeatedly advocated in the literature. Algorithms and sensors to identify patterns of human behavior, such as gestures, speech, eye gaze and facial expression, are becoming available by using low cost hardware: This paper presents a new system which uses surrogate measures such as facial expression (emotion) and head pose and movements (intention) to infer task difficulty in a driving situation. 11 drivers were recruited and observed in a simulated driving task that involved several pre-programmed events aimed at eliciting emotive reactions, such as being stuck behind slower vehicles, intersections and roundabouts, and potentially dangerous situations. The resulting system, combining face expressions and head pose classification, is capable of recognizing dangerous events (such as crashes and near misses) and stressful situations (e.g. intersections and way giving) that occur during the simulated drive.

Impact and interest:

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 73039
Item Type: Conference Paper
Refereed: Yes
Additional URLs:
Keywords: Affective, Social, Computing, Automotive, in-Vehicle, Emotion, Facial Expression, Head Pose
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > INFORMATION SYSTEMS (080600) > Computer-Human Interaction (080602)
Divisions: Current > Research Centres > Centre for Accident Research & Road Safety - Qld (CARRS-Q)
Past > Schools > Computer Science
Current > QUT Faculties and Divisions > Faculty of Health
Current > Institutes > Institute of Health and Biomedical Innovation
Current > QUT Faculties and Divisions > Science & Engineering Faculty
Current > Schools > School of Psychology & Counselling
Copyright Owner: Copyright 2014 Please consult the authors
Deposited On: 24 Jun 2014 23:19
Last Modified: 06 Sep 2014 02:24

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page