Analysis and detection of cognitive load and frustration in drivers' speech

Boril, Hynek, Omid Sadjadi, Seyed, Kleinschmidt, Tristan, & Hansen, John H. L. (2010) Analysis and detection of cognitive load and frustration in drivers' speech. In Kobayashi, Takao, Hirose, Keikichi, & Nakamura, Satoshi (Eds.) Proceedings of INTERSPEECH 2010, International Speech Communication Association, Makuhari Messe International Convention Complex, Chiba, Makuhari, Japan, pp. 502-505.

View at publisher


Non-driving related cognitive load and variations of emotional state may impact a driver’s capability to control a vehicle and introduces driving errors. Availability of reliable cognitive load and emotion detection in drivers would benefit the design of active safety systems and other intelligent in-vehicle interfaces. In this study, speech produced by 68 subjects while driving in urban areas is analyzed. A particular focus is on speech production differences in two secondary cognitive tasks, interactions with a co-driver and calls to automated spoken dialog systems (SDS), and two emotional states during the SDS interactions - neutral/negative. A number of speech parameters are found to vary across the cognitive/emotion classes. Suitability of selected cepstral- and production-based features for automatic cognitive task/emotion classification is investigated. A fusion of GMM/SVM classifiers yields an accuracy of 94.3% in cognitive task and 81.3% in emotion classification.

Impact and interest:

8 citations in Scopus
13 citations in Web of Science®
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

314 since deposited on 11 Oct 2010
43 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 33168
Item Type: Conference Paper
Refereed: Yes
Keywords: Cognitive Load, Emotions, Speech Production Variations, Automatic Classification, Pattern Recognition
ISSN: 1990-9772 Proceedings CD-ROM
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > ARTIFICIAL INTELLIGENCE AND IMAGE PROCESSING (080100) > Pattern Recognition and Data Mining (080109)
Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > INFORMATION SYSTEMS (080600) > Computer-Human Interaction (080602)
Australian and New Zealand Standard Research Classification > ENGINEERING (090000) > ELECTRICAL AND ELECTRONIC ENGINEERING (090600) > Signal Processing (090609)
Divisions: Past > QUT Faculties & Divisions > Faculty of Built Environment and Engineering
Past > Institutes > Information Security Institute
Copyright Owner: Copyright 2010 International Speech Communication Association (INTERSPEECH 2010). [please consult the authors]
Copyright Statement: All rights reserved.
Deposited On: 11 Oct 2010 22:55
Last Modified: 28 Jun 2017 14:42

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page