Analysis and detection of cognitive load and frustration in drivers' speech
Boril, Hynek, Omid Sadjadi, Seyed, Kleinschmidt, Tristan, & Hansen, John H. L. (2010) Analysis and detection of cognitive load and frustration in drivers' speech. In Kobayashi, Takao, Hirose, Keikichi, & Nakamura, Satoshi (Eds.) Proceedings of INTERSPEECH 2010, International Speech Communication Association, Makuhari Messe International Convention Complex, Chiba, Makuhari, Japan, pp. 502-505.
Non-driving related cognitive load and variations of emotional state may impact a driver’s capability to control a vehicle and introduces driving errors. Availability of reliable cognitive load and emotion detection in drivers would benefit the design of active safety systems and other intelligent in-vehicle interfaces. In this study, speech produced by 68 subjects while driving in urban areas is analyzed. A particular focus is on speech production differences in two secondary cognitive tasks, interactions with a co-driver and calls to automated spoken dialog systems (SDS), and two emotional states during the SDS interactions - neutral/negative. A number of speech parameters are found to vary across the cognitive/emotion classes. Suitability of selected cepstral- and production-based features for automatic cognitive task/emotion classification is investigated. A fusion of GMM/SVM classifiers yields an accuracy of 94.3% in cognitive task and 81.3% in emotion classification.
Impact and interest:
Citation counts are sourced monthly from and citation databases.
Citations counts from theindexing service can be viewed at the linked Google Scholar™ search.
|Item Type:||Conference Paper|
|Keywords:||Cognitive Load, Emotions, Speech Production Variations, Automatic Classification, Pattern Recognition|
|ISSN:||1990-9772 Proceedings CD-ROM|
|Subjects:||Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > ARTIFICIAL INTELLIGENCE AND IMAGE PROCESSING (080100) > Pattern Recognition and Data Mining (080109)
Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > INFORMATION SYSTEMS (080600) > Computer-Human Interaction (080602)
Australian and New Zealand Standard Research Classification > ENGINEERING (090000) > ELECTRICAL AND ELECTRONIC ENGINEERING (090600) > Signal Processing (090609)
|Divisions:||Past > QUT Faculties & Divisions > Faculty of Built Environment and Engineering
Past > Institutes > Information Security Institute
Past > Schools > School of Engineering Systems
|Copyright Owner:||Copyright 2010 International Speech Communication Association (INTERSPEECH 2010). [please consult the authors]|
|Copyright Statement:||All rights reserved.|
|Deposited On:||11 Oct 2010 22:55|
|Last Modified:||29 Feb 2012 14:31|
Repository Staff Only: item control page