Impact of cognitive load and frustration on drivers’ speech [Abstract]
Boril, Hynek, Kleinschmidt, Tristan, Boyraz, Pinar, & Hansen, John H. L. (2010) Impact of cognitive load and frustration on drivers’ speech [Abstract]. Journal of the Acoustical Society of America, Vol. 127, no. 3.
Secondary tasks such as cell phone calls or interaction with automated speech dialog systems (SDSs) increase the driver’s cognitive load as well as the probability of driving errors. This study analyzes speech production variations due to cognitive load and emotional state of drivers in real driving conditions. Speech samples were acquired from 24 female and 17 male subjects (approximately 8.5 h of data) while talking to a co-driver and communicating with two automated call centers, with emotional states (neutral, negative) and the number of necessary SDS query repetitions also labeled. A consistent shift in a number of speech production parameters (pitch, first format center frequency, spectral center of gravity, spectral energy spread, and duration of voiced segments) was observed when comparing SDS interaction against co-driver interaction; further increases were observed when considering negative emotion segments and the number of requested SDS query repetitions. A mel frequency cepstral coefficient based Gaussian mixture classifier trained on 10 male and 10 female sessions provided 91% accuracy in the open test set task of distinguishing co-driver interactions from SDS interactions, suggesting—together with the acoustic analysis—that it is possible to monitor the level of driver distraction directly from their speech.
Impact and interest:
Citation counts are sourced monthly from and citation databases.
Citations counts from theindexing service can be viewed at the linked Google Scholar™ search.
|Additional Information:||This is an Invited Paper to the 159th ASA Meeting/NOISE-CON 2010 Conference. Only Abstracts are published.|
|Keywords:||Speech Dialog Systems, Cognitive Analysis, Vehicular Systems, Speech Production|
|Subjects:||Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > INFORMATION SYSTEMS (080600) > Computer-Human Interaction (080602)
Australian and New Zealand Standard Research Classification > ENGINEERING (090000) > ELECTRICAL AND ELECTRONIC ENGINEERING (090600) > Signal Processing (090609)
|Divisions:||Past > QUT Faculties & Divisions > Faculty of Built Environment and Engineering
Past > Institutes > Information Security Institute
Past > Schools > School of Engineering Systems
|Copyright Owner:||Copyright 2010 [please consult the authors]|
|Copyright Statement:||Reprinted with permission from Journal of the Acoustical Society of America (vol. 127, no. 3). Copyright 2010, Acoustic Society of America.|
|Deposited On:||24 Mar 2010 23:48|
|Last Modified:||10 Aug 2011 14:30|
Repository Staff Only: item control page