Impact of cognitive load and frustration on drivers’ speech [Abstract]

Boril, Hynek, Kleinschmidt, Tristan, Boyraz, Pinar, & Hansen, John H. L. (2010) Impact of cognitive load and frustration on drivers’ speech [Abstract]. Journal of the Acoustical Society of America, Vol. 127, no. 3.

Abstract (PDF 1MB)
Submitted Version.

View at publisher


Secondary tasks such as cell phone calls or interaction with automated speech dialog systems (SDSs) increase the driver’s cognitive load as well as the probability of driving errors. This study analyzes speech production variations due to cognitive load and emotional state of drivers in real driving conditions. Speech samples were acquired from 24 female and 17 male subjects (approximately 8.5 h of data) while talking to a co-driver and communicating with two automated call centers, with emotional states (neutral, negative) and the number of necessary SDS query repetitions also labeled. A consistent shift in a number of speech production parameters (pitch, first format center frequency, spectral center of gravity, spectral energy spread, and duration of voiced segments) was observed when comparing SDS interaction against co-driver interaction; further increases were observed when considering negative emotion segments and the number of requested SDS query repetitions. A mel frequency cepstral coefficient based Gaussian mixture classifier trained on 10 male and 10 female sessions provided 91% accuracy in the open test set task of distinguishing co-driver interactions from SDS interactions, suggesting—together with the acoustic analysis—that it is possible to monitor the level of driver distraction directly from their speech.

Impact and interest:

Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

30 since deposited on 24 Mar 2010
2 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 31472
Item Type: Other
Refereed: No
Additional Information: This is an Invited Paper to the 159th ASA Meeting/NOISE-CON 2010 Conference. Only Abstracts are published.
Additional URLs:
Keywords: Speech Dialog Systems, Cognitive Analysis, Vehicular Systems, Speech Production
DOI: 10.1121/1.3385171
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > INFORMATION SYSTEMS (080600) > Computer-Human Interaction (080602)
Australian and New Zealand Standard Research Classification > ENGINEERING (090000) > ELECTRICAL AND ELECTRONIC ENGINEERING (090600) > Signal Processing (090609)
Divisions: Past > QUT Faculties & Divisions > Faculty of Built Environment and Engineering
Past > Institutes > Information Security Institute
Past > Schools > School of Engineering Systems
Copyright Owner: Copyright 2010 [please consult the authors]
Copyright Statement: Reprinted with permission from Journal of the Acoustical Society of America (vol. 127, no. 3). Copyright 2010, Acoustic Society of America.
Deposited On: 24 Mar 2010 23:48
Last Modified: 10 Aug 2011 14:30

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page