The effect of prior visual information on recognition of speech and sounds

Noppeney, Uta, Josephs, Oliver, Hocking, Julia, Price, Cathy J., & Friston, Karl J. (2008) The effect of prior visual information on recognition of speech and sounds. Cerebral Cortex, 18(3), pp. 598-609.

View at publisher (open access)


To identify and categorize complex stimuli such as familiar objects or speech, the human brain integrates information that is abstracted at multiple levels from its sensory inputs. Using cross-modal priming for spoken words and sounds, this functional magnetic resonance imaging study identified 3 distinct classes of visuoauditory incongruency effects: visuoauditory incongruency effects were selective for 1) spoken words in the left superior temporal sulcus (STS), 2) environmental sounds in the left angular gyrus (AG), and 3) both words and sounds in the lateral and medial prefrontal cortices (IFS/mPFC). From a cognitive perspective, these incongruency effects suggest that prior visual information influences the neural processes underlying speech and sound recognition at multiple levels, with the STS being involved in phonological, AG in semantic, and mPFC/IFS in higher conceptual processing. In terms of neural mechanisms, effective connectivity analyses (dynamic causal modeling) suggest that these incongruency effects may emerge via greater bottom-up effects from early auditory regions to intermediate multisensory integration areas (i.e., STS and AG). This is consistent with a predictive coding perspective on hierarchical Bayesian inference in the cortex where the domain of the prediction error (phonological vs. semantic) determines its regional expression (middle temporal gyrus/STS vs. AG/intraparietal sulcus).

Impact and interest:

95 citations in Scopus
89 citations in Web of Science®
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 74096
Item Type: Journal Article
Refereed: Yes
Additional Information: Articles free to read on journal website after 12 months
Noppeney, Uta
Josephs, Oliver
Hocking, Julia
Price, Cathy J
Friston, Karl J
082420/Wellcome Trust/United Kingdom
Wellcome Trust/United Kingdom
Comparative Study
Research Support, Non-U.S. Gov't
New York, N.Y. : 1991
2007/07/10 09:00
Cereb Cortex. 2008 Mar;18(3):598-609. Epub 2007 Jul 7.
Keywords: Auditory Perception/physiology, Reaction Time/physiology, Recognition (Psychology)/*physiology, *Sound, Speech/*physiology, Speech Perception/*physiology, Visual Perception/physiology
DOI: 10.1093/cercor/bhm091
ISSN: 1460-2199
Subjects: Australian and New Zealand Standard Research Classification > MEDICAL AND HEALTH SCIENCES (110000) > NEUROSCIENCES (110900) > Central Nervous System (110903)
Australian and New Zealand Standard Research Classification > PSYCHOLOGY AND COGNITIVE SCIENCES (170000) > COGNITIVE SCIENCE (170200) > Linguistic Processes (incl. Speech Production and Comprehension) (170204)
Divisions: Current > QUT Faculties and Divisions > Faculty of Health
Deposited On: 17 Jul 2014 23:50
Last Modified: 22 Jun 2017 01:01

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page