Dissociating verbal and nonverbal audiovisual object processing

Hocking, Julia & Price, Cathy J. (2009) Dissociating verbal and nonverbal audiovisual object processing. Brain and Language, 108(2), pp. 89-96.

View at publisher

Abstract

This fMRI study investigates how audiovisual integration differs for verbal stimuli that can be matched at a phonological level and nonverbal stimuli that can be matched at a semantic level. Subjects were presented simultaneously with one visual and one auditory stimulus and were instructed to decide whether these stimuli referred to the same object or not. Verbal stimuli were simultaneously presented spoken and written object names, and nonverbal stimuli were photographs of objects simultaneously presented with naturally occurring object sounds. Stimulus differences were controlled by including two further conditions that paired photographs of objects with spoken words and object sounds with written words. Verbal matching, relative to all other conditions, increased activation in a region of the left superior temporal sulcus that has previously been associated with phonological processing. Nonverbal matching, relative to all other conditions, increased activation in a right fusiform region that has previously been associated with structural and conceptual object processing. Thus, we demonstrate how brain activation for audiovisual integration depends on the verbal content of the stimuli, even when stimulus and task processing differences are controlled.

Impact and interest:

20 citations in Scopus
Search Google Scholar™
20 citations in Web of Science®

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 74093
Item Type: Journal Article
Refereed: Yes
Keywords: audiovisual integration, verbal/nonverbal, Auditory Perception, Brain Mapping, Magnetic Resonance Imaging, Reading, Speech Perception/physiology, Visual Perception/*physiology
DOI: 10.1016/j.bandl.2008.10.005
ISSN: 1090-2155
Subjects: Australian and New Zealand Standard Research Classification > MEDICAL AND HEALTH SCIENCES (110000) > NEUROSCIENCES (110900) > Central Nervous System (110903)
Australian and New Zealand Standard Research Classification > PSYCHOLOGY AND COGNITIVE SCIENCES (170000) > COGNITIVE SCIENCE (170200) > Linguistic Processes (incl. Speech Production and Comprehension) (170204)
Divisions: Current > QUT Faculties and Divisions > Faculty of Health
Current > Schools > School of Psychology & Counselling
Copyright Owner: Copyright 2008 Elsevier Inc.
Deposited On: 17 Jul 2014 23:56
Last Modified: 20 Jul 2014 23:37

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page