Improving visual noise insensitivity in small vocabulary audio visual speech recognition applications

Lucey, Simon, Sridharan, S., & Chandran, Vinod (2001) Improving visual noise insensitivity in small vocabulary audio visual speech recognition applications. In International Symposium on Signal Processing and its Applications (6th : 2001 : Kuala Lumpur, Malaysia), IEEE, Kuala Lumpur, Malaysia, pp. 434-437.

View at publisher


Visual noise insensitivity is important to audio visual speech recognition (AVSR). Visual noise can take on a number of forms such as varying frame rate, occlusion, lighting or speaker variabilities. The use of a high dimensional secondary classifier on the word likelihood scores from both the audio and video modalities is investigated for the purposes of adaptive fusion. Preliminary results are presented demonstrating performance above the catastrophic fusion boundary for our confidence measure irrespective of the type of visual noise presented to it. Our experiments were restricted to small vocabulary applications.

Impact and interest:

0 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 45582
Item Type: Conference Paper
Refereed: No
Additional URLs:
Keywords: adaptive signal processing, audio signal processing, audio-visual systems, random noise, speech recognition, video signal processing, adaptive fusion, audio modality, audio visual speech recognition, catastrophic fusion boundary, high dimensional secondary classifier, small vocabulary, video modality, visual noise insensitivity improvement, word likelihood scores
DOI: 10.1109/ISSPA.2001.950173
ISBN: 0780367030
Divisions: Past > QUT Faculties & Divisions > Faculty of Built Environment and Engineering
Past > Schools > School of Engineering Systems
Copyright Owner: Copyright 2001 IEEE
Copyright Statement: 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Deposited On: 16 Oct 2011 22:41
Last Modified: 16 Oct 2011 22:41

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page