Statistical language modelling for large vocabulary speech recognition

McGreevy, Michael (2006) Statistical language modelling for large vocabulary speech recognition. Masters by Research thesis, Queensland University of Technology.


The move towards larger vocabulary Automatic Speech Recognition (ASR) systems places greater demands on language models. In a large vocabulary system, acoustic confusion is greater, thus there is more reliance placed on the language model for disambiguation. In addition to this, ASR systems are increasingly being deployed in situations where the speaker is not conscious of their interaction with the system, such as in recorded meetings and surveillance scenarios. This results in more natural speech, which contains many false starts and disfluencies.

In this thesis we investigate a novel approach to the modelling of speech corrections.

We propose a syntactic model of speech corrections, and seek to determine if this model can improve on the performance of standard language modelling approaches when applied to conversational speech. We investigate a number of related variations to our basic approach and compare these approaches against the class-based N-gram.

We also investigate the modelling of styles of speech. Specifically, we investigate whether the incorporation of prior knowledge about sentence types can improve the performance of language models. We propose a sentence mixture model based on word-class N-grams, in which the sentence mixture models and the word-class membership probabilities are jointly trained. We compare this approach with word-based sentence mixture models.

Impact and interest:

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

419 since deposited on 03 Dec 2008
21 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 16444
Item Type: QUT Thesis (Masters by Research)
Supervisor: Sridharan, Subramanian & Mason, Michael
Keywords: language modelling, automatic speech recognition, syntax, grammar, disfluency, sentence mixture model
Divisions: Past > QUT Faculties & Divisions > Faculty of Built Environment and Engineering
Past > Schools > School of Engineering Systems
Department: Faculty of Built Environment and Engineering
Institution: Queensland University of Technology
Copyright Owner: Copyright Michael McGreevy
Deposited On: 03 Dec 2008 04:03
Last Modified: 28 Oct 2011 19:48

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page