
For FullText PDF, please login, if you are a member of IEICE,
or go to Pay Per View on menu list, if you are a nonmember of IEICE.

What HMMs Can Do
Jeff A. BILMES
Publication
IEICE TRANSACTIONS on Information and Systems
Vol.E89D
No.3
pp.869891 Publication Date: 2006/03/01
Online ISSN: 17451361
DOI: 10.1093/ietisy/e89d.3.869
Print ISSN: 09168532 Type of Manuscript: INVITED PAPER (Special Section on Statistical Modeling for Speech Processing) Category: Keyword: automatic speech recognition, hidden Markov models, HMMs, timeseries processes, handwriting recognition, graphical models, dynamic Bayesian networks, dynamic graphical models, stochastic processes, timeseries densities, bioinformatics,
Full Text: PDF(972.7KB)>>
Summary:
Since their inception almost fifty years ago, hidden Markov models (HMMs) have have become the predominant methodology for automatic speech recognition (ASR) systemstoday, most stateoftheart speech systems are HMMbased. There have been a number of ways to explain HMMs and to list their capabilities, each of these ways having both advantages and disadvantages. In an effort to better understand what HMMs can do, this tutorial article analyzes HMMs by exploring a definition of HMMs in terms of random variables and conditional independence assumptions. We prefer this definition as it allows us to reason more throughly about the capabilities of HMMs. In particular, it is possible to deduce that there are, in theory at least, no limitations to the class of probability distributions representable by HMMs. This paper concludes that, in search of a model to supersede the HMM (say for ASR), rather than trying to correct for HMM limitations in the general case, new models should be found based on their potential for better parsimony, computational requirements, and noise insensitivity.

