A tutorial on hidden Markov models and selected applications in speech recognition
1989/01/01 by L.R. Rabiner, L. R. Rabiner · 260 citations
Computer Science · #Bayesian Methods and Mixture Models #Speech Recognition and Synthesis #Speech and dialogue systems
paper · doi:10.1109/5.18626
Abstract
This tutorial provides an overview of the basic theory of hidden Markov models (HMMs) as originated by L.E. Baum and T. Petrie (1966) and gives practical details on methods of implementation of the theory along with a description of selected applications of the theory to distinct problems in speech recognition. Results from a number of original sources are combined to provide a single source of acquiring the background required to pursue further this area of research. The author first reviews the theory of discrete Markov chains and shows how the concept of hidden states, where the observation is a probabilistic function of the state, can be used effectively. The theory is illustrated with two simple examples, namely coin-tossing, and the classic balls-in-urns system. Three fundamental problems of HMMs are noted and several practical techniques for solving these problems are given. The various types of HMMs that have been studied, including ergodic as well as left-right models, are described.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">></ETX>
Citations
Cited by
- Motor imagery and direct brain-computer communication
- Far-Field Automatic Speech Recognition
- Planning and acting in partially observable stochastic domains
- Survey of maneuvering target tracking. part v: multiple-model methods
- Understanding the neural code of stress to control anhedonia
- Online Prediction Under Model Uncertainty via Dynamic Model Averaging: Application to a Cold Rolling Mill
- Human action recognition using shape and CLG-motion flow from multi-view image sequences
- Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation
- Propofol-mediated Unconsciousness Disrupts Progression of Sensory Signals through the Cortical Hierarchy
- Two-Step Occupation Coding
- End-to-End Markov State Sequence Learning for Auditory Attention Decoding
- CITRUS: Candidate Inference and Temporal-tracking for Reliable, Unobtrusive Sensing of Wearable Heart Rate under Motion
- Staypoint Detection from Noisy Trajectory Data [Experiment Paper]
- Toward Learning POMDPs Beyond Full-Rank Actions and State Observability
- Robust Assamese Speech Recognition through Controlled Fine-Tuning of Whisper Models
- Synchronization-Free Algebraic Fingerprints for Large Language Models: From Autoregressive to Diffusion Models
- A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computing
- On learning parametric-output HMMs
- Measurement-Level Fusion for OTHR Network Using Message Passing
- An Approach to Track Reading Progression Using Eye-Gaze Fixation Points
- Divergence-Based Motivation for Online EM and Combining Hidden Variable\n Models
- Automating the Analysis of Parsing Algorithms (and other Dynamic Programs)
- Sequential Labeling with online Deep Learning
- Hybrid CTC-Attention based End-to-End Speech Recognition using Subword Units
- Online Segment to Segment Neural Transduction
- Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search
- Neural Particle Smoothing for Sampling from Conditional Sequence Models
- A Unified Adaptive Recoding Framework for Batched Network Coding
- Variational Quantum Conditional Boltzmann Machines for Time-Series Forecasting: Architectures, Symmetric Hyperparameter Evaluation, and a Nonlinear Benchmark
- Model Checking as Control: Feedback Control for Statistical Model Checking of Cyber-Physical Systems
- Multi-Task Learning for Argumentation Mining
- Towards High-Level Semantic Intelligence
- A protein structural alphabet and its substitution matrix CLESUM
- Compositional Behavioral Semantics for State Abstraction in Reinforcement Learning
- Online Adaptive Hidden Markov Model for Multi-Tracker Fusion
- Learning Temporal Logical Properties Discriminating ECG models of Cardiac Arrhytmias
- Classical Music Composition Using State Space Models
- Learning Filter Banks Using Deep Learning For Acoustic Signals
- Exploiting Cross-Lingual Knowledge in Unsupervised Acoustic Modeling for Low-Resource Languages
- A comparison between initialization strategies for the infinite hidden Markov model
- AI Empowered Communication and Radar Modulation Recognition: A Survey
- Modeling Memory-Dependent Reliability of LLMs: A Hidden Markov Model
- Temporal Tessellation: A Unified Approach for Video Analysis
- Provable superior accuracy in machine learned quantum models
- Speaker Recognition -- Wavelet Packet Based Multiresolution Feature Extraction Approach
- A Hidden Quantum Markov model framework for Entanglement and Topological Order in the AKLT Chain
- Adversarial Robustness of Vision in Open Foundation Models
- Packet-Level Traffic Modeling with Heavy-Tailed Payload and Inter-Arrival Distributions for Digital Twins
- Fast estimation of posterior probabilities in change-point models through a constrained hidden Markov model
- Tractable Model for Tunable Non-Markovian Dynamics
- Timing-Error Optimized Architecture for Current-Steering DACs
- Soft state reduction of fuzzy automata over residuated lattices
- Partially Observable Markov Decision Process Framework for Operating Condition Optimization Using Real-Time Degradation Signals
- Markovian language model of the DNA and its information content
- Tagging Grammatical Functions
- Phase-Aware Code-Aided EM Algorithm for Blind Channel Estimation in PSK-Modulated OFDM
- Deep Neural Networks Regularization for Structured Output Prediction
- Comparing Labeled Markov Chains: A Cantor-Kantorovich Approach
- Flexible unimodal density estimation in hidden Markov models
- Segmental Recurrent Neural Networks
- Simulated Human Learning in a Dynamic, Partially-Observed, Time-Series Environment
- Motion2Vec: Semi-Supervised Representation Learning from Surgical Videos
- Kernel Density Estimation-Based Markov Models with Hidden State
- Scale Up Event Extraction Learning via Automatic Training Data Generation
- Exact Computation of Kullback-Leibler Distance for Hidden Markov Trees and Models
- An efficient algorithm for the entropy rate of a hidden Markov model with unambiguous symbols
- Leveraging Recursive Gumbel-Max Trick for Approximate Inference in Combinatorial Spaces
- Hierarchical Semi-Markov Conditional Random Fields for Recursive\n Sequential Data
- Belief Net: A Filter-Based Framework for Learning Hidden Markov Models from Observations
- Multivariate Time series Anomaly Detection:A Framework of Hidden Markov Models
- A Survey of Machine Learning Methods and Challenges for Windows Malware Classification
- Power Constrained Nonstationary Bandits with Habituation and Recovery Dynamics
- Natural Building Blocks for Structured World Models: Theory, Evidence, and Scaling
- Can AI be Accountable?
- Turn-taking cues in task-oriented dialogue
- Tagset Reduction Without Information Loss
- Voice Memory for Agentic Speech Recognition
- A Hidden Markov Model–Inspired Sequence Classification Method for Hyperdimensional Computing
- Survey of Clustering Algorithms
- The dynamics of animal social networks: analytical, conceptual, and theoretical advances
- Signal automata and hidden Markov models
- Non parametric finite translation mixtures with dependent regime
- Edge Detection using Stationary Wavelet Transform, HMM, and EM algorithm
- Delimiting subterritories of the human subthalamic nucleus by means of microelectrode recordings and a Hidden Markov Model
- The expectation-maximization algorithm
- Latent Variable Modeling with Diversity-Inducing Mutual Angular Regularization
- From Newton to Cellular Automata
- Cognitive Radars: On the Road to Reality: Progress Thus Far and Possibilities for the Future
- Dynamic functional connectivity using state-based dynamic community structure: Method and application to opioid analgesia
- A Novel Connectionist System for Unconstrained Handwriting Recognition
- Statistical Learning and Estimation of Piano Fingering
- A Strong Law of Large Numbers for Strongly Mixing Processes
- The Hitchhiker’s guide to nonlinear filtering
- Hidden Markov Process: A New Representation, Entropy Rate and Estimation Entropy
- Identifiability and consistent estimation of nonparametric translation hidden Markov models with general state space
- Noradrenaline tracks emotional modulation of attention in human amygdala
- Estimating migration and mortality rates for European sea bass ( <i>Dicentrarchus labrax</i> ) using electronic tagging data
- Sequential Routing Framework: Fully Capsule Network-based Speech Recognition
- Bayesian Classifier for Route Prediction with Markov Chains
- MCMC for Hierarchical Semi-Markov Conditional Random Fields
- Inferring chromosome segregation error stage and crossover in trisomic disorders with application to Down syndrome
- A Driving Intention Prediction Method Based on Hidden Markov Model for Autonomous Driving
- Bayesian inference of Lévy walks via hidden Markov models
- Does Google Scholar contain all highly cited documents (1950-2013)?
- A hidden Markov model to estimate homozygous-by-descent probabilities associated with nested layers of ancestors
- Protein secondary structure: entropy, correlations and prediction
- Proactive QoE Provisioning in Heterogeneous Access Networks using Hidden Markov Models and Reinforcement Learning
- Analysis of nascent RNA identifies a unified architecture of initiation regions at mammalian promoters and enhancers
- Convolutional Attention-based Seq2Seq Neural Network for End-to-End ASR
- A Preliminary Review of Influential Works in Data-Driven Discovery
- Timbre Analysis of Music Audio Signals with Convolutional Neural\n Networks
- A Dynamic Programming Algorithm for the Fused Lasso and <i>L</i> <sub>0</sub> -Segmentation
- Video Processing from Electro-optical Sensors for Object Detection and Tracking in Maritime Environment: A Survey
- Democracy Manifest or Democracy Latent? A Unified Framework for Identifying Regime Types and Transitions
- Semi-supervised Neural Chord Estimation Based on a Variational Autoencoder with Latent Chord Labels and Features
- A Survey on Principles, Models and Methods for Learning from Irregularly Sampled Time Series
- Viterbi Extraction tutorial with Hidden Markov Toolkit
- Partial Reinitialisation for Optimisers
- Human Activity Recognition based on Dynamic Spatio-Temporal Relations
- Stochastic Variational Inference
- Shaping Belief States with Generative Environment Models for RL
- An empirical evaluation of AMR parsing for legal documents
- How to choose a PIN - assessment of dictionary methods
- The Emergence of Chunking Structures with Hierarchical RNN
- Tagging the Teleman Corpus
- Application of Extended Kalman Filter to Tactical Ballistic Missile Re-entry Problem
- A Bayesian Perspective on Residential Demand Response Using Smart Meter Data
- TrajGATFormer: A Graph-Based Transformer Approach for Worker and Obstacle Trajectory Prediction in Off-site Construction Environments
- Shape-CD: Change-Point Detection in Time-Series Data with Shapes and Neurons
- Finite State Markov Modeling of Fading Channels Towards Decoding of LDPC Codes
- Tibetan Language and AI: A Comprehensive Survey of Resources, Methods and Challenges
- A high-bias, low-variance introduction to Machine Learning for physicists
- Facial expression recognition using active contour-based face detection, facial movement-based feature extraction, and non-linear feature selection
- Runtime Monitoring for Markov Decision Processes
- Mixtures of Sparse Autoregressive Networks
- Sampling First Order Logical Particles
- Analytic Properties of Trackable Weak Models
- Bayesian hidden Markov models for latent variable labeling assignments in conflict research: Application to the role ceasefires play in conflict dynamics
- Estimation of Playable Piano Fingering by Pitch-difference Fingering Matching Model
- Bayesian Nonparametric Dynamical Clustering of Time Series
- How I Built ASR for Endangered Languages with a Spoken Dictionary
- Neural Bayesian Filtering
- Extreme Quantum Advantage when Simulating Strongly Coupled Classical Systems
- Artificial intelligence enables comprehensive genome interpretation and nomination of candidate diagnoses for rare genetic diseases
- Hybrid Modeling for Predicting the Evolution of Premalignant Cervical Squamous Lesions via Intelligent Agents and Deep Neural Networks
- Cyber Conflict as Statecraft: Explaining the Persistence of State-Sponsored Cyber Operations
- Feature Extraction for Temporal Signal Recognition: An Overview
- Rhythm Transcription of Polyphonic Piano Music Based on Merged-Output HMM for Multiple Voices
- Prolonged use of freshwater habitats by the European sea bass revealed by otolith chemical analysis
- A Comprehensive Overview of Recommender System and Sentiment Analysis
- Hidden Markov Model Decoding for LDPC Codes
- Genome-wide inference of ancestral recombination graphs
- Nonparametric inference in hidden Markov models using P-splines
- Stochastic Gradient MCMC Methods for Hidden Markov Models
- Extending finite mixture models with skew-normal distributions and hidden Markov models for time series
- SAGE:State-Aware Guided End-to-End Policy for Multi-Stage Sequential Tasks via Hidden Markov Decision Process
- The LICORS Cabinet: Nonparametric Algorithms for Spatio-temporal Prediction
- Engineering Gesture-Based Authentication Systems
- Strategy Phasing of Cyber Attacks on Digital Substations
- Image recognition of multi-perspective data for intelligent analysis of gestures and actions
- Online EM Algorithm for Hidden Markov Models
- Stochastic motion and transcriptional dynamics of pairs of distal DNA loci on a compacted chromosome
- Joint estimation of insurance loss development factors using Bayesian hidden Markov models
- Bearings Fault Detection Using Hidden Markov Models and Principal Component Analysis Enhanced Features
- Dynamical Wasserstein Barycenters for Time-series Modeling
- Parameter Estimation of Hidden Diffusion Processes: Particle Filter vs. Modified Baum-Welch Algorithm
- On the Generalization Error Bounds of Neural Networks under Diversity-Inducing Mutual Angular Regularization
- Large-Scale Shrinkage Estimation under Markovian Dependence
- Exploring temporal dynamics in digital trace data: mining user-sequences for communication research
- Neural Lattice-to-Sequence Models for Uncertain Inputs
- A Concise Information-Theoretic Derivation of the Baum-Welch algorithm
- Covariance-Corrected WAIC for Bayesian Sequential Data Models
- Joint Semantic Synthesis and Morphological Analysis of the Derived Word
- Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech
- The Viterbi Algorithm: A Personal History
- An end-to-end machine learning system for harmonic analysis of music
- Protein secondary structure prediction based on quintuplets
- Classification Filtering
- GestOS: Advanced Hand Gesture Interpretation via Large Language Models to control Any Type of Robot
- Shapes Characterization on Address Event Representation Using Histograms of Oriented Events and an Extended LBP Approach
- Conditional Chow-Liu Tree Structures for Modeling Discrete-Valued Vector Time Series
- Mixed Membership Models for Time Series
- WaveGuard: Understanding and Mitigating Audio Adversarial Examples
- Diagnosing ADHD from fMRI Scans Using Hidden Markov Models
- State Aware Traffic Generation for Real-Time Network Digital Twins
- Hidden Markov model segmentation of hydrological and enviromental time series
- Affective Movement Generation using Laban Effort and Shape and Hidden\n Markov Models
- Neural Predictive Belief Representations
- Statistical Piano Reduction Controlling Performance Difficulty
- The Factored Frontier Algorithm for Approximate Inference in DBNs
- GCN-TULHOR: Trajectory-User Linking Leveraging GCNs and Higher-Order Spatial Representations
- Design and accuracy trade-offs in Computational Statistics
- An HMM-based framework for identity-aware long-term multi-object tracking from sparse and uncertain identification: use case on long-term tracking in livestock
- A Data-Driven CO2 Leakage Detection Using Seismic Data and Spatial-Temporal Densely Connected Convolutional Neural Networks
- Optimal Immunization Policy Using Dynamic Programming
- Reinforcement Learning with Partially Known World Dynamics
- PALMAR: Towards Adaptive Multi-inhabitant Activity Recognition in\n Point-Cloud Technology
- An introduction to quantum machine learning
- Physics-Informed Detection of Friction Anomalies in Satellite Reaction Wheels
- An Overview of Lead and Accompaniment Separation in Music
- Time Series Classification using the Hidden-Unit Logistic Model
- Text-to-Image Generation Grounded by Fine-Grained User Attention
- Automatic Screening of Parkinson's Disease from Visual Explorations
- Lifted Graphical Models: A Survey
- Automatic Music Accompanist
- SparseMAP: Differentiable Sparse Structured Inference
- Differentiable Weighted Finite-State Transducers
- Interestingness First Classifiers
- An Introduction to Silent Paralinguistics
- Graphical models for inferring single molecule dynamics
- Graphical model approximations of random finite set filters
- An Acoustic Segment Model Based Segment Unit Selection Approach to Acoustic Scene Classification with Partial Utterances
- Models with varying structure
- Exploring RNN-Transducer for Chinese Speech Recognition
- Boltzmann Exploration Expectation-Maximisation
- Parts of Speech Tagging in NLP: Runtime Optimization with Quantum Formulation and ZX Calculus
- Effects of a scientific echo sounder on the behavior of short-finned pilot whales (<i>Globicephala macrorhynchus</i>)
- Correlative Channel-Aware Fusion for Multi-View Time Series Classification
- Far-Field Automatic Speech Recognition
- Sato: Contextual Semantic Type Detection in Tables
- Hidden Markov Model for Inferring Learner Task Using Mouse Movement
- Capturing spatial interdependence in image features: the counting grid,\n an epitomic representation for bags of features
- MEDIC: Medical embedded device for individualized care
- A Bayesian Hidden Semi-Markov Model with Covariate-Dependent State Duration Parameters for High-Frequency Environmental Data
- Visual Recognition of Isolated Swedish Sign Language Signs
- Identity Testing for Stochastic Languages
- Modelling Stochastic Inflow Patterns to a Reservoir with a Hidden Phase-Type Markov Model
- Maximum likelihood analysis of non-equilibrium solution-based\n single-molecule FRET data
- A Hidden Absorbing Semi-Markov Model for Informatively Censored Temporal Data: Learning and Inference
- Seeing More with Less: Video Capsule Endoscopy with Multi-Task Learning
- Consistent estimation of the filtering and marginal smoothing\n distributions in nonparametric hidden Markov models
- Regime Switching Volatility Calibration by the Baum-Welch Method
- Adaptive BSTs for Single-Source and All-to-All Requests: Algorithms and Lower Bounds
- Forward–backward algorithm [wikipedia]
- Forward algorithm [wikipedia]
- A memory-efficient dynamic programming algorithm for optimal alignment of a sequence to an RNA secondary structure. [europepmc]
- HMM Logos for visualization of protein families. [europepmc]
- Whole genome DNA copy number changes identified by high density oligonucleotide arrays. [europepmc]
- Lineage-specific expansion of proteins exported to erythrocytes in malaria parasites. [europepmc]
- Shape-IT: new rapid and accurate algorithm for haplotype inference. [europepmc]
- Extensive linkage disequilibrium and parallel adaptive divergence across threespine stickleback genomes. [europepmc]
- T-cell epitope vaccine design by immunoinformatics. [europepmc]
- Determination of parameter identifiability in nonlinear biophysical models: A Bayesian approach. [europepmc]
- fNIRS-based brain-computer interfaces: a review. [europepmc]
- Dynamics of multistable states during ongoing and evoked cortical activity. [europepmc]
- Brain-to-text: decoding spoken phrases from phone representations in the brain. [europepmc]
- Normative evidence accumulation in unpredictable environments. [europepmc]
- Genetic properties of the MAGIC maize population: a new platform for high definition QTL mapping in Zea mays. [europepmc]
- Congruent Visual Speech Enhances Cortical Entrainment to Continuous Auditory Speech in Noise-Free Conditions. [europepmc]
- Physical Human Activity Recognition Using Wearable Sensors. [europepmc]
- Gait Partitioning Methods: A Systematic Review. [europepmc]
- Brain-wide mapping of neural activity controlling zebrafish exploratory locomotion. [europepmc]
- Comprehensive Essentiality Analysis of the Mycobacterium tuberculosis Genome via Saturating Transposon Mutagenesis. [europepmc]
- PureCLIP: capturing target-specific protein-RNA interaction footprints from single-nucleotide CLIP-seq data. [europepmc]
- hmmIBD: software to infer pairwise identity by descent between haploid genotypes. [europepmc]
- Spontaneous cortical activity transiently organises into frequency specific phase-coupling networks. [europepmc]
- Real-time decoding of question-and-answer speech dialogue using human cortical activity. [europepmc]
- A practical introduction to sequentially Markovian coalescent methods for estimating demographic history from genomic data. [europepmc]
- Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review. [europepmc]
- Genotype imputation using the Positional Burrows Wheeler Transform. [europepmc]
Related