Density Ratio Hidden Markov Models

02/15/2013
by   John A. Quinn, et al.
0

Hidden Markov models and their variants are the predominant sequential classification method in such domains as speech recognition, bioinformatics and natural language processing. Being generative rather than discriminative models, however, their classification performance is a drawback. In this paper we apply ideas from the field of density ratio estimation to bypass the difficult step of learning likelihood functions in HMMs. By reformulating inference and model fitting in terms of density ratios and applying a fast kernel-based estimation method, we show that it is possible to obtain a striking increase in discriminative performance while retaining the probabilistic qualities of the HMM. We demonstrate experimentally that this formulation makes more efficient use of training data than alternative approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/28/2022

On the Sequential Probability Ratio Test in Hidden Markov Models

We consider the Sequential Probability Ratio Test applied to Hidden Mark...
research
01/24/2023

Context-specific kernel-based hidden Markov model for time series analysis

Traditional hidden Markov models have been a useful tool to understand a...
research
05/01/2018

On the Equivalence of Generative and Discriminative Formulations of the Sequential Dependence Model

The sequential dependence model (SDM) is a popular retrieval model which...
research
02/15/2021

Robust Classification using Hidden Markov Models and Mixtures of Normalizing Flows

We test the robustness of a maximum-likelihood (ML) based classifier whe...
research
11/14/2021

On equivalence between linear-chain conditional random fields and hidden Markov chains

Practitioners successfully use hidden Markov chains (HMCs) in different ...
research
11/09/2020

Scaling Hidden Markov Language Models

The hidden Markov model (HMM) is a fundamental tool for sequence modelin...
research
05/28/2021

The Power of Log-Sum-Exp: Sequential Density Ratio Matrix Estimation for Speed-Accuracy Optimization

We propose a model for multiclass classification of time series to make ...

Please sign up or login with your details

Forgot password? Click here to reset