Fast Sequence Segmentation using Log-Linear Models

02/08/2019
by   Nikolaj Tatti, et al.
0

Sequence segmentation is a well-studied problem, where given a sequence of elements, an integer K, and some measure of homogeneity, the task is to split the sequence into K contiguous segments that are maximally homogeneous. A classic approach to find the optimal solution is by using a dynamic program. Unfortunately, the execution time of this program is quadratic with respect to the length of the input sequence. This makes the algorithm slow for a sequence of non-trivial length. In this paper we study segmentations whose measure of goodness is based on log-linear models, a rich family that contains many of the standard distributions. We present a theoretical result allowing us to prune many suboptimal segmentations. Using this result, we modify the standard dynamic program for one-dimensional log-linear models, and by doing so reduce the computational time. We demonstrate empirically, that this approach can significantly reduce the computational burden of finding the optimal segmentation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/18/2022

Marginal log-linear models and mediation analysis

We review some not well known results about marginal log-linear models, ...
research
05/05/2022

Greedy Clustering-Based Algorithm for Improving Multi-point Robotic Manipulation Sequencing

The problem of optimizing a sequence of tasks for a robot, also known as...
research
05/28/2018

Strongly polynomial efficient approximation scheme for segmentation

Partitioning a sequence of length n into k coherent segments is one of t...
research
08/16/2022

Simple deterministic O(n log n) algorithm finding a solution of Erdős-Ginzburg-Ziv theorem

Erdős-Ginzburg-Ziv theorem is a famous theorem in additive number theory...
research
07/21/2019

Log-linear models independence structure comparison

Log-linear models are a family of probability distributions which captur...
research
07/11/2017

Fast Amortized Inference and Learning in Log-linear Models with Randomly Perturbed Nearest Neighbor Search

Inference in log-linear models scales linearly in the size of output spa...
research
03/22/2022

Dealing with Logs and Zeros in Regression Models

Log-linear models are prevalent in empirical research. Yet, how to handl...

Please sign up or login with your details

Forgot password? Click here to reset