Parallel approach to sliding window sums

11/25/2018
by   Roman Snytsar, et al.
0

Sliding window sums are widely used in bioinformatics applications, including sequence assembly, k-mer generation, hashing and compression. New vector algorithms which utilize the advanced vector extension (AVX) instructions available on modern processors, or the parallel compute units on GPUs and FPGAs, would provide a significant performance boost for the bioinformatics applications. We develop a generic vectorized sliding sum algorithm with speedup for window size w and number of processors P is O(P/w) for a generic sliding sum. For a sum with commutative operator the speedup is improved to O(P/log(w)). When applied to the genomic application of minimizer based k-mer table generation using AVX instructions, we obtain a speedup of over 5X. For a family of sliding sums that allow recurrent interpretation we achieve speedup that is independent of w: O(P/log(P)). With ntHash algorithm rewritten using AVX instructions we have observed a speedup close to 3X.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/25/2023

Sliding Window Sum Algorithms for Deep Neural Networks

Sliding window sums are widely used for string indexing, hashing and tim...
research
11/27/2017

Skip-Sliding Window Codes

Constrained coding is used widely in digital communication and storage s...
research
04/16/2019

Almost-Smooth Histograms and Sliding-Window Graph Algorithms

We study algorithms for the sliding-window model, an important variant o...
research
09/29/2022

Low-Latency Sliding Window Algorithms for Formal Languages

Low-latency sliding window algorithms for regular and context-free langu...
research
10/31/2018

Cardinalities estimation under sliding time window by sharing HyperLogLog Counter

Cardinalities estimation is an important research topic in network manag...
research
08/27/2015

Rapid Exact Signal Scanning with Deep Convolutional Neural Networks

A rigorous formulation of the dynamics of a signal processing scheme aim...
research
01/02/2019

The Divide-and-Conquer Framework: A Suitable Setting for the DDM of the Future

This paper was prompted by numerical experiments we performed, in which ...

Please sign up or login with your details

Forgot password? Click here to reset