Recursive Multikernel Filters Exploiting Nonlinear Temporal Structure

06/12/2017
by   Steven Van Vaerenbergh, et al.
0

In kernel methods, temporal information on the data is commonly included by using time-delayed embeddings as inputs. Recently, an alternative formulation was proposed by defining a gamma-filter explicitly in a reproducing kernel Hilbert space, giving rise to a complex model where multiple kernels operate on different temporal combinations of the input signal. In the original formulation, the kernels are then simply combined to obtain a single kernel matrix (for instance by averaging), which provides computational benefits but discards important information on the temporal structure of the signal. Inspired by works on multiple kernel learning, we overcome this drawback by considering the different kernels separately. We propose an efficient strategy to adaptively combine and select these kernels during the training phase. The resulting batch and online algorithms automatically learn to process highly nonlinear temporal information extracted from the input signal, which is implicitly encoded in the kernel values. We evaluate our proposal on several artificial and real tasks, showing that it can outperform classical approaches both in batch and online settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/19/2023

An Online Multiple Kernel Parallelizable Learning Scheme

The performance of reproducing kernel Hilbert space-based methods is kno...
research
01/07/2016

Learning Kernels for Structured Prediction using Polynomial Kernel Transformations

Learning the kernel functions used in kernel methods has been a vastly e...
research
09/11/2020

A kernel function for Signal Temporal Logic formulae

We discuss how to define a kernel for Signal Temporal Logic (STL) formul...
research
03/31/2021

Symmetric and antisymmetric kernels for machine learning problems in quantum physics and chemistry

We derive symmetric and antisymmetric kernels by symmetrizing and antisy...
research
02/11/2018

Learning Multiple Levels of Representations with Kernel Machines

We propose a connectionist-inspired kernel machine model with three key ...
research
11/21/2013

A Unified SVM Framework for Signal Estimation

This paper presents a unified framework to tackle estimation problems in...
research
05/22/2020

Arbitrary-sized Image Training and Residual Kernel Learning: Towards Image Fraud Identification

Preserving original noise residuals in images are critical to image frau...

Please sign up or login with your details

Forgot password? Click here to reset