Multi-Task Kernel Null-Space for One-Class Classification

The one-class kernel spectral regression (OC-KSR), the regression-based formulation of the kernel null-space approach has been found to be an effective Fisher criterion-based methodology for one-class classification (OCC), achieving state-of-the-art performance in one-class classification while providing relatively high robustness against data corruption. This work extends the OC-KSR methodology to a multi-task setting where multiple one-class problems share information for improved performance. By viewing the multi-task structure learning problem as one of compositional function learning, first, the OC-KSR method is extended to learn multiple tasks' structure linearly by posing it as an instantiation of the separable kernel learning problem in a vector-valued reproducing kernel Hilbert space where an output kernel encodes tasks' structure while another kernel captures input similarities. Next, a non-linear structure learning mechanism is proposed which captures multiple tasks' relationships non-linearly via an output kernel. The non-linear structure learning method is then extended to a sparse setting where different tasks compete in an output composition mechanism, leading to a sparse non-linear structure among multiple problems. Through extensive experiments on different data sets, the merits of the proposed multi-task kernel null-space techniques are verified against the baseline as well as other existing multi-task one-class learning techniques.

READ FULL TEXT

page 1

page 9

page 10

research
02/06/2019

Robust One-Class Kernel Spectral Regression

The kernel null-space technique and its regression-based formulation (ca...
research
08/19/2020

ℓ_p-Norm Multiple Kernel One-Class Fisher Null-Space

The paper addresses the multiple kernel learning (MKL) problem for one-c...
research
11/18/2015

Efficient Output Kernel Learning for Multiple Tasks

The paradigm of multi-task learning is that one can achieve better gener...
research
04/13/2015

Learning Multiple Visual Tasks while Discovering their Structure

Multi-task learning is a natural approach for computer vision applicatio...
research
08/20/2020

No-regret Algorithms for Multi-task Bayesian Optimization

We consider multi-objective optimization (MOO) of an unknown vector-valu...
research
05/01/2022

Generalized Reference Kernel for One-class Classification

In this paper, we formulate a new generalized reference kernel hoping to...
research
09/23/2014

A non-linear learning & classification algorithm that achieves full training accuracy with stellar classification accuracy

A fast Non-linear and non-iterative learning and classification algorith...

Please sign up or login with your details

Forgot password? Click here to reset