Automated Spectral Kernel Learning

09/11/2019
by   Jian Li, et al.
0

The generalization performance of kernel methods is largely determined by the kernel, but common kernels are stationary thus input-independent and output-independent, that limits their applications on complicated tasks. In this paper, we propose a powerful and efficient spectral kernel learning framework and learned kernels are dependent on both inputs and outputs, by using non-stationary spectral kernels and flexibly learning the spectral measure from the data. Further, we derive a data-dependent generalization error bound based on Rademacher complexity, which estimates the generalization ability of the learning framework and suggests two regularization terms to improve performance. Extensive experimental results validate the effectiveness of the proposed algorithm and confirm our theoretical results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/28/2020

Convolutional Spectral Kernel Learning

Recently, non-stationary spectral kernels have drawn much attention, owi...
research
10/10/2018

Harmonizable mixture kernels with variational Fourier features

The expressive power of Gaussian processes depends heavily on the choice...
research
10/22/2020

Label-Aware Neural Tangent Kernel: Toward Better Generalization and Local Elasticity

As a popular approach to modeling the dynamics of training overparametri...
research
04/13/2021

Towards Unbiased Random Features with Lower Variance For Stationary Indefinite Kernels

Random Fourier Features (RFF) demonstrate wellappreciated performance in...
research
04/21/2022

Provably Efficient Kernelized Q-Learning

We propose and analyze a kernelized version of Q-learning. Although a ke...
research
03/14/2019

Low-rank Kernel Learning for Graph-based Clustering

Constructing the adjacency graph is fundamental to graph-based clusterin...
research
10/05/2022

Spectral Regularization Allows Data-frugal Learning over Combinatorial Spaces

Data-driven machine learning models are being increasingly employed in s...

Please sign up or login with your details

Forgot password? Click here to reset