Transfer Learning in Quantum Parametric Classifiers: An Information-Theoretic Generalization Analysis

01/17/2022
by   Sharu Theresa Jose, et al.
0

A key step in quantum machine learning with classical inputs is the design of an embedding circuit mapping inputs to a quantum state. This paper studies a transfer learning setting in which classical-to-quantum embedding is carried out by an arbitrary parametric quantum circuit that is pre-trained based on data from a source task. At run time, the binary classifier is then optimized based on data from the target task of interest. Using an information-theoretic approach, we demonstrate that the average excess risk, or optimality gap, can be bounded in terms of two Rényi mutual information terms between classical input and quantum embedding under source and target tasks, as well as in terms of a measure of similarity between the source and target tasks related to the trace distance. The main theoretical results are validated on a simple binary classification example.

READ FULL TEXT
research
06/11/2023

An information-Theoretic Approach to Semi-supervised Transfer Learning

Transfer learning is a valuable tool in deep learning as it allows propa...
research
02/17/2021

Generalization in Quantum Machine Learning: a Quantum Information Perspective

We study the machine learning problem of generalization when quantum ope...
research
10/13/2020

Information-Theoretic Bounds on Transfer Generalization Gap Based on Jensen-Shannon Divergence

In transfer learning, training and testing data sets are drawn from diff...
research
10/20/2016

Kernel Alignment for Unsupervised Transfer Learning

The ability of a human being to extrapolate previously gained knowledge ...
research
01/11/2020

Parametric Probabilistic Quantum Memory

Probabilistic Quantum Memory (PQM) is a data structure that computes the...
research
05/17/2022

Quantum Transfer Learning for Wi-Fi Sensing

Beyond data communications, commercial-off-the-shelf Wi-Fi devices can b...
research
11/01/2020

An Information-Geometric Distance on the Space of Tasks

This paper computes a distance between tasks modeled as joint distributi...

Please sign up or login with your details

Forgot password? Click here to reset