Improving Gradient Methods via Coordinate Transformations: Applications to Quantum Machine Learning

04/13/2023
by   Pablo Bermejo, et al.
0

Machine learning algorithms, both in their classical and quantum versions, heavily rely on optimization algorithms based on gradients, such as gradient descent and alike. The overall performance is dependent on the appearance of local minima and barren plateaus, which slow-down calculations and lead to non-optimal solutions. In practice, this results in dramatic computational and energy costs for AI applications. In this paper we introduce a generic strategy to accelerate and improve the overall performance of such methods, allowing to alleviate the effect of barren plateaus and local minima. Our method is based on coordinate transformations, somehow similar to variational rotations, adding extra directions in parameter space that depend on the cost function itself, and which allow to explore the configuration landscape more efficiently. The validity of our method is benchmarked by boosting a number of quantum machine learning algorithms, getting a very significant improvement in their performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/17/2020

Optimizing parametrized quantum circuits via noise-induced breaking of symmetries

Very little is known about the cost landscape for parametrized Quantum C...
research
06/19/2022

Laziness, Barren Plateau, and Noise in Machine Learning

We define laziness to describe a large suppression of variational parame...
research
09/29/2022

On Quantum Speedups for Nonconvex Optimization via Quantum Tunneling Walks

Classical algorithms are often not effective for solving nonconvex optim...
research
11/17/2019

Solving machine learning optimization problems using quantum computers

Classical optimization algorithms in machine learning often take a long ...
research
10/06/2021

Exponentially Many Local Minima in Quantum Neural Networks

Quantum Neural Networks (QNNs), or the so-called variational quantum cir...
research
04/28/2022

BEINIT: Avoiding Barren Plateaus in Variational Quantum Algorithms

Barren plateaus are a notorious problem in the optimization of variation...
research
10/24/2018

Randomized Gradient Boosting Machine

Gradient Boosting Machine (GBM) introduced by Friedman is an extremely p...

Please sign up or login with your details

Forgot password? Click here to reset