Hyperparameter Importance of Quantum Neural Networks Across Small Datasets

06/20/2022
by   Charles Moussa, et al.
0

As restricted quantum computers are slowly becoming a reality, the search for meaningful first applications intensifies. In this domain, one of the more investigated approaches is the use of a special type of quantum circuit - a so-called quantum neural network – to serve as a basis for a machine learning model. Roughly speaking, as the name suggests, a quantum neural network can play a similar role to a neural network. However, specifically for applications in machine learning contexts, very little is known about suitable circuit architectures, or model hyperparameters one should use to achieve good learning performance. In this work, we apply the functional ANOVA framework to quantum neural networks to analyze which of the hyperparameters were most influential for their predictive performance. We analyze one of the most typically used quantum neural network architectures. We then apply this to 7 open-source datasets from the OpenML-CC18 classification benchmark whose number of features is small enough to fit on quantum hardware with less than 20 qubits. Three main levels of importance were detected from the ranking of hyperparameters obtained with functional ANOVA. Our experiment both confirmed expected patterns and revealed new insights. For instance, setting well the learning rate is deemed the most critical hyperparameter in terms of marginal contribution on all datasets, whereas the particular choice of entangling gates used is considered the least important except on one dataset. This work introduces new methodologies to study quantum machine learning models and provides new insights toward quantum model selection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/10/2022

Hyperparameter optimization of hybrid quantum neural networks for car classification

Image recognition is one of the primary applications of machine learning...
research
02/16/2022

Towards AutoQML: A Cloud-Based Automated Circuit Architecture Search Framework

The learning process of classical machine learning algorithms is tuned b...
research
01/19/2023

Quantum HyperNetworks: Training Binary Neural Networks in Quantum Superposition

Binary neural networks, i.e., neural networks whose parameters and activ...
research
06/26/2020

Can Quantum Computers Learn Like Classical Computers? A Co-Design Framework for Machine Learning and Quantum Circuits

Despite the pursuit of quantum supremacy in various applications, the po...
research
01/29/2016

Quantum perceptron over a field and neural network architecture selection in a quantum computer

In this work, we propose a quantum neural network named quantum perceptr...
research
03/25/2022

High Dimensional Quantum Learning With Small Quantum Computers

Quantum computers hold great promise to enhance machine learning, but th...
research
08/29/2021

CrossedWires: A Dataset of Syntactically Equivalent but Semantically Disparate Deep Learning Models

The training of neural networks using different deep learning frameworks...

Please sign up or login with your details

Forgot password? Click here to reset