Application-Oriented Benchmarking of Quantum Generative Learning Using QUARK

08/08/2023
by   Florian J. Kiwit, et al.
0

Benchmarking of quantum machine learning (QML) algorithms is challenging due to the complexity and variability of QML systems, e.g., regarding model ansatzes, data sets, training techniques, and hyper-parameters selection. The QUantum computing Application benchmaRK (QUARK) framework simplifies and standardizes benchmarking studies for quantum computing applications. Here, we propose several extensions of QUARK to include the ability to evaluate the training and deployment of quantum generative models. We describe the updated software architecture and illustrate its flexibility through several example applications: (1) We trained different quantum generative models using several circuit ansatzes, data sets, and data transformations. (2) We evaluated our models on GPU and real quantum hardware. (3) We assessed the generalization capabilities of our generative models using a broad set of metrics that capture, e.g., the novelty and validity of the generated data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2022

Evaluating Generalization in Classical and Quantum Generative Models

Defining and accurately measuring generalization in generative models re...
research
07/05/2023

Performance Modeling of Data Storage Systems using Generative Models

High-precision modeling of systems is one of the main areas of industria...
research
08/21/2023

Evaluating quantum generative models via imbalanced data classification benchmarks

A limited set of tools exist for assessing whether the behavior of quant...
research
10/22/2020

Learnability and Complexity of Quantum Samples

Given a quantum circuit, a quantum computer can sample the output distri...
research
08/14/2018

Skill Rating for Generative Models

We explore a new way to evaluate generative models using insights from e...
research
06/06/2021

On Training Sample Memorization: Lessons from Benchmarking Generative Modeling with a Large-scale Competition

Many recent developments on generative models for natural images have re...
research
05/04/2023

Trainability barriers and opportunities in quantum generative modeling

Quantum generative models, in providing inherently efficient sampling st...

Please sign up or login with your details

Forgot password? Click here to reset