The Second International Verification of Neural Networks Competition (VNN-COMP 2021): Summary and Results

08/31/2021
by   Stanley Bak, et al.
6

This report summarizes the second International Verification of Neural Networks Competition (VNN-COMP 2021), held as a part of the 4th Workshop on Formal Methods for ML-Enabled Autonomous Systems that was collocated with the 33rd International Conference on Computer-Aided Verification (CAV). Twelve teams participated in this competition. The goal of the competition is to provide an objective comparison of the state-of-the-art methods in neural network verification, in terms of scalability and speed. Along this line, we used standard formats (ONNX for neural networks and VNNLIB for specifications), standard hardware (all tools are run by the organizers on AWS), and tool parameters provided by the tool authors. This report summarizes the rules, benchmarks, participating tools, results, and lessons learned from this competition.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/20/2022

The Third International Verification of Neural Networks Competition (VNN-COMP 2022): Summary and Results

This report summarizes the 3rd International Verification of Neural Netw...
research
01/14/2023

First Three Years of the International Verification of Neural Networks Competition (VNN-COMP)

This paper presents a summary and meta-analysis of the first three itera...
research
03/11/2023

Reproduction Report for SV-COMP 2023

The Competition on Software Verification (SV-COMP) is a large computatio...
research
11/22/2022

CHC-COMP 2022: Competition Report

CHC-COMP 2022 is the fifth edition of the competition of solvers for Con...
research
04/20/2023

SBFT Tool Competition 2023 – Fuzzing Track

This report outlines the objectives, methodology, challenges, and result...
research
08/31/2020

VerifyThis 2019: A Program Verification Competition (Extended Report)

VerifyThis is a series of program verification competitions that emphasi...
research
10/18/2017

The Robust Reading Competition Annotation and Evaluation Platform

The ICDAR Robust Reading Competition (RRC), initiated in 2003 and re-est...

Please sign up or login with your details

Forgot password? Click here to reset