SI-Score: An image dataset for fine-grained analysis of robustness to object location, rotation and size

04/09/2021
by   Jessica Yung, et al.
10

Before deploying machine learning models it is critical to assess their robustness. In the context of deep neural networks for image understanding, changing the object location, rotation and size may affect the predictions in non-trivial ways. In this work we perform a fine-grained analysis of robustness with respect to these factors of variation using SI-Score, a synthetic dataset. In particular, we investigate ResNets, Vision Transformers and CLIP, and identify interesting qualitative differences between these.

READ FULL TEXT

page 2

page 4

research
12/10/2014

Object-centric Sampling for Fine-grained Image Classification

This paper proposes to go beyond the state-of-the-art deep convolutional...
research
11/29/2022

Finding Differences Between Transformers and ConvNets Using Counterfactual Simulation Testing

Modern deep neural networks tend to be evaluated on static test sets. On...
research
08/17/2022

Conviformers: Convolutionally guided Vision Transformer

Vision transformers are nowadays the de-facto preference for image class...
research
11/11/2021

Identification of Fine-Grained Location Mentions in Crisis Tweets

Identification of fine-grained location mentions in crisis tweets is cen...
research
09/15/2023

Let's Roll: Synthetic Dataset Analysis for Pedestrian Detection Across Different Shutter Types

Computer vision (CV) pipelines are typically evaluated on datasets proce...
research
06/21/2013

Fine-Grained Visual Classification of Aircraft

This paper introduces FGVC-Aircraft, a new dataset containing 10,000 ima...
research
10/31/2018

Interventional Robustness of Deep Latent Variable Models

The ability to learn disentangled representations that split underlying ...

Please sign up or login with your details

Forgot password? Click here to reset