MetH: A family of high-resolution and variable-shape image challenges

11/20/2019
by   Ferran Parés Pont, et al.
3

High-resolution and variable-shape images have not yet been properly addressed by the AI community. The approach of down-sampling data often used with convolutional neural networks is sub-optimal for many tasks, and has too many drawbacks to be considered a sustainable alternative. In sight of the increasing importance of problems that can benefit from exploiting high-resolution (HR) and variable-shape, and with the goal of promoting research in that direction, we introduce a new family of datasets (MetH). The four proposed problems include two image classification, one image regression and one super resolution task. Each of these datasets contains thousands of art pieces captured by HR and variable-shape images, labeled by experts at the Metropolitan Museum of Art. We perform an analysis, which shows how the proposed tasks go well beyond current public alternatives in both pixel size and aspect ratio variance. At the same time, the performance obtained by popular architectures on these tasks shows that there is ample room for improvement. To wrap up the relevance of the contribution we review the fields, both in AI and high-performance computing, that could benefit from the proposed challenges.

READ FULL TEXT

page 1

page 3

page 4

research
09/29/2021

The MAMe Dataset: On the relevance of High Resolution and Variable Shape image properties

In the image classification task, the most common approach is to resize ...
research
07/27/2020

A Closer Look at Art Mediums: The MAMe Image Classification Dataset

Art is an expression of human creativity, skill and technology. An excep...
research
02/27/2018

3D Object Super-Resolution

We consider the problem of scaling deep generative shape models to high-...
research
01/25/2022

Revisiting L1 Loss in Super-Resolution: A Probabilistic View and Beyond

Super-resolution as an ill-posed problem has many high-resolution candid...
research
04/10/2018

Large Field and High Resolution: Detecting Needle in Haystack

The growing use of convolutional neural networks (CNN) for a broad range...
research
11/06/2020

Augmented Equivariant Attention Networks for Electron Microscopy Image Super-Resolution

Taking electron microscopy (EM) images in high-resolution is time-consum...
research
04/13/2021

Aliasing is your Ally: End-to-End Super-Resolution from Raw Image Bursts

This presentation addresses the problem of reconstructing a high-resolut...

Please sign up or login with your details

Forgot password? Click here to reset