Exploring object-centric and scene-centric CNN features and their complementarity for human rights violations recognition in images

05/12/2018
by   Grigorios Kalliatakis, et al.
0

Identifying potential abuses of human rights through imagery is a novel and challenging task in the field of computer vision, that will enable to expose human rights violations over large-scale data that may otherwise be impossible. While standard databases for object and scene categorisation contain hundreds of different classes, the largest available dataset of human rights violations contains only 4 classes. Here, we introduce the `Human Rights Archive Database' (HRA), a verified-by-experts repository of 3050 human rights violations photographs, labelled with human rights semantic categories, comprising a list of the types of human rights abuses encountered at present. With the HRA dataset and a two-phase transfer learning scheme, we fine-tuned the state-of-the-art deep convolutional neural networks (CNNs) to provide human rights violations classification CNNs (HRA-CNNs). We also present extensive experiments refined to evaluate how well object-centric and scene-centric CNN features can be combined for the task of recognising human rights abuses. With this, we show that HRA database poses a challenge at a higher level for the well studied representation learning methods, and provide a benchmark in the task of human rights violations recognition in visual context. We expect this dataset can help to open up new horizons on creating systems able of recognising rich information about human rights violations. Our dataset, codes and trained models are available online at https://github.com/GKalliatakis/Human-Rights-Archive-CNNs.

READ FULL TEXT

page 3

page 7

page 12

page 13

page 15

research
09/05/2019

Semantic-Aware Scene Recognition

Scene recognition is currently one of the top-challenging research field...
research
10/06/2016

Places: An Image Database for Deep Scene Understanding

The rise of multi-million-item dataset initiatives has enabled data-hung...
research
06/03/2015

Understanding deep features with computer-generated imagery

We introduce an approach for analyzing the variation of features generat...
research
12/04/2015

Toward a Taxonomy and Computational Models of Abnormalities in Images

The human visual system can spot an abnormal image, and reason about wha...
research
02/11/2019

GET-AID: Visual Recognition of Human Rights Abuses via Global Emotional Traits

In the era of social media and big data, the use of visual evidence to d...
research
05/09/2020

Human in Events: A Large-Scale Benchmark for Human-centric Video Analysis in Complex Events

Along with the development of the modern smart city, human-centric video...
research
07/21/2022

Human-centric Image Cropping with Partition-aware and Content-preserving Features

Image cropping aims to find visually appealing crops in an image, which ...

Please sign up or login with your details

Forgot password? Click here to reset