Faces in the Wild: Efficient Gender Recognition in Surveillance Conditions

07/14/2021
by   Tiago Roxo, et al.
0

Soft biometrics inference in surveillance scenarios is a topic of interest for various applications, particularly in security-related areas. However, soft biometric analysis is not extensively reported in wild conditions. In particular, previous works on gender recognition report their results in face datasets, with relatively good image quality and frontal poses. Given the uncertainty of the availability of the facial region in wild conditions, we consider that these methods are not adequate for surveillance settings. To overcome these limitations, we: 1) present frontal and wild face versions of three well-known surveillance datasets; and 2) propose a model that effectively and dynamically combines facial and body information, which makes it suitable for gender recognition in wild conditions. The frontal and wild face datasets derive from widely used Pedestrian Attribute Recognition (PAR) sets (PETA, PA-100K, and RAP), using a pose-based approach to filter the frontal samples and facial regions. This approach retrieves the facial region of images with varying image/subject conditions, where the state-of-the-art face detectors often fail. Our model combines facial and body information through a learnable fusion matrix and a channel-attention sub-network, focusing on the most influential body parts according to the specific image/subject features. We compare it with five PAR methods, consistently obtaining state-of-the-art results on gender recognition, and reducing the prediction errors by up to 24 in frontal samples. The announced PAR datasets versions and model serve as the basis for wild soft biometrics classification and are available in https://github.com/Tiago-Roxo.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

page 8

research
05/12/2021

Is Gender "In-the-Wild" Inference Really a Solved Problem?

Soft biometrics analysis is seen as an important research topic, given i...
research
10/24/2022

Facial Soft Biometrics for Recognition in the Wild: Recent Works, Annotation, and COTS Evaluation

The role of soft biometrics to enhance person recognition systems in unc...
research
06/13/2017

AFIF4: Deep Gender Classification based on AdaBoost-based Fusion of Isolated Facial Features and Foggy Faces

Gender classification aims at recognizing a person's gender. Despite the...
research
04/02/2020

An Attention-Based Deep Learning Model for Multiple Pedestrian Attributes Recognition

The automatic characterization of pedestrians in surveillance footage is...
research
10/31/2021

From Face to Gait: Weakly-Supervised Learning of Gender Information from Walking Patterns

Obtaining demographics information from video is valuable for a range of...
research
03/09/2023

WASD: A Wilder Active Speaker Detection Dataset

Current Active Speaker Detection (ASD) models achieve great results on A...
research
01/27/2020

Unconstrained Biometric Recognition: Summary of Recent SOCIA Lab. Research

The development of biometric recognition solutions able to work in visua...

Please sign up or login with your details

Forgot password? Click here to reset