MiVOLO: Multi-input Transformer for Age and Gender Estimation

07/10/2023
by   Maksim Kuprashevich, et al.
0

Age and gender recognition in the wild is a highly challenging task: apart from the variability of conditions, pose complexities, and varying image quality, there are cases where the face is partially or completely occluded. We present MiVOLO (Multi Input VOLO), a straightforward approach for age and gender estimation using the latest vision transformer. Our method integrates both tasks into a unified dual input/output model, leveraging not only facial information but also person image data. This improves the generalization ability of our model and enables it to deliver satisfactory results even when the face is not visible in the image. To evaluate our proposed model, we conduct experiments on four popular benchmarks and achieve state-of-the-art performance, while demonstrating real-time processing capabilities. Additionally, we introduce a novel benchmark based on images from the Open Images Dataset. The ground truth annotations for this benchmark have been meticulously generated by human annotators, resulting in high accuracy answers due to the smart aggregation of votes. Furthermore, we compare our model's age recognition performance with human-level accuracy and demonstrate that it significantly outperforms humans across a majority of age ranges. Finally, we grant public access to our models, along with the code for validation and inference. In addition, we provide extra annotations for used datasets and introduce our new benchmark.

READ FULL TEXT

page 1

page 7

page 10

page 11

research
06/21/2021

FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in the Wild

Image-based age estimation aims to predict a person's age from facial im...
research
10/15/2020

FOSS: Multi-Person Age Estimation with Focusing on Objects and Still Seeing Surroundings

Age estimation from images can be used in many practical scenes. Most of...
research
10/09/2017

Age Group and Gender Estimation in the Wild with Deep RoR Architecture

Automatically predicting age group and gender from face images acquired ...
research
05/12/2021

Is Gender "In-the-Wild" Inference Really a Solved Problem?

Soft biometrics analysis is seen as an important research topic, given i...
research
03/29/2016

Face Image Analysis using AAM, Gabor, LBP and WD features for Gender, Age, Expression and Ethnicity Classification

The growth in electronic transactions and human machine interactions rel...
research
02/07/2023

Auditing Gender Presentation Differences in Text-to-Image Models

Text-to-image models, which can generate high-quality images based on te...
research
04/14/2022

Constructing Open Cloze Tests Using Generation and Discrimination Capabilities of Transformers

This paper presents the first multi-objective transformer model for cons...

Please sign up or login with your details

Forgot password? Click here to reset