Novel Long Short-Term Memory Cell Architectures: Application to Light Field Face Recognition

05/11/2019
by   Alireza Sepas-Moghaddam, et al.
0

With the emergence of lenslet light field cameras able to capture rich spatio-angular information from multiple directions, new frontiers in visual recognition performance have been opened. Since multiple 2D viewpoint images can be rendered from a light field, those multiple images, or descriptions extracted from them, can be organized as a pseudo-video sequence so that a LSTM network learns a model describing that sequence. This paper proposes three novel LSTM cell architectures able to create richer and more effective description models for visual recognition tasks, by jointly learning from two sequences simultaneously acquired. The novel key idea is to jointly process two sequences of rendered 2D images or their descriptions, e.g. representing the scene horizontal and vertical parallaxes, and thus with some specific dependency between them, that would not be exploited otherwise. To show the efficiency of the novel LSTM cell architectures, these architectures have been integrated into an end-to-end deep learning face recognition framework, which creates this join spatio-angular light field description. The LSTM network, using the proposed LSTM cell architectures, receives as input a sequence of VGG-Face descriptions computed for parallax related, horizontal and vertical 2D face viewpoint images, derived from the input light field image. A comprehensive evaluation in terms of recognition accuracy, computational complexity, memory efficiency, and parallelization ability has been performed with the IST EURECOM LFFD database using three new and challenging evaluation protocols. The obtained results show the superior performance of the proposed face recognition solutions adopting the novel LSTM cell architectures over ten state-of-the-art benchmarking recognition solutions.

READ FULL TEXT
research
05/25/2018

A Double-Deep Spatio-Angular Learning Framework for Light Field based Face Recognition

Face recognition has attracted increasing attention due to its wide rang...
research
05/06/2021

Multi-Perspective LSTM for Joint Visual Representation Learning

We present a novel LSTM cell architecture capable of learning both intra...
research
01/10/2021

CapsField: Light Field-based Face and Expression Recognition in the Wild using Capsule Routing

Light field (LF) cameras provide rich spatio-angular visual representati...
research
04/26/2019

Recurrent Embedding Aggregation Network for Video Face Recognition

Recurrent networks have been successful in analyzing temporal data and h...
research
01/03/2019

Face Recognition: A Novel Multi-Level Taxonomy based Survey

In a world where security issues have been gaining growing importance, f...
research
06/10/2020

Unique Faces Recognition in Videos

This paper tackles face recognition in videos employing metric learning ...
research
11/22/2018

The typical cell in anisotropic tessellations

The typical cell is a key concept for stochastic-geometry based modeling...

Please sign up or login with your details

Forgot password? Click here to reset