Slices of Attention in Asynchronous Video Job Interviews

by   Léo Hemamou, et al.

The impact of non verbal behaviour in a hiring decision remains an open question. Investigating this question is important, as it could provide a better understanding on how to train candidates for job interviews and make recruiters be aware of influential non verbal behaviour. This research has recently been accelerated due to the development of tools for the automatic analysis of social signals, and the emergence of machine learning methods. However, these studies are still mainly based on hand engineered features, which imposes a limit to the discovery of influential social signals. On the other side, deep learning methods are a promising tool to discover complex patterns without the necessity of feature engineering. In this paper, we focus on studying influential non verbal social signals in asynchronous job video interviews that are discovered by deep learning methods. We use a previously published deep learning system that aims at inferring the hirability of a candidate with regard to a sequence of interview questions. One particularity of this system is the use of attention mechanisms, which aim at identifying the relevant parts of an answer. Thus, information at a fine-grained temporal level could be extracted using global (at the interview level) annotations on hirability. While most of the deep learning systems use attention mechanisms to offer a quick visualization of slices when a rise of attention occurs, we perform an in-depth analysis to understand what happens during these moments. First, we propose a methodology to automatically extract slices where there is a rise of attention (attention slices). Second, we study the content of attention slices by comparing them with randomly sampled slices. Finally, we show that they bear significantly more information for hirability than randomly sampled slices.


page 1

page 2


HireNet: a Hierarchical Attention Model for the Automatic Analysis of Asynchronous Video Job Interviews

New technologies drastically change recruitment techniques. Some researc...

Learning Slice-Aware Representations with Mixture of Attentions

Real-world machine learning systems are achieving remarkable performance...

Reconstruction of 3D Porous Media From 2D Slices

We propose a novel deep learning architecture for three-dimensional poro...

A Hierarchical Reasoning Graph Neural Network for The Automatic Scoring of Answer Transcriptions in Video Job Interviews

We address the task of automatically scoring the competency of candidate...

Past, Present, and Future Approaches Using Computer Vision for Animal Re-Identification from Camera Trap Data

The ability of a researcher to re-identify (re-ID) an individual animal ...

Supporting single responsibility through automated extract method refactoring

The responsibility of a method/function is to perform some desired compu...

Please sign up or login with your details

Forgot password? Click here to reset