HireNet: a Hierarchical Attention Model for the Automatic Analysis of Asynchronous Video Job Interviews

07/25/2019
by   Léo Hemamou, et al.
0

New technologies drastically change recruitment techniques. Some research projects aim at designing interactive systems that help candidates practice job interviews. Other studies aim at the automatic detection of social signals (e.g. smile, turn of speech, etc...) in videos of job interviews. These studies are limited with respect to the number of interviews they process, but also by the fact that they only analyze simulated job interviews (e.g. students pretending to apply for a fake position). Asynchronous video interviewing tools have become mature products on the human resources market, and thus, a popular step in the recruitment process. As part of a project to help recruiters, we collected a corpus of more than 7000 candidates having asynchronous video job interviews for real positions and recording videos of themselves answering a set of questions. We propose a new hierarchical attention model called HireNet that aims at predicting the hirability of the candidates as evaluated by recruiters. In HireNet, an interview is considered as a sequence of questions and answers containing salient socials signals. Two contextual sources of information are modeled in HireNet: the words contained in the question and in the job position. Our model achieves better F1-scores than previous approaches for each modality (verbal content, audio and video). Results from early and late multimodal fusion suggest that more sophisticated fusion schemes are needed to improve on the monomodal results. Finally, some examples of moments captured by the attention mechanisms suggest our model could potentially be used to help finding key moments in an asynchronous job interview.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/19/2019

Slices of Attention in Asynchronous Video Job Interviews

The impact of non verbal behaviour in a hiring decision remains an open ...
research
12/22/2020

A Hierarchical Reasoning Graph Neural Network for The Automatic Scoring of Answer Transcriptions in Video Job Interviews

We address the task of automatically scoring the competency of candidate...
research
07/22/2020

Predicting job-hopping likelihood using answers to open-ended interview questions

Voluntary employee turnover incurs significant direct and indirect finan...
research
08/27/2022

MyMigrationBot: A Cloud-based Facebook Social Chatbot for Migrant Populations

We present the design, implementation and evaluation of a new cloud-base...
research
01/27/2023

"Finding the Magic Sauce": Exploring Perspectives of Recruiters and Job Seekers on Recruitment Bias and Automated Tools

Automated recruitment tools are proliferating. While having the promise ...
research
02/12/2020

Optimal Multiple Stopping Rule for Warm-Starting Sequential Selection

In this paper we present the Warm-starting Dynamic Thresholding algorith...

Please sign up or login with your details

Forgot password? Click here to reset