Learning Preference-Based Similarities from Face Images using Siamese Multi-Task CNNs

01/25/2020
by   Nils Gessert, et al.
9

Online dating has become a common occurrence over the last few decades. A key challenge for online dating platforms is to determine suitable matches for their users. A lot of dating services rely on self-reported user traits and preferences for matching. At the same time, some services largely rely on user images and thus initial visual preference. Especially for the latter approach, previous research has attempted to capture users' visual preferences for automatic match recommendation. These approaches are mostly based on the assumption that physical attraction is the key factor for relationship formation and personal preferences, interests, and attitude are largely neglected. Deep learning approaches have shown that a variety of properties can be predicted from human faces to some degree, including age, health and even personality traits. Therefore, we investigate the feasibility of bridging image-based matching and matching with personal interests, preferences, and attitude. We approach the problem in a supervised manner by predicting similarity scores between two users based on images of their faces only. The ground-truth for the similarity matching scores is determined by a test that aims to capture users' preferences, interests, and attitude that are relevant for forming romantic relationships. The images are processed by a Siamese Multi-Task deep learning architecture. We find a statistically significant correlation between predicted and target similarity scores. Thus, our results indicate that learning similarities in terms of interests, preferences, and attitude from face images appears to be feasible to some degree.

READ FULL TEXT

page 3

page 4

page 5

page 9

research
12/21/2015

Beyond Classification: Latent User Interests Profiling from Visual Contents Analysis

User preference profiling is an important task in modern online social n...
research
07/08/2020

MRIF: Multi-resolution Interest Fusion for Recommendation

The main task of personalized recommendation is capturing users' interes...
research
05/09/2020

SocialTrans: A Deep Sequential Model with Social Information for Web-Scale Recommendation Systems

On social network platforms, a user's behavior is based on his/her perso...
research
08/08/2023

Multi-Granularity Attention Model for Group Recommendation

Group recommendation provides personalized recommendations to a group of...
research
08/28/2023

Alleviating Video-Length Effect for Micro-video Recommendation

Micro-videos platforms such as TikTok are extremely popular nowadays. On...
research
04/26/2016

Modern Physiognomy: An Investigation on Predicting Personality Traits and Intelligence from the Human Face

The human behavior of evaluating other individuals with respect to their...
research
06/15/2019

A Books Recommendation Approach Based on Online Bookstore Data

In the era of information explosion, facing complex information, it is d...

Please sign up or login with your details

Forgot password? Click here to reset