Learning to Learn Relation for Important People Detection in Still Images

04/07/2019
by   Wei-Hong Li, et al.
0

Humans can easily recognize the importance of people in social event images, and they always focus on the most important individuals. However, learning to learn the relation between people in an image, and inferring the most important person based on this relation, remains undeveloped. In this work, we propose a deep imPOrtance relatIon NeTwork (POINT) that combines both relation modeling and feature learning. In particular, we infer two types of interaction modules: the person-person interaction module that learns the interaction between people and the event-person interaction module that learns to describe how a person is involved in the event occurring in an image. We then estimate the importance relations among people from both interactions and encode the relation feature from the importance relations. In this way, POINT automatically learns several types of relation features in parallel, and we aggregate these relation features and the person's feature to form the importance feature for important people classification. Extensive experimental results show that our method is effective for important people detection and verify the efficacy of learning to learn relations for important people detection.

READ FULL TEXT

page 2

page 4

page 9

research
02/19/2015

VIP: Finding Important People in Images

People preserve memories of events such as birthdays, weddings, or vacat...
research
04/16/2020

Learning to Detect Important People in Unlabelled Images for Semi-supervised Important People Detection

Important people detection is to automatically detect the individuals wh...
research
11/06/2017

PersonRank: Detecting Important People in Images

Always, some individuals in images are more important/attractive than ot...
research
08/31/2017

Learning Lexico-Functional Patterns for First-Person Affect

Informal first-person narratives are a unique resource for computational...
research
03/23/2023

ReVersion: Diffusion-Based Relation Inversion from Images

Diffusion models gain increasing popularity for their generative capabil...
research
07/30/2021

Enhancing Social Relation Inference with Concise Interaction Graph and Discriminative Scene Representation

There has been a recent surge of research interest in attacking the prob...
research
11/09/2015

Detecting events and key actors in multi-person videos

Multi-person event recognition is a challenging task, often with many pe...

Please sign up or login with your details

Forgot password? Click here to reset