Interact as You Intend: Intention-Driven Human-Object Interaction Detection

08/29/2018
by   Bingjie Xu, et al.
0

The recent advances in instance-level detection tasks lay strong foundation for genuine comprehension of the visual scenes. However, the ability to fully comprehend a social scene is still in its preliminary stage. In this work, we focus on detecting human-object interactions (HOIs) in social scene images, which is demanding in terms of research and increasingly useful for practical applications. To undertake social tasks interacting with objects, humans direct their attention and move their body based on their intention. Based on this observation, we provide a unique computational perspective to explore human intention in HOI detection. Specifically, the proposed human intention- driven HOI detection (iHOI) framework models human pose with the relative distances from body joints to the object instances. It also utilizes human gaze to guide the attended contextual regions in a weakly-supervised setting. In addition, we propose a hard negative sampling strategy to address the problem of mis-grouping. We perform extensive experiments on two benchmark datasets, namely V-COCO and HICO-DET, and show that iHOI outperforms the existing approaches. The efficacy of each proposed component has also been validated.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

research
10/17/2019

Deep Contextual Attention for Human-Object Interaction Detection

Human-object interaction detection is an important and relatively new cl...
research
09/17/2019

What Are You Looking at? Detecting Human Intention in Gaze based Human-Robot Interaction

In gaze based Human-Robot Interaction (HRI), it is important to determin...
research
03/11/2020

GID-Net: Detecting Human-Object Interaction with Global and Instance Dependency

Since detecting and recognizing individual human or object are not adequ...
research
07/14/2020

A Graph-based Interactive Reasoning for Human-Object Interaction Detection

Human-Object Interaction (HOI) detection devotes to learn how humans int...
research
07/05/2022

Distance Matters in Human-Object Interaction Detection

Human-Object Interaction (HOI) detection has received considerable atten...
research
03/02/2023

Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learning

Human object interaction (HOI) detection plays a crucial role in human-c...
research
04/12/2023

Real-time Trajectory-based Social Group Detection

Social group detection is a crucial aspect of various robotic applicatio...

Please sign up or login with your details

Forgot password? Click here to reset