Transferable Interactiveness Prior for Human-Object Interaction Detection

11/20/2018
by   Yong-Lu Li, et al.
4

Human-Object Interaction (HOI) Detection is an important problem to understand how humans interact with objects. In this paper, we explore Interactiveness Prior which indicates whether human and object interact with each other or not. We found that interactiveness prior can be learned across HOI datasets, regardless of HOI category settings. Our core idea is to exploit an Interactiveness Network to learn the general interactiveness prior from multiple HOI datasets and perform Non-Interaction Suppression before HOI classification in inference. On account of the generalization of interactiveness prior, interactiveness network is a transferable knowledge learner and can be cooperated with any HOI detection models to achieve desirable results. We extensively evaluate the proposed method on HICO-DET and V-COCO datasets. Our framework outperforms state-of-the-art HOI detection results by a great margin, verifying its efficacy and flexibility. Source codes and models will be made publicly available.

READ FULL TEXT

page 4

page 7

page 8

research
01/25/2021

Transferable Interactiveness Knowledge for Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is an important problem to unde...
research
05/07/2021

Human Object Interaction Detection using Two-Direction Spatial Enhancement and Exclusive Object Prior

Human-Object Interaction (HOI) detection aims to detect visual relations...
research
08/30/2018

iCAN: Instance-Centric Attention Network for Human-Object Interaction Detection

Recent years have witnessed rapid progress in detecting and recognizing ...
research
05/17/2023

HICO-DET-SG and V-COCO-SG: New Data Splits to Evaluate Systematic Generalization in Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task to predict interactio...
research
03/28/2023

HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Models

Human-Object Interaction (HOI) detection aims to localize human-object p...
research
10/02/2020

DecAug: Augmenting HOI Detection via Decomposition

Human-object interaction (HOI) detection requires a large amount of anno...
research
08/24/2020

ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theory

Robots in human environments will need to interact with a wide variety o...

Please sign up or login with your details

Forgot password? Click here to reset