Detecting Human-Object Interactions with Action Co-occurrence Priors

07/17/2020
by   Dong-Jin Kim, et al.
0

A common problem in human-object interaction (HOI) detection task is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution. The lack of positive labels can lead to low classification accuracy for these classes. Towards addressing this issue, we observe that there exist natural correlations and anti-correlations among human-object interactions. In this paper, we model the correlations as action co-occurrence matrices and present techniques to learn these priors and leverage them for more effective training, especially in rare classes. The utility of our approach is demonstrated experimentally, where the performance of our approach exceeds the state-of-the-art methods on both of the two leading HOI detection benchmark datasets, HICO-Det and V-COCO.

READ FULL TEXT

page 2

page 4

research
09/09/2021

ACP++: Action Co-occurrence Priors for Human-Object Interaction Detection

A common problem in the task of human-object interaction (HOI) detection...
research
12/23/2022

Detecting Objects with Graph Priors and Graph Refinement

The goal of this paper is to detect objects by exploiting their interrel...
research
08/14/2020

Rb-PaStaNet: A Few-Shot Human-Object Interaction Detection Based on Rules and Part States

Existing Human-Object Interaction (HOI) Detection approaches have achiev...
research
12/13/2021

Decoupling Object Detection from Human-Object Interaction Recognition

We propose DEFR, a DEtection-FRee method to recognize Human-Object Inter...
research
07/06/2022

Chairs Can be Stood on: Overcoming Object Bias in Human-Object Interaction Detection

Detecting Human-Object Interaction (HOI) in images is an important step ...
research
05/14/2023

Instance-Aware Repeat Factor Sampling for Long-Tailed Object Detection

We propose an embarrassingly simple method – instance-aware repeat facto...
research
11/16/2022

Towards Long-Tailed 3D Detection

Contemporary autonomous vehicle (AV) benchmarks have advanced techniques...

Please sign up or login with your details

Forgot password? Click here to reset