Log In Sign Up

DRG: Dual Relation Graph for Human-Object Interaction Detection

by   Chen Gao, et al.

We tackle the challenging problem of human-object interaction (HOI) detection. Existing methods either recognize the interaction of each human-object pair in isolation or perform joint inference based on complex appearance-based features. In this paper, we leverage an abstract spatial-semantic representation to describe each human-object pair and aggregate the contextual information of the scene via a dual relation graph (one human-centric and one object-centric). Our proposed dual relation graph effectively captures discriminative cues from the scene to resolve ambiguity from local predictions. Our model is conceptually simple and leads to favorable results compared to the state-of-the-art HOI detection algorithms on two large-scale benchmark datasets.


page 1

page 9

page 12

page 14


Visual-Semantic Graph Attention Network for Human-Object Interaction Detection

In scene understanding, machines benefit from not only detecting individ...

Knowledge Guided Bidirectional Attention Network for Human-Object Interaction Detection

Human Object Interaction (HOI) detection is a challenging task that requ...

iCAN: Instance-Centric Attention Network for Human-Object Interaction Detection

Recent years have witnessed rapid progress in detecting and recognizing ...

Pose-aware Multi-level Feature Network for Human Object Interaction Detection

Reasoning human object interactions is a core problem in human-centric s...

Self-Selective Context for Interaction Recognition

Human-object interaction recognition aims for identifying the relationsh...

Human Centric Accessibility Graph For Environment Analysis

Understanding design decisions in relation to the future occupants of a ...

Code Repositories