Category Query Learning for Human-Object Interaction Classification

03/24/2023
by   Chi Xie, et al.
0

Unlike most previous HOI methods that focus on learning better human-object features, we propose a novel and complementary approach called category query learning. Such queries are explicitly associated to interaction categories, converted to image specific category representation via a transformer decoder, and learnt via an auxiliary image-level classification task. This idea is motivated by an earlier multi-label image classification method, but is for the first time applied for the challenging human-object interaction classification task. Our method is simple, general and effective. It is validated on three representative HOI baselines and achieves new state-of-the-art results on two benchmarks.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 14

research
04/11/2022

Category-Aware Transformer Network for Better Human-Object Interaction Detection

Human-Object Interactions (HOI) detection, which aims to localize a huma...
research
10/16/2017

Pushing the envelope in deep visual recognition for mobile platforms

Image classification is the task of assigning to an input image a label ...
research
12/10/2021

Visual Transformers with Primal Object Queries for Multi-Label Image Classification

Multi-label image classification is about predicting a set of class labe...
research
12/25/2019

InSphereNet: a Concise Representation and Classification Method for 3D Object

In this paper, we present an InSphereNet method for the problem of 3D ob...
research
01/09/2020

Don't Judge an Object by Its Context: Learning to Overcome Contextual Bias

Existing models often leverage co-occurrences between objects and their ...
research
01/20/2022

Cost-Effective Algorithms for Average-Case Interactive Graph Search

Interactive graph search (IGS) uses human intelligence to locate the tar...
research
08/04/2023

Improving Human-Object Interaction Detection via Virtual Image Learning

Human-Object Interaction (HOI) detection aims to understand the interact...

Please sign up or login with your details

Forgot password? Click here to reset