DeepAI AI Chat
Log In Sign Up

Feedback Graph Convolutional Network for Skeleton-based Action Recognition

03/17/2020
by   Hao Yang, et al.
Tsinghua University
University of Amsterdam
Birkbeck, University of London
NUCTECH COMPANY LIMITED
10

Skeleton-based action recognition has attracted considerable attention in computer vision since skeleton data is more robust to the dynamic circumstance and complicated background than other modalities. Recently, many researchers have used the Graph Convolutional Network (GCN) to model spatial-temporal features of skeleton sequences by an end-to-end optimization. However, conventional GCNs are feedforward networks which are impossible for low-level layers to access semantic information in the high-level layers. In this paper, we propose a novel network, named Feedback Graph Convolutional Network (FGCN). This is the first work that introduces the feedback mechanism into GCNs and action recognition. Compared with conventional GCNs, FGCN has the following advantages: (1) a multi-stage temporal sampling strategy is designed to extract spatial-temporal features for action recognition in a coarse-to-fine progressive process; (2) A dense connections based Feedback Graph Convolutional Block (FGCB) is proposed to introduce feedback connections into the GCNs. It transmits the high-level semantic features to the low-level layers and flows temporal information stage by stage to progressively model global spatial-temporal features for action recognition; (3) The FGCN model provides early predictions. In the early stages, the model receives partial information about actions. Naturally, its predictions are relatively coarse. The coarse predictions are treated as the prior to guide the feature learning of later stages for a accurate prediction. Extensive experiments on the datasets, NTU-RGB+D, NTU-RGB+D120 and Northwestern-UCLA, demonstrate that the proposed FGCN is effective for action recognition. It achieves the state-of-the-art performance on the three datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/10/2022

Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition

Graph convolutional networks (GCNs), which can model the human body skel...
08/01/2020

Improving Skeleton-based Action Recognitionwith Robust Spatial and Temporal Features

Recently skeleton-based action recognition has made signif-icant progres...
04/07/2020

SC4D: A Sparse 4D Convolutional Network for Skeleton-Based Action Recognition

In this paper, a new perspective is presented for skeleton-based action ...
09/21/2022

Adaptive Local-Component-aware Graph Convolutional Network for One-shot Skeleton-based Action Recognition

Skeleton-based action recognition receives increasing attention because ...
10/12/2021

Video Is Graph: Structured Graph Module for Video Action Recognition

In the field of action recognition, video clips are always treated as or...
01/15/2022

Real-World Graph Convolution Networks (RW-GCNs) for Action Recognition in Smart Video Surveillance

Action recognition is a key algorithmic part of emerging on-the-edge sma...