Interweaved Graph and Attention Network for 3D Human Pose Estimation

04/27/2023
by   Ti Wang, et al.
0

Despite substantial progress in 3D human pose estimation from a single-view image, prior works rarely explore global and local correlations, leading to insufficient learning of human skeleton representations. To address this issue, we propose a novel Interweaved Graph and Attention Network (IGANet) that allows bidirectional communications between graph convolutional networks (GCNs) and attentions. Specifically, we introduce an IGA module, where attentions are provided with local information from GCNs and GCNs are injected with global information from attentions. Additionally, we design a simple yet effective U-shaped multi-layer perceptron (uMLP), which can capture multi-granularity information for body joints. Extensive experiments on two popular benchmark datasets (i.e. Human3.6M and MPI-INF-3DHP) are conducted to evaluate our proposed method.The results show that IGANet achieves state-of-the-art performance on both datasets. Code is available at https://github.com/xiu-cs/IGANet.

READ FULL TEXT

page 2

page 4

research
06/13/2022

GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimation

Modern multi-layer perceptron (MLP) models have shown competitive result...
research
02/20/2023

HTNet: Human Topology Aware Network for 3D Human Pose Estimation

3D human pose estimation errors would propagate along the human body top...
research
11/23/2021

Hierarchical Graph Networks for 3D Human Pose Estimation

Recent 2D-to-3D human pose estimation works tend to utilize the graph st...
research
08/10/2023

Double-chain Constraints for 3D Human Pose Estimation in Images and Videos

Reconstructing 3D poses from 2D poses lacking depth information is parti...
research
08/29/2023

Spatio-temporal MLP-graph network for 3D human pose estimation

Graph convolutional networks and their variants have shown significant p...
research
06/10/2019

Global Context for Convolutional Pose Machines

Convolutional Pose Machine is a popular neural network architecture for ...
research
10/11/2022

ACRNet: Attention Cube Regression Network for Multi-view Real-time 3D Human Pose Estimation in Telemedicine

Human pose estimation (HPE) for 3D skeleton reconstruction in telemedici...

Please sign up or login with your details

Forgot password? Click here to reset