GraFormer: Graph Convolution Transformer for 3D Pose Estimation

09/17/2021
by   Weixi Zhao, et al.
8

Exploiting relations among 2D joints plays a crucial role yet remains semi-developed in 2D-to-3D pose estimation. To alleviate this issue, we propose GraFormer, a novel transformer architecture combined with graph convolution for 3D pose estimation. The proposed GraFormer comprises two repeatedly stacked core modules, GraAttention and ChebGConv block. GraAttention enables all 2D joints to interact in global receptive field without weakening the graph structure information of joints, which introduces vital features for later modules. Unlike vanilla graph convolutions that only model the apparent relationship of joints, ChebGConv block enables 2D joints to interact in the high-order sphere, which formulates their hidden implicit relations. We empirically show the superiority of GraFormer through conducting extensive experiments across popular benchmarks. Specifically, GraFormer outperforms state of the art on Human3.6M dataset while using 18% parameters. The code is available at https://github.com/Graformer/GraFormer .

READ FULL TEXT

page 1

page 3

page 6

page 7

research
08/24/2022

K-Order Graph-oriented Transformer with GraAttention for 3D Pose and Shape Estimation

We propose a novel attention-based 2D-to-3D pose estimation network for ...
research
05/11/2022

AggPose: Deep Aggregation Vision Transformer for Infant Pose Estimation

Movement and pose assessment of newborns lets experienced pediatricians ...
research
02/09/2023

HybrIK-Transformer

HybrIK relies on a combination of analytical inverse kinematics and deep...
research
06/10/2019

Global Context for Convolutional Pose Machines

Convolutional Pose Machine is a popular neural network architecture for ...
research
04/03/2023

Rethinking Context Aggregation in Natural Image Matting

For natural image matting, context information plays a crucial role in e...
research
10/11/2021

Adaptively Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimation

In practical application, 3D Human Pose Estimation (HPE) is facing with ...
research
07/16/2022

CA-SpaceNet: Counterfactual Analysis for 6D Pose Estimation in Space

Reliable and stable 6D pose estimation of uncooperative space objects pl...

Please sign up or login with your details

Forgot password? Click here to reset