DeepAI AI Chat
Log In Sign Up

Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos

08/13/2020
by   Ling-An Zeng, et al.
0

The objective of action quality assessment is to score sports videos. However, most existing works focus only on video dynamic information (i.e., motion information) but ignore the specific postures that an athlete is performing in a video, which is important for action assessment in long videos. In this work, we present a novel hybrid dynAmic-static Context-aware attenTION NETwork (ACTION-NET) for action assessment in long videos. To learn more discriminative representations for videos, we not only learn the video dynamic information but also focus on the static postures of the detected athletes in specific frames, which represent the action quality at certain moments, along with the help of the proposed hybrid dynamic-static architecture. Moreover, we leverage a context-aware attention module consisting of a temporal instance-wise graph convolutional network unit and an attention unit for both streams to extract more robust stream features, where the former is for exploring the relations between instances and the latter for assigning a proper weight to each instance. Finally, we combine the features of the two streams to regress the final video score, supervised by ground-truth scores given by experts. Additionally, we have collected and annotated the new Rhythmic Gymnastics dataset, which contains videos of four different types of gymnastics routines, for evaluation of action quality assessment in long videos. Extensive experimental results validate the efficacy of our proposed method, which outperforms related approaches. The codes and dataset are available at <https://github.com/lingan1996/ACTION-NET>.

READ FULL TEXT

page 5

page 8

08/01/2019

Quality Assessment of In-the-Wild Videos

Quality assessment of in-the-wild videos is a challenging problem becaus...
01/11/2022

TSA-Net: Tube Self-Attention Network for Action Quality Assessment

In recent years, assessing action quality from videos has attracted grow...
08/17/2021

Group-aware Contrastive Regression for Action Quality Assessment

Assessing action quality is challenging due to the subtle differences be...
02/27/2020

Action Quality Assessment using Siamese Network-Based Deep Metric Learning

Automated vision-based score estimation models can be used as an alterna...
04/07/2022

FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessment

Most existing action quality assessment methods rely on the deep feature...
02/21/2021

Improving Action Quality Assessment using ResNets and Weighted Aggregation

Action quality assessment (AQA) aims at automatically judging human acti...
08/07/2020

A Multi-Task Learning Approach for Human Action Detection and Ergonomics Risk Assessment

We propose a new approach to Human Action Evaluation (HAE) in long video...