Action Quality Assessment using Siamese Network-Based Deep Metric Learning

02/27/2020
by   Hiteshi Jain, et al.
0

Automated vision-based score estimation models can be used as an alternate opinion to avoid judgment bias. In the past works the score estimation models were learned by regressing the video representations to the ground truth score provided by the judges. However such regression-based solutions lack interpretability in terms of giving reasons for the awarded score. One solution to make the scores more explicable is to compare the given action video with a reference video. This would capture the temporal variations w.r.t. the reference video and map those variations to the final score. In this work, we propose a new action scoring system as a two-phase system: (1) A Deep Metric Learning Module that learns similarity between any two action videos based on their ground truth scores given by the judges; (2) A Score Estimation Module that uses the first module to find the resemblance of a video to a reference video in order to give the assessment score. The proposed scoring model has been tested for Olympics Diving and Gymnastic vaults and the model outperforms the existing state-of-the-art scoring models.

READ FULL TEXT

page 1

page 2

page 5

page 6

research
08/17/2021

Group-aware Contrastive Regression for Action Quality Assessment

Assessing action quality is challenging due to the subtle differences be...
research
07/05/2018

3D Human Action Recognition with Siamese-LSTM Based Deep Metric Learning

This paper proposes a new 3D Human Action Recognition system as a two-ph...
research
08/13/2020

Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos

The objective of action quality assessment is to score sports videos. Ho...
research
03/16/2023

IRIS: Interpretable Rubric-Informed Segmentation for Action Quality Assessment

AI-driven Action Quality Assessment (AQA) of sports videos can mimic Oly...
research
10/03/2020

autoTICI: Automatic Brain Tissue Reperfusion Scoring on 2D DSA Images of Acute Ischemic Stroke Patients

The Thrombolysis in Cerebral Infarction (TICI) score is an important met...
research
04/07/2022

FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessment

Most existing action quality assessment methods rely on the deep feature...
research
03/27/2023

DQSOps: Data Quality Scoring Operations Framework for Data-Driven Applications

Data quality assessment has become a prominent component in the successf...

Please sign up or login with your details

Forgot password? Click here to reset