SALAD: Self-Assessment Learning for Action Detection

11/13/2020
by   Guillaume Vaudaux-Ruth, et al.
0

Literature on self-assessment in machine learning mainly focuses on the production of well-calibrated algorithms through consensus frameworks i.e. calibration is seen as a problem. Yet, we observe that learning to be properly confident could behave like a powerful regularization and thus, could be an opportunity to improve performance.Precisely, we show that used within a framework of action detection, the learning of a self-assessment score is able to improve the whole action localization process.Experimental results show that our approach outperforms the state-of-the-art on two action detection benchmarks. On THUMOS14 dataset, the mAP at tIoU@0.5 is improved from 42.8% to 44.6%, and from 50.4% to 51.7% on ActivityNet1.3 dataset. For lower tIoU values, we achieve even more significant improvements on both datasets.

READ FULL TEXT

page 4

page 8

research
09/06/2021

Class Semantics-based Attention for Action Detection

Action localization networks are often structured as a feature encoder s...
research
12/15/2018

Action Quality Assessment Across Multiple Actions

Can learning to measure the quality of an action help in measuring the q...
research
04/08/2019

What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment

Can performance on the task of action quality assessment (AQA) be improv...
research
03/23/2019

StartNet: Online Detection of Action Start in Untrimmed Videos

We propose StartNet to address Online Detection of Action Start (ODAS) w...
research
09/22/2020

How Much Does It Hurt: A Deep Learning Framework for Chronic Pain Score Assessment

Chronic pain is defined as pain that lasts or recurs for more than 3 to ...
research
11/16/2016

Learning To Score Olympic Events

Estimating action quality, the process of assigning a "score" to the exe...
research
02/18/2020

Constraining Temporal Relationship for Action Localization

Recently, temporal action localization (TAL), i.e., finding specific act...

Please sign up or login with your details

Forgot password? Click here to reset