Improving Accuracy of Zero-Shot Action Recognition with Handcrafted Features

01/21/2023
by   Nan Wu, et al.
0

With the development of machine learning, datasets for models are getting increasingly larger. This leads to increased data annotation costs and training time, which undoubtedly hinders the development of machine learning. To solve this problem, zero-shot learning is gaining considerable attention. With zero-shot learning, objects can be recognized or classified, even without having been seen before. Nevertheless, the accuracy of this method is still low, thus limiting its practical application. To solve this problem, we propose a video-text matching model, which can learn from handcrafted features. Our model can be used alone to predict the action classes and can also be added to any other model to improve its accuracy. Moreover, our model can be continuously optimized to improve its accuracy. We only need to manually annotate some features, which incurs some labor costs; in many situations, the costs are worth it. The results with UCF101 and HMDB51 show that our model achieves the best accuracy and also improves the accuracies of other models.

READ FULL TEXT

page 4

page 7

page 8

page 10

page 11

page 12

research
10/20/2017

Generalized Zero-Shot Learning for Action Recognition with Web-Scale Video Data

Action recognition in surveillance video makes our life safer by detecti...
research
05/25/2021

GAN for Vision, KG for Relation: a Two-stage Deep Network for Zero-shot Action Recognition

Zero-shot action recognition can recognize samples of unseen classes tha...
research
03/29/2022

Practical Aspects of Zero-Shot Learning

One of important areas of machine learning research is zero-shot learnin...
research
03/10/2022

Zero-Shot Action Recognition with Transformer-based Video Semantic Embedding

While video action recognition has been an active area of research for s...
research
11/26/2019

Skeleton based Zero Shot Action Recognition in Joint Pose-Language Semantic Space

How does one represent an action? How does one describe an action that w...
research
07/20/2020

Sorted Pooling in Convolutional Networks for One-shot Learning

We present generalized versions of the commonly used maximum pooling ope...
research
07/23/2023

Validation of a Zero-Shot Learning Natural Language Processing Tool for Data Abstraction from Unstructured Healthcare Data

Objectives: To describe the development and validation of a zero-shot le...

Please sign up or login with your details

Forgot password? Click here to reset