Transferable Feature Representation for Visible-to-Infrared Cross-Dataset Human Action Recognition

09/18/2019
by   Yang Liu, et al.
0

Recently, infrared human action recognition has attracted increasing attention for it has many advantages over visible light, that is, being robust to illumination change and shadows. However, the infrared action data is limited until now, which degrades the performance of infrared action recognition. Motivated by the idea of transfer learning, an infrared human action recognition framework using auxiliary data from visible light is proposed to solve the problem of limited infrared action data. In the proposed framework, we first construct a novel Cross-Dataset Feature Alignment and Generalization (CDFAG) framework to map the infrared data and visible light data into a common feature space, where Kernel Manifold Alignment (KEMA) and a dual alignedto-generalized encoders (AGE) model are employed to represent the feature. Then, a support vector machine (SVM) is trained, using both the infrared data and visible light data, and can classify the features derived from infrared data. The proposed method is evaluated on InfAR, which is a publicly available infrared human action dataset. To build up auxiliary data, we set up a novel visible light action dataset XD145. Experimental results show that the proposed method can achieve state-of-the-art performance compared with several transfer learning and domain adaptation methods.

READ FULL TEXT

page 2

page 5

page 7

page 9

page 12

page 14

page 16

page 19

research
06/21/2019

FBK-HUPBA Submission to the EPIC-Kitchens 2019 Action Recognition Challenge

In this report we describe the technical details of our submission to th...
research
06/30/2022

Spatial Transformer Network with Transfer Learning for Small-scale Fine-grained Skeleton-based Tai Chi Action Recognition

Human action recognition is a quite hugely investigated area where most ...
research
09/15/2023

hear-your-action: human action recognition by ultrasound active sensing

Action recognition is a key technology for many industrial applications....
research
04/17/2018

PM-GANs: Discriminative Representation Learning for Action Recognition Using Partial-modalities

Data of different modalities generally convey complimentary but heteroge...
research
09/06/2017

A Compact Kernel Approximation for 3D Action Recognition

3D action recognition was shown to benefit from a covariance representat...
research
07/02/2020

Low-light Environment Neural Surveillance

We design and implement an end-to-end system for real-time crime detecti...
research
12/02/2015

Actions Transformations

What defines an action like "kicking ball"? We argue that the true meani...

Please sign up or login with your details

Forgot password? Click here to reset