Trajectory Aligned Features For First Person Action Recognition

04/07/2016
by   Suriya Singh, et al.
0

Egocentric videos are characterised by their ability to have the first person view. With the popularity of Google Glass and GoPro, use of egocentric videos is on the rise. Recognizing action of the wearer from egocentric videos is an important problem. Unstructured movement of the camera due to natural head motion of the wearer causes sharp changes in the visual field of the egocentric camera causing many standard third person action recognition techniques to perform poorly on such videos. Objects present in the scene and hand gestures of the wearer are the most important cues for first person action recognition but are difficult to segment and recognize in an egocentric video. We propose a novel representation of the first person actions derived from feature trajectories. The features are simple to compute using standard point tracking and does not assume segmentation of hand/objects or recognizing object or hand pose unlike in many previous approaches. We train a bag of words classifier with the proposed features and report a performance improvement of more than 11 case, we show that our technique can also recognize wearer's actions when hands or objects are not visible.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 8

page 9

page 10

research
10/17/2019

Making Third Person Techniques Recognize First-Person Actions in Egocentric Videos

We focus on first-person action recognition from egocentric videos. Unli...
research
05/02/2019

Egocentric Hand Track and Object-based Human Action Recognition

Egocentric vision is an emerging field of computer vision that is charac...
research
02/10/2020

Joint Encoding of Appearance and Motion Features with Self-supervision for First Person Action Recognition

Wearable cameras are becoming more and more popular in several applicati...
research
11/17/2020

Whose hand is this? Person Identification from Egocentric Hand Gestures

Recognizing people by faces and other biometrics has been extensively st...
research
06/06/2018

Action4D: Real-time Action Recognition in the Crowd and Clutter

Recognizing every person's action in a crowded and cluttered environment...
research
05/20/2021

Egocentric Activity Recognition and Localization on a 3D Map

Given a video captured from a first person perspective and recorded in a...
research
11/16/2016

Am I a Baller? Basketball Performance Assessment from First-Person Videos

This paper presents a method to assess a basketball player's performance...

Please sign up or login with your details

Forgot password? Click here to reset