EgoReID: Person re-identification in Egocentric Videos Acquired by Mobile Devices with First-Person Point-of-View

12/22/2018
by   Emrah Basaran, et al.
8

Widespread use of wearable cameras and recording devices such as cellphones have opened the door to a lot of interesting research in first-person Point-of-view (POV) videos (egocentric videos). In recent years, we have seen the performance of video-based person Re-Identification (ReID) methods improve considerably. However, with the influx of varying video domains, such as egocentric videos, it has become apparent that there are still many open challenges to be faced. These challenges are a result of factors such as poor video quality due to ego-motion, blurriness, severe changes in lighting conditions and perspective distortions. To facilitate the research towards conquering these challenges, this paper contributes a new, first-of-its-kind dataset called EgoReID. The dataset is captured using 3 mobile cellphones with non-overlapping field-of-view. It contains 900 IDs and around 10,200 tracks with a total of 176,000 detections. Moreover, for each video we also provide 12-sensor meta data. Directly applying current approaches to our dataset results in poor performance. Considering the unique nature of our dataset, we propose a new framework which takes advantage of both visual and sensor meta data to successfully perform Person ReID. In this paper, we propose to adopt human body region parsing to extract local features from different body regions and then employ 3D convolution to better encode temporal information of each sequence of body parts. In addition, we also employ sensor meta data to determine target's next camera and their estimated time of arrival, such that the search is only performed among tracks present in the predicted next camera around the estimated time. This considerably improves our ReID performance as it significantly reduces our search space.

READ FULL TEXT

page 2

page 5

page 13

page 18

research
06/15/2016

Ego-Surfing: Person Localization in First-Person Videos Using Ego-Motion Signatures

We envision a future time when wearable cameras are worn by the masses a...
research
03/31/2018

Human Semantic Parsing for Person Re-identification

Person re-identification is a challenging task mainly due to factors suc...
research
10/07/2015

Egocentric Field-of-View Localization Using First-Person Point-of-View Devices

We present a technique that uses images, videos and sensor data taken fr...
research
07/15/2018

Improved Person Re-Identification Based on Saliency and Semantic Parsing with Deep Neural Network Models

Given a video or an image of a person acquired from a camera, person re-...
research
11/23/2017

Person Transfer GAN to Bridge Domain Gap for Person Re-Identification

Although the performance of person Re-Identification (ReID) has been sig...
research
11/09/2022

MEVID: Multi-view Extended Videos with Identities for Video Person Re-Identification

In this paper, we present the Multi-view Extended Videos with Identities...
research
03/30/2016

Unsupervised Understanding of Location and Illumination Changes in Egocentric Videos

Wearable cameras stand out as one of the most promising devices for the ...

Please sign up or login with your details

Forgot password? Click here to reset