Is First Person Vision Challenging for Object Tracking?

08/31/2021
by   Matteo Dunnhofer, et al.
7

Understanding human-object interactions is fundamental in First Person Vision (FPV). Tracking algorithms which follow the objects manipulated by the camera wearer can provide useful cues to effectively model such interactions. Visual tracking solutions available in the computer vision literature have significantly improved their performance in the last years for a large variety of target objects and tracking scenarios. However, despite a few previous attempts to exploit trackers in FPV applications, a methodical analysis of the performance of state-of-the-art trackers in this domain is still missing. In this paper, we fill the gap by presenting the first systematic study of object tracking in FPV. Our study extensively analyses the performance of recent visual trackers and baseline FPV trackers with respect to different aspects and considering a new performance measure. This is achieved through TREK-150, a novel benchmark dataset composed of 150 densely annotated video sequences. Our results show that object tracking in FPV is challenging, which suggests that more research efforts should be devoted to this problem so that tracking could benefit FPV tasks.

READ FULL TEXT

page 1

page 15

page 19

page 21

research
11/24/2020

Is First Person Vision Challenging for Object Tracking? The TREK-100 Benchmark Dataset

Understanding human-object interactions is fundamental in First Person V...
research
09/27/2022

Visual Object Tracking in First Person Vision

The understanding of human-object interactions is fundamental in First P...
research
01/05/2015

Adaptive Objectness for Object Tracking

Object tracking is a long standing problem in vision. While great effort...
research
03/27/2018

A Framework for Evaluating 6-DOF Object Trackers

We present a challenging and realistic novel dataset for evaluating 6-DO...
research
04/29/2021

LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search

Object tracking has achieved significant progress over the past few year...
research
02/26/2022

Global Instance Tracking: Locating Target More Like Humans

Target tracking, the essential ability of the human visual system, has b...
research
08/04/2022

SOMPT22: A Surveillance Oriented Multi-Pedestrian Tracking Dataset

Multi-object tracking (MOT) has been dominated by the use of track by de...

Please sign up or login with your details

Forgot password? Click here to reset