Egocentric Height Estimation

10/09/2016
by   Jessica Finocchiaro, et al.
0

Egocentric, or first-person vision which became popular in recent years with an emerge in wearable technology, is different than exocentric (third-person) vision in some distinguishable ways, one of which being that the camera wearer is generally not visible in the video frames. Recent work has been done on action and object recognition in egocentric videos, as well as work on biometric extraction from first-person videos. Height estimation can be a useful feature for both soft-biometrics and object tracking. Here, we propose a method of estimating the height of an egocentric camera without any calibration or reference points. We used both traditional computer vision approaches and deep learning in order to determine the visual cues that results in best height estimation. Here, we introduce a framework inspired by two stream networks comprising of two Convolutional Neural Networks, one based on spatial information, and one based on information given by optical flow in a frame. Given an egocentric video as an input to the framework, our model yields a height estimate as an output. We also incorporate late fusion to learn a combination of temporal and spatial cues. Comparing our model with other methods we used as baselines, we achieve height estimates for videos with a Mean Average Error of 14.04 cm over a range of 103 cm of data, and classification accuracy for relative height (tall, medium or short) up to 93.75

READ FULL TEXT

page 3

page 5

page 6

research
09/05/2019

Gravity as a Reference for Estimating a Person's Height from Video

Estimating the metric height of a person from monocular imagery without ...
research
03/15/2023

VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation

We introduce VideoFlow, a novel optical flow estimation framework for vi...
research
03/15/2016

First Person Action-Object Detection with EgoNet

Unlike traditional third-person cameras mounted on robots, a first-perso...
research
02/09/2017

Predicting Privileged Information for Height Estimation

In this paper, we propose a novel regression-based method for employing ...
research
10/05/2019

Object Segmentation Tracking from Generic Video Cues

We propose a light-weight variational framework for online tracking of o...
research
07/28/2021

Lighter Stacked Hourglass Human Pose Estimation

Human pose estimation (HPE) is one of the most challenging tasks in comp...
research
08/05/2023

Data Fusion for Multi-Task Learning of Building Extraction and Height Estimation

In accordance with the urban reconstruction problem proposed by the DFC2...

Please sign up or login with your details

Forgot password? Click here to reset