Egocentric Visitors Localization in Cultural Sites

by   Francesco Ragusa, et al.

We consider the problem of localizing visitors in a cultural site from egocentric (first person) images. Localization information can be useful both to assist the user during his visit (e.g., by suggesting where to go and what to see next) and to provide behavioral information to the manager of the cultural site (e.g., how much time has been spent by visitors at a given location? What has been liked most?). To tackle the problem, we collected a large dataset of egocentric videos using two cameras: a head-mounted HoloLens device and a chest-mounted GoPro. Each frame has been labeled according to the location of the visitor and to what he was looking at. The dataset is freely available in order to encourage research in this domain. The dataset is complemented with baseline experiments performed considering a state-of-the-art method for location-based temporal segmentation of egocentric videos. Experiments show that compelling results can be achieved to extract useful information for both the visitor and the site-manager.


page 3

page 4

page 5

page 6

page 8

page 12

page 13


EGO-CH: Dataset and Fundamental Tasks for Visitors BehavioralUnderstanding using Egocentric Vision

Equipping visitors of a cultural site with a wearable device allows to e...

Location Recognition Over Large Time Lags

Would it be possible to automatically associate ancient pictures to mode...

A Service for Supporting Digital and Immersive Cultural Experiences

Cultural heritage sites in Italy typically attract a large number of tou...

Synthetic to Real Unsupervised Domain Adaptation for Single-Stage Artwork Recognition in Cultural Sites

Recognizing artworks in a cultural site using images acquired from the u...

Informative Path Planning for Location Fingerprint Collection

Fingerprint-based indoor localization methods are promising due to the h...

Smart, Responsible, and Upper Caste Only: Measuring Caste Attitudes through Large-Scale Analysis of Matrimonial Profiles

Discriminatory caste attitudes currently stigmatize millions of Indians,...

Please sign up or login with your details

Forgot password? Click here to reset