GO-Finder: A Registration-Free Wearable System for Assisting Users in Finding Lost Objects via Hand-Held Object Discovery

01/18/2021
by   Takuma Yagi, et al.
18

People spend an enormous amount of time and effort looking for lost objects. To help remind people of the location of lost objects, various computational systems that provide information on their locations have been developed. However, prior systems for assisting people in finding objects require users to register the target objects in advance. This requirement imposes a cumbersome burden on the users, and the system cannot help remind them of unexpectedly lost objects. We propose GO-Finder ("Generic Object Finder"), a registration-free wearable camera based system for assisting people in finding an arbitrary number of objects based on two key features: automatic discovery of hand-held objects and image-based candidate selection. Given a video taken from a wearable camera, Go-Finder automatically detects and groups hand-held objects to form a visual timeline of the objects. Users can retrieve the last appearance of the object by browsing the timeline through a smartphone app. We conducted a user study to investigate how users benefit from using GO-Finder and confirmed improved accuracy and reduced mental load regarding the object search task by providing clear visual cues on object locations.

READ FULL TEXT

page 4

page 5

page 6

page 8

page 10

page 13

research
05/04/2023

Learning Hand-Held Object Reconstruction from In-The-Wild Videos

Prior works for reconstructing hand-held objects from a single image rel...
research
02/28/2023

MateRobot: Material Recognition in Wearable Robotics for People with Visual Impairments

Wearable robotics can improve the lives of People with Visual Impairment...
research
06/19/2022

Object Localization Assistive System Based on CV and Vibrotactile Encoding

Intelligent assistive systems can navigate blind people, but most of the...
research
03/06/2019

Camera Obscurer: Generative Art for Design Inspiration

We investigate using generated decorative art as a source of inspiration...
research
08/29/2016

Where is my Phone ? Personal Object Retrieval from Egocentric Images

This work presents a retrieval pipeline and evaluation scheme for the pr...
research
03/11/2022

Registering Articulated Objects With Human-in-the-loop Corrections

Remotely programming robots to execute tasks often relies on registering...
research
04/26/2013

In the sight of my wearable camera: Classifying my visual experience

We introduce and we analyze a new dataset which resembles the input to b...

Please sign up or login with your details

Forgot password? Click here to reset