Enabling Tangible Interaction through Detection and Augmentation of Everyday Objects

12/20/2020
by   Thomas Kosch, et al.
0

Digital interaction with everyday objects has become popular since the proliferation of camera-based systems that detect and augment objects "just-in-time". Common systems use a vision-based approach to detect objects and display their functionalities to the user. Sensors, such as color and depth cameras, have become inexpensive and allow seamless environmental tracking in mobile as well as stationary settings. However, object detection in different contexts faces challenges as it highly depends on environmental parameters and the conditions of the object itself. In this work, we present three tracking algorithms which we have employed in past research projects to track and recognize objects. We show, how mobile and stationary augmented reality can be used to extend the functionalities of objects. We conclude, how common items can provide user-defined tangible interaction beyond their regular functionality.

READ FULL TEXT

page 1

page 3

page 4

research
11/17/2022

Multi-Camera Multi-Object Tracking on the Move via Single-Stage Global Association Approach

The development of autonomous vehicles generates a tremendous demand for...
research
03/22/2022

Detection, Recognition, and Tracking: A Survey

For humans, object detection, recognition, and tracking are innate. Thes...
research
09/05/2017

6D Object Pose Estimation with Depth Images: A Seamless Approach for Robotic Interaction and Augmented Reality

To determine the 3D orientation and 3D location of objects in the surrou...
research
03/11/2016

Region Graph Based Method for Multi-Object Detection and Tracking using Depth Cameras

In this paper, we propose a multi-object detection and tracking method u...
research
11/18/2021

Semantic Interaction in Augmented Reality Environments for Microsoft HoloLens

Augmented Reality is a promising technique for human-machine interaction...
research
09/06/2018

On-Orbit Smart Camera System to Observe Illuminated and Unilluminated Space Objects

The wide availability of Commercial Off-The-Shelf (COTS) electronics tha...
research
01/25/2021

They See Me Rollin': Inherent Vulnerability of the Rolling Shutter in CMOS Image Sensors

Cameras have become a fundamental component of vision-based intelligent ...

Please sign up or login with your details

Forgot password? Click here to reset