Szloca: towards a framework for full 3D tracking through a single camera in context of interactive arts

06/26/2022
by   Sahaj Garg, et al.
6

Realtime virtual data of objects and human presence in a large area holds a valuable key in enabling many experiences and applications in various industries and with exponential rise in the technological development of artificial intelligence, computer vision has expanded the possibilities of tracking and classifying things through just video inputs, which is also surpassing the limitations of most popular and common hardware setups known traditionally to detect human pose and position, such as low field of view and limited tracking capacity. The benefits of using computer vision in application development is large as it augments traditional input sources (like video streams) and can be integrated in many environments and platforms. In the context of new media interactive arts, based on physical movements and expanding over large areas or gallaries, this research presents a novel way and a framework towards obtaining data and virtual representation of objects/people - such as three-dimensional positions, skeltons/pose and masks from a single rgb camera. Looking at the state of art through some recent developments and building on prior research in the field of computer vision, the paper also proposes an original method to obtain three dimensional position data from monocular images, the model does not rely on complex training of computer vision systems but combines prior computer vision research and adds a capacity to represent z depth, ieto represent a world position in 3 axis from a 2d input source.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 10

page 11

research
01/02/2004

Cyborg Systems as Platforms for Computer-Vision Algorithm-Development for Astrobiology

Employing the allegorical imagery from the film "The Matrix", we motivat...
research
01/18/2023

A Survey of Advanced Computer Vision Techniques for Sports

Computer Vision developments are enabling significant advances in many f...
research
07/01/2020

The IKEA ASM Dataset: Understanding People Assembling Furniture through Actions, Objects and Pose

The availability of a large labeled dataset is a key requirement for app...
research
11/12/2017

Evaluation of trackers for Pan-Tilt-Zoom Scenarios

Tracking with a Pan-Tilt-Zoom (PTZ) camera has been a research topic in ...
research
05/18/2023

LDM3D: Latent Diffusion Model for 3D

This research paper proposes a Latent Diffusion Model for 3D (LDM3D) tha...
research
10/09/2015

Procams-Based Cybernetics

Procams-based cybernetics is a unique, emerging research field, which ai...
research
01/10/2021

Activity Recognition with Moving Cameras and Few Training Examples: Applications for Detection of Autism-Related Headbanging

Activity recognition computer vision algorithms can be used to detect th...

Please sign up or login with your details

Forgot password? Click here to reset