Lightform: Procedural Effects for Projected AR

12/25/2019
by   Brittany Factura, et al.
0

Projected augmented reality, also called projection mapping or video mapping, is a form of augmented reality that uses projected light to directly augment 3D surfaces, as opposed to using pass-through screens or headsets. The value of projected AR is its ability to add a layer of digital content directly onto physical objects or environments in a way that can be instantaneously viewed by multiple people, unencumbered by a screen or additional setup. Because projected AR typically involves projecting onto non-flat, textured objects (especially those that are conventionally not used as projection surfaces), the digital content needs to be mapped and aligned to precisely fit the physical scene to ensure a compelling experience. Current projected AR techniques require extensive calibration at the time of installation, which is not conducive to iteration or change, whether intentional (the scene is reconfigured) or not (the projector is bumped or settles). The workflows are undefined and fragmented, thus making it confusing and difficult for many to approach projected AR. For example, a digital artist may have the software expertise to create AR content, but could not complete an installation without experience in mounting, blending, and realigning projector(s); the converse is true for many A/V installation teams/professionals. Projection mapping has therefore been limited to high-end event productions, concerts, and films, because it requires expensive, complex tools, and skilled teams (100K+ budgets). Lightform provides a technology that makes projected AR approachable, practical, intelligent, and robust through integrated hardware and computer-vision software. Lightform brings together and unites a currently fragmented workflow into a single cohesive process that provides users with an approachable and robust method to create and control projected AR experiences.

READ FULL TEXT
research
04/10/2017

Projection Mapping Technologies for AR

This invited talk will present recent projection mapping technologies fo...
research
08/28/2021

SceneAR: Scene-based Micro Narratives for Sharing and Remixing in Augmented Reality

Short-form digital storytelling has become a popular medium for millions...
research
03/27/2021

AR Mapping: Accurate and Efficient Mapping for Augmented Reality

Augmented reality (AR) has gained increasingly attention from both resea...
research
10/08/2021

Multifocal Stereoscopic Projection Mapping

Stereoscopic projection mapping (PM) allows a user to see a three-dimens...
research
08/18/2020

Retargetable AR: Context-aware Augmented Reality in Indoor Scenes based on 3D Scene Graph

In this paper, we present Retargetable AR, a novel AR framework that yie...
research
06/11/2023

Neural Projection Mapping Using Reflectance Fields

We introduce a high resolution spatially adaptive light source, or a pro...
research
06/29/2023

Evaluation of Environmental Conditions on Object Detection using Oriented Bounding Boxes for AR Applications

The objective of augmented reality (AR) is to add digital content to nat...

Please sign up or login with your details

Forgot password? Click here to reset