RealityCanvas: Augmented Reality Sketching for Embedded and Responsive Scribble Animation Effects

07/30/2023
by   Zhijie Xia, et al.
0

We introduce RealityCanvas, a mobile AR sketching tool that can easily augment real-world physical motion with responsive hand-drawn animation. Recent research in AR sketching tools has enabled users to not only embed static drawings into the real world but also dynamically animate them with physical motion. However, existing tools often lack the flexibility and expressiveness of possible animations, as they primarily support simple line-based geometry. To address this limitation, we explore both expressive and improvisational AR sketched animation by introducing a set of responsive scribble animation techniques that can be directly embedded through sketching interactions: 1) object binding, 2) flip-book animation, 3) action trigger, 4) particle effects, 5) motion trajectory, and 6) contour highlight. These six animation effects were derived from the analysis of 172 existing video-edited scribble animations. We showcase these techniques through various applications, such as video creation, augmented education, storytelling, and AR prototyping. The results of our user study and expert interviews confirm that our tool can lower the barrier to creating AR-based sketched animation, while allowing creative, expressive, and improvisational AR sketching experiences.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 9

page 10

research
02/21/2023

Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine Teaching

This paper introduces Teachable Reality, an augmented reality (AR) proto...
research
08/19/2020

RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic Sketching

We present RealitySketch, an augmented reality interface for sketching i...
research
08/12/2022

RealityTalk: Real-Time Speech-Driven Augmented Presentation for AR Live Storytelling

We present RealityTalk, a system that augments real-time live presentati...
research
07/30/2023

Augmented Math: Authoring AR-Based Explorable Explanations by Augmenting Static Math Textbooks

We introduce Augmented Math, a machine learning-based approach to author...
research
11/28/2022

Exploring Immersive Interpersonal Communication via AR

A central challenge of social computing research is to enable people to ...
research
08/25/2019

Color Blending in Outdoor Optical See-through AR: The Effect of Real-world Backgrounds on User Interface Color

It has been noted anecdotally and through a small number of formal studi...
research
02/15/2021

Context-Responsive Labeling in Augmented Reality

Route planning and navigation are common tasks that often require additi...

Please sign up or login with your details

Forgot password? Click here to reset