ARShoe: Real-Time Augmented Reality Shoe Try-on System on Smartphones

08/24/2021
by   Shan An, et al.
10

Virtual try-on technology enables users to try various fashion items using augmented reality and provides a convenient online shopping experience. However, most previous works focus on the virtual try-on for clothes while neglecting that for shoes, which is also a promising task. To this concern, this work proposes a real-time augmented reality virtual shoe try-on system for smartphones, namely ARShoe. Specifically, ARShoe adopts a novel multi-branch network to realize pose estimation and segmentation simultaneously. A solution to generate realistic 3D shoe model occlusion during the try-on process is presented. To achieve a smooth and stable try-on effect, this work further develop a novel stabilization method. Moreover, for training and evaluation, we construct the very first large-scale foot benchmark with multiple virtual shoe try-on task-related labels annotated. Exhaustive experiments on our newly constructed benchmark demonstrate the satisfying performance of ARShoe. Practical tests on common smartphones validate the real-time performance and stabilization of the proposed approach.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 8

research
06/25/2018

Vision-based Pose Estimation for Augmented Reality : A Comparison Study

Augmented reality aims to enrich our real world by inserting 3D virtual ...
research
08/26/2023

DM-VTON: Distilled Mobile Real-time Virtual Try-On

The fashion e-commerce industry has witnessed significant growth in rece...
research
12/19/2017

Real-time deep hair matting on mobile devices

Augmented reality is an emerging technology in many application domains....
research
06/28/2019

Non-user Inclusive Design for Maintaining Harmony of Real-Virtual Human Interaction in Augmented Reality

Augmented reality enables the illusion of contents such as objects and h...
research
12/27/2019

One Point, One Object: Simultaneous 3D Object Segmentation and 6-DOF Pose Estimation

We propose a single-shot method for simultaneous 3D object segmentation ...
research
10/05/2020

Ego-Motion Alignment from Face Detections for Collaborative Augmented Reality

Sharing virtual content among multiple smart glasses wearers is an essen...
research
08/01/2020

PanoNet: Real-time Panoptic Segmentation through Position-Sensitive Feature Embedding

We propose a simple, fast, and flexible framework to generate simultaneo...

Please sign up or login with your details

Forgot password? Click here to reset