BrickPal: Augmented Reality-based Assembly Instructions for Brick Models

07/06/2023
by   Yao Shi, et al.
0

The assembly instruction is a mandatory component of Lego-like brick sets.The conventional production of assembly instructions requires a considerable amount of manual fine-tuning, which is intractable for casual users and customized brick sets.Moreover, the traditional paper-based instructions lack expressiveness and interactivity.To tackle the two problems above, we present BrickPal, an augmented reality-based system, which visualizes assembly instructions in an augmented reality head-mounted display. It utilizes Natural Language Processing (NLP) techniques to generate plausible assembly sequences, and provide real-time guidance in the AR headset.Our user study demonstrates BrickPal's effectiveness at assisting users in brick assembly compared to traditional assembly methods. Additionally, the NLP algorithm-generated assembly sequences achieve the same usability with manually adapted sequences.

READ FULL TEXT

page 1

page 3

research
08/13/2022

BinBert: Binary Code Understanding with a Fine-tunable and Execution-aware Transformer

A recent trend in binary code analysis promotes the use of neural soluti...
research
09/07/2021

SketchMeHow: Interactive Projection Guided Task Instruction with User Sketches

In this work, we propose an interactive general instruction framework Sk...
research
06/11/2021

Small Object Detection for Near Real-Time Egocentric Perception in a Manual Assembly Scenario

Detecting small objects in video streams of head-worn augmented reality ...
research
01/07/2021

Object Detection for Understanding Assembly Instruction Using Context-aware Data Augmentation and Cascade Mask R-CNN

Understanding assembly instruction has the potential to enhance the robo...
research
11/19/2020

Towards the Development of 3D Engine Assembly Simulation Learning Module for Senior High School

The focus of the study is to develop a 3D engine assembly simulation lea...
research
08/21/2019

Design, Assembly, Calibration, and Measurement of an Augmented Reality Haploscope

A haploscope is an optical system which produces a carefully controlled ...

Please sign up or login with your details

Forgot password? Click here to reset