DeepAI AI Chat
Log In Sign Up

ShapeFindAR: Exploring In-Situ Spatial Search for Physical Artifact Retrieval using Mixed Reality

by   Evgeny Stemasov, et al.
Télécom Paris
Universität Ulm

Personal fabrication is made more accessible through repositories like Thingiverse, as they replace modeling with retrieval. However, they require users to translate spatial requirements to keywords, which paints an incomplete picture of physical artifacts: proportions or morphology are non-trivially encoded through text only. We explore a vision of in-situ spatial search for (future) physical artifacts, and present ShapeFindAR, a mixed-reality tool to search for 3D models using in-situ sketches blended with textual queries. With ShapeFindAR, users search for geometry, and not necessarily precise labels, while coupling the search process to the physical environment (e.g., by sketching in-situ, extracting search terms from objects present, or tracing them). We developed ShapeFindAR for HoloLens 2, connected to a database of 3D-printable artifacts. We specify in-situ spatial search, describe its advantages, and present walkthroughs using ShapeFindAR, which highlight novel ways for users to articulate their wishes, without requiring complex modeling tools or profound domain knowledge.


page 2

page 3

page 4

page 5

page 6

page 10

page 11

page 12


The VISIONE Video Search System: Exploiting Off-the-Shelf Text Search Engines for Large-Scale Video Retrieval

In this paper, we describe VISIONE, a video search system that allows us...

Semantic Search by Latent Ontological Features

Both named entities and keywords are important in defining the content o...

Exploring Configuration of Mixed Reality Spaces for Communication

Mixed Reality (MR) enables users to explore a wonderland which is not re...

ArcAid: Analysis of Archaeological Artifacts using Drawings

Archaeology is an intriguing domain for computer vision. It suffers not ...

Cross-Reality Re-Rendering: Manipulating between Digital and Physical Realities

The advent of personalized reality has arrived. Rapid development in AR/...