User configurable 3D object regeneration for spatial privacy

08/10/2021
by   Arpit Nama, et al.
0

Environmental understanding capability of augmented (AR) and mixed reality (MR) devices are continuously improving through advances in sensing, computer vision, and machine learning. Various AR/MR applications demonstrate such capabilities i.e. scanning a space using a handheld or head mounted device and capturing a digital representation of the space that are accurate copies of the real space. However, these capabilities impose privacy risks to users: personally identifiable information can leak from captured 3D maps of the sensitive spaces and/or captured sensitive objects within the mapped space. Thus, in this work, we demonstrate how we can leverage 3D object regeneration for preserving privacy of 3D point clouds. That is, we employ an intermediary layer of protection to transform the 3D point cloud before providing it to the third-party applications. Specifically, we use an existing adversarial autoencoder to generate copies of 3D objects where the likeness of the copies from the original can be varied. To test the viability and performance of this method as a privacy preserving mechanism, we use a 3D classifier to classify and identify these transformed point clouds i.e. perform super-class and intra-class classification. To measure the performance of the proposed privacy framework, we define privacy, Π∈[0,1], and utility metrics, Q∈[0,1], which are desired to be maximized. Experimental evaluation shows that the privacy framework can indeed variably effect the privacy of a 3D object by varying the privilege level l∈[0,1] i.e. if a low l<0.17 is maintained, Π_1,Π_2>0.4 is ensured where Π_1,Π_2 are super- and intra-class privacy. Lastly, the privacy framework can ensure relatively high intra-class privacy and utility i.e. Π_2>0.63 and Q>0.70, if the privilege level is kept within the range of 0.17<l<0.25.

READ FULL TEXT
research
04/17/2020

Conservative Plane Releasing for Spatial Privacy Protection in Mixed Reality

Augmented reality (AR) or mixed reality (MR) platforms require spatial u...
research
03/13/2019

Privacy Preserving Image-Based Localization

Image-based localization is a core component of many augmented/mixed rea...
research
02/15/2018

Security and Privacy Approaches in Mixed Reality: A Literature Survey

Mixed reality (MR) technology is now gaining ground due to advances in c...
research
07/20/2020

Privacy Preserving Visual SLAM

This study proposes a privacy-preserving Visual SLAM framework for estim...
research
03/12/2023

Adaptive Local Adversarial Attacks on 3D Point Clouds for Augmented Reality

As the key technology of augmented reality (AR), 3D recognition and trac...
research
02/10/2018

Distributed One-class Learning

We propose a cloud-based filter trained to block third parties from uplo...

Please sign up or login with your details

Forgot password? Click here to reset