Totems: Physical Objects for Verifying Visual Integrity

09/26/2022
by   Jingwei Ma, et al.
4

We introduce a new approach to image forensics: placing physical refractive objects, which we call totems, into a scene so as to protect any photograph taken of that scene. Totems bend and redirect light rays, thus providing multiple, albeit distorted, views of the scene within a single image. A defender can use these distorted totem pixels to detect if an image has been manipulated. Our approach unscrambles the light rays passing through the totems by estimating their positions in the scene and using their known geometric and material properties. To verify a totem-protected image, we detect inconsistencies between the scene reconstructed from totem viewpoints and the scene's appearance from the camera viewpoint. Such an approach makes the adversarial manipulation task more difficult, as the adversary must modify both the totem and image pixels in a geometrically consistent manner without knowing the physical properties of the totem. Unlike prior learning-based approaches, our method does not require training on datasets of specific manipulations, and instead uses physical properties of the scene and camera to solve the forensics problem.

READ FULL TEXT

page 1

page 10

page 11

page 12

page 23

page 25

page 26

research
08/19/2020

Deep Relighting Networks for Image Light Source Manipulation

Manipulating the light source of given images is an interesting task and...
research
07/16/2018

Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning

Recent approaches on visual scene understanding attempt to build a scene...
research
04/02/2023

altiro3D: Scene representation from single image and novel view synthesis

We introduce altiro3D, a free extended library developed to represent re...
research
04/07/2020

Semantic Image Manipulation Using Scene Graphs

Image manipulation can be considered a special case of image generation ...
research
08/20/2021

A Multiple-View Geometric Model for Specularity Prediction on Non-Uniformly Curved Surfaces

Specularity prediction is essential to many computer vision applications...
research
10/16/2018

Projecting Trouble: Light Based Adversarial Attacks on Deep Learning Classifiers

This work demonstrates a physical attack on a deep learning image classi...
research
10/31/2022

Real-time Mapping of Physical Scene Properties with an Autonomous Robot Experimenter

Neural fields can be trained from scratch to represent the shape and app...

Please sign up or login with your details

Forgot password? Click here to reset