Totems: Physical Objects for Verifying Visual Integrity

by   Jingwei Ma, et al.

We introduce a new approach to image forensics: placing physical refractive objects, which we call totems, into a scene so as to protect any photograph taken of that scene. Totems bend and redirect light rays, thus providing multiple, albeit distorted, views of the scene within a single image. A defender can use these distorted totem pixels to detect if an image has been manipulated. Our approach unscrambles the light rays passing through the totems by estimating their positions in the scene and using their known geometric and material properties. To verify a totem-protected image, we detect inconsistencies between the scene reconstructed from totem viewpoints and the scene's appearance from the camera viewpoint. Such an approach makes the adversarial manipulation task more difficult, as the adversary must modify both the totem and image pixels in a geometrically consistent manner without knowing the physical properties of the totem. Unlike prior learning-based approaches, our method does not require training on datasets of specific manipulations, and instead uses physical properties of the scene and camera to solve the forensics problem.


page 1

page 10

page 11

page 12

page 23

page 25

page 26


Deep Relighting Networks for Image Light Source Manipulation

Manipulating the light source of given images is an interesting task and...

Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning

Recent approaches on visual scene understanding attempt to build a scene...

altiro3D: Scene representation from single image and novel view synthesis

We introduce altiro3D, a free extended library developed to represent re...

Semantic Image Manipulation Using Scene Graphs

Image manipulation can be considered a special case of image generation ...

A Multiple-View Geometric Model for Specularity Prediction on Non-Uniformly Curved Surfaces

Specularity prediction is essential to many computer vision applications...

Projecting Trouble: Light Based Adversarial Attacks on Deep Learning Classifiers

This work demonstrates a physical attack on a deep learning image classi...

Real-time Mapping of Physical Scene Properties with an Autonomous Robot Experimenter

Neural fields can be trained from scratch to represent the shape and app...

Please sign up or login with your details

Forgot password? Click here to reset