The Contextual Loss for Image Transformation with Non-Aligned Data

03/06/2018
by   Roey Mechrez, et al.
0

Feed-forward CNNs trained for image transformation problems rely on loss functions that measure the similarity between the generated image and a target image. Most of the common loss functions assume that these images are spatially aligned and compare pixels at corresponding locations. However, for many tasks, aligned training pairs of images will not be available. We present an alternative loss function that does not require alignment, thus providing an effective and simple solution for a new space of problems. Our loss is based on both context and semantics -- it compares regions with similar semantic meaning, while considering the context of the entire image. Hence, for example, when transferring the style of one face to another, it will translate eyes-to-eyes and mouth-to-mouth.

READ FULL TEXT

page 1

page 2

page 8

page 10

page 11

page 12

page 13

page 14

research
03/27/2016

Perceptual Losses for Real-Time Style Transfer and Super-Resolution

We consider image transformation problems, where an input image is trans...
research
05/29/2017

The Principle of Logit Separation

We consider neural network training, in applications in which there are ...
research
05/04/2022

Homography-Based Loss Function for Camera Pose Regression

Some recent visual-based relocalization algorithms rely on deep learning...
research
03/10/2016

Texture Networks: Feed-forward Synthesis of Textures and Stylized Images

Gatys et al. recently demonstrated that deep networks can generate beaut...
research
10/22/2019

Penalizing small errors using an Adaptive Logarithmic Loss

Loss functions are error metrics that quantify the difference between a ...
research
04/09/2022

Self-Labeling Refinement for Robust Representation Learning with Bootstrap Your Own Latent

In this work, we have worked towards two major goals. Firstly, we have i...
research
11/30/2020

Persistent Reductions in Regularized Loss Minimization for Variable Selection

In the context of regularized loss minimization with polyhedral gauges, ...

Please sign up or login with your details

Forgot password? Click here to reset