DeepAI AI Chat
Log In Sign Up

"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priors

by   Yossi Gandelsman, et al.

Many seemingly unrelated computer vision tasks can be viewed as a special case of image decomposition into separate layers. For example, image segmentation (separation into foreground and background layers); transparent layer separation (into reflection and transmission layers); Image dehazing (separation into a clear image and a haze map), and more. In this paper we propose a unified framework for unsupervised layer decomposition of a single image, based on coupled "Deep-image-Prior" (DIP) networks. It was shown [Ulyanov et al] that the structure of a single DIP generator network is sufficient to capture the low-level statistics of a single image. We show that coupling multiple such DIPs provides a powerful tool for decomposing images into their basic components, for a wide variety of applications. This capability stems from the fact that the internal statistics of a mixture of layers is more complex than the statistics of each of its individual components. We show the power of this approach for Image-Dehazing, Fg/Bg Segmentation, Watermark-Removal, Transparency Separation in images and video, and more. These capabilities are achieved in a totally unsupervised way, with no training examples other than the input image/video itself.


page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8


Separate from Observation: Unsupervised Single Image Layer Separation

Unsupervised single image layer separation aims at extracting two layers...

Semantic Guided Single Image Reflection Removal

Reflection is common in images capturing scenes behind a glass window, w...

Learning to Separate Multiple Illuminants in a Single Image

We present a method to separate a single image captured under two illumi...

Controllable Attention for Structured Layered Video Decomposition

The objective of this paper is to be able to separate a video into its n...

A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing

This paper proposes a deep neural network structure that exploits edge i...

Leveraging Multi-view Image Sets for Unsupervised Intrinsic Image Decomposition and Highlight Separation

We present an unsupervised approach for factorizing object appearance in...