SiENet: Siamese Expansion Network for Image Extrapolation

07/08/2020
by   Xiaofeng Zhang, et al.
0

Different from image inpainting, image outpainting has relative less context in the image center to capture and more content at the image border to predict. Therefore, classical encoder-decoder pipeline of existing methods may not predict the outstretched unknown content perfectly. In this paper, a novel two-stage siamese adversarial model for image extrapolation, named Siamese Expansion Network (SiENet) is proposed. In two stages, a novel border sensitive convolution named adaptive filling convolution is designed for allowing encoder to predict the unknown content, alleviating the burden of decoder. Besides, to introduce prior knowledge to network and reinforce the inferring ability of encoder, siamese adversarial mechanism is designed to enable our network to model the distribution of covered long range feature for that of uncovered image feature. The results on four datasets has demonstrated that our method outperforms existing state-of-the-arts and could produce realistic results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/14/2020

Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations

Deep encoder-decoder based CNNs have advanced image inpainting methods f...
research
02/16/2023

Personalized Audio Quality Preference Prediction

This paper proposes to use both audio input and subject information to p...
research
12/20/2022

Content Adaptive Latents and Decoder for Neural Image Compression

In recent years, neural image compression (NIC) algorithms have shown po...
research
05/28/2020

CGGAN: A Context Guided Generative Adversarial Network For Single Image Dehazing

Image haze removal is highly desired for the application of computer vis...
research
08/18/2021

Towards Deep and Efficient: A Deep Siamese Self-Attention Fully Efficient Convolutional Network for Change Detection in VHR Images

Recently, FCNs have attracted widespread attention in the CD field. In p...
research
06/07/2022

Wavelet Prior Attention Learning in Axial Inpainting Network

Image inpainting is the task of filling masked or unknown regions of an ...
research
11/05/2020

Hyperrealistic Image Inpainting with Hypergraphs

Image inpainting is a non-trivial task in computer vision due to multipl...

Please sign up or login with your details

Forgot password? Click here to reset