Test-Time Adaptation for Out-of-distributed Image Inpainting

02/02/2021
by   Chajin Shin, et al.
17

Deep learning-based image inpainting algorithms have shown great performance via powerful learned prior from the numerous external natural images. However, they show unpleasant results on the test image whose distribution is far from the that of training images because their models are biased toward the training images. In this paper, we propose a simple image inpainting algorithm with test-time adaptation named AdaFill. Given a single out-of-distributed test image, our goal is to complete hole region more naturally than the pre-trained inpainting models. To achieve this goal, we treat remained valid regions of the test image as another training cues because natural images have strong internal similarities. From this test-time adaptation, our network can exploit externally learned image priors from the pre-trained features as well as the internal prior of the test image explicitly. Experimental results show that AdaFill outperforms other models on the various out-of-distribution test images. Furthermore, the model named ZeroFill, that are not pre-trained also sometimes outperforms the pre-trained models.

READ FULL TEXT

page 4

page 6

page 7

page 8

page 9

page 10

page 11

page 12

research
08/18/2022

Evaluating Continual Test-Time Adaptation for Contextual and Semantic Domain Shifts

In this paper, our goal is to adapt a pre-trained Convolutional Neural N...
research
08/03/2022

Learning Prior Feature and Attention Enhanced Image Inpainting

Many recent inpainting works have achieved impressive results by leverag...
research
09/01/2022

Visual Prompting via Image Inpainting

How does one adapt a pre-trained visual model to novel downstream tasks ...
research
12/14/2020

Deep Optimized Priors for 3D Shape Modeling and Reconstruction

Many learning-based approaches have difficulty scaling to unseen data, a...
research
02/21/2020

Learning to Inpaint by Progressively Growing the Mask Regions

Image inpainting is one of the most challenging tasks in computer vision...
research
02/16/2021

Restore from Restored: Single-image Inpainting

Recent image inpainting methods show promising results due to the power ...
research
01/19/2022

Enhanced Performance of Pre-Trained Networks by Matched Augmentation Distributions

There exists a distribution discrepancy between training and testing, in...

Please sign up or login with your details

Forgot password? Click here to reset