Controllable Style Transfer via Test-time Training of Implicit Neural Representation

10/14/2022
by   Sunwoo Kim, et al.
0

We propose a controllable style transfer framework based on Implicit Neural Representation that pixel-wisely controls the stylized output via test-time training. Unlike traditional image optimization methods that often suffer from unstable convergence and learning-based methods that require intensive training and have limited generalization ability, we present a model optimization framework that optimizes the neural networks during test-time with explicit loss functions for style transfer. After being test-time trained once, thanks to the flexibility of the INR-based model, our framework can precisely control the stylized images in a pixel-wise manner and freely adjust image resolution without further optimization or training. We demonstrate several applications.

READ FULL TEXT

page 13

page 14

page 15

page 16

page 17

page 18

page 19

page 20

research
12/12/2021

Deep Translation Prior: Test-time Training for Photorealistic Style Transfer

Recent techniques to solve photorealistic style transfer within deep con...
research
02/20/2018

Stroke Controllable Fast Style Transfer with Adaptive Receptive Fields

Recently, in the community of Neural Style Transfer, several algorithms ...
research
08/15/2023

StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models

Content and style (C-S) disentanglement is a fundamental problem and cri...
research
03/20/2023

Open-World Pose Transfer via Sequential Test-Time Adaption

Pose transfer aims to transfer a given person into a specified posture, ...
research
09/24/2020

Style-invariant Cardiac Image Segmentation with Test-time Augmentation

Deep models often suffer from severe performance drop due to the appeara...
research
03/27/2017

StyleBank: An Explicit Representation for Neural Image Style Transfer

We propose StyleBank, which is composed of multiple convolution filter b...
research
02/28/2023

Temporal Coherent Test-Time Optimization for Robust Video Classification

Deep neural networks are likely to fail when the test data is corrupted ...

Please sign up or login with your details

Forgot password? Click here to reset