Towards High-Quality Specular Highlight Removal by Leveraging Large-Scale Synthetic Data

09/12/2023
by   Gang Fu, et al.
0

This paper aims to remove specular highlights from a single object-level image. Although previous methods have made some progresses, their performance remains somewhat limited, particularly for real images with complex specular highlights. To this end, we propose a three-stage network to address them. Specifically, given an input image, we first decompose it into the albedo, shading, and specular residue components to estimate a coarse specular-free image. Then, we further refine the coarse result to alleviate its visual artifacts such as color distortion. Finally, we adjust the tone of the refined result to match that of the input as closely as possible. In addition, to facilitate network training and quantitative evaluation, we present a large-scale synthetic dataset of object-level images, covering diverse objects and illumination conditions. Extensive experiments illustrate that our network is able to generalize well to unseen real object-level images, and even produce good results for scene-level images with multiple background objects and complex lighting.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 7

page 8

research
08/16/2021

Text-Aware Single Image Specular Highlight Removal

Removing undesirable specular highlight from a single input image is of ...
research
07/20/2022

M2-Net: Multi-stages Specular Highlight Detection and Removal in Multi-scenes

In this paper, we propose a novel uniformity framework for highlight det...
research
12/13/2022

MegaPose: 6D Pose Estimation of Novel Objects via Render Compare

We introduce MegaPose, a method to estimate the 6D pose of novel objects...
research
03/22/2022

CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training

Recent image inpainting methods have made great progress but often strug...
research
03/23/2023

SIEDOB: Semantic Image Editing by Disentangling Object and Background

Semantic image editing provides users with a flexible tool to modify a g...
research
04/15/2020

ALCN: Adaptive Local Contrast Normalization

To make Robotics and Augmented Reality applications robust to illuminati...
research
03/09/2022

Align-Deform-Subtract: An Interventional Framework for Explaining Object Differences

Given two object images, how can we explain their differences in terms o...

Please sign up or login with your details

Forgot password? Click here to reset