Generating Superpixels for High-resolution Images with Decoupled Patch Calibration

by   Yaxiong Wang, et al.
Xi'an Jiaotong University
Zhejiang University

Superpixel segmentation has recently seen important progress benefiting from the advances in differentiable deep learning. However, the very high-resolution superpixel segmentation still remains challenging due to the expensive memory and computation cost, making the current advanced superpixel networks fail to process. In this paper, we devise Patch Calibration Networks (PCNet), aiming to efficiently and accurately implement high-resolution superpixel segmentation. PCNet follows the principle of producing high-resolution output from low-resolution input for saving GPU memory and relieving computation cost. To recall the fine details destroyed by the down-sampling operation, we propose a novel Decoupled Patch Calibration (DPC) branch for collaboratively augment the main superpixel generation branch. In particular, DPC takes a local patch from the high-resolution images and dynamically generates a binary mask to impose the network to focus on region boundaries. By sharing the parameters of DPC and main branches, the fine-detailed knowledge learned from high-resolution patches will be transferred to help calibrate the destroyed information. To the best of our knowledge, we make the first attempt to consider the deep-learning-based superpixel generation for high-resolution cases. To facilitate this research, we build evaluation benchmarks from two public datasets and one new constructed one, covering a wide range of diversities from fine-grained human parts to cityscapes. Extensive experiments demonstrate that our PCNet can not only perform favorably against the state-of-the-arts in the quantitative results but also improve the resolution upper bound from 3K to 5K on 1080Ti GPUs.


page 1

page 2

page 3

page 6

page 8


Collaborative Global-Local Networks for Memory-Efficient Segmentation of Ultra-High Resolution Images

Segmentation of ultra-high resolution images is increasingly demanded, y...

High-Resolution Deep Image Matting

Image matting is a key technique for image and video editing and composi...

Differentiable Patch Selection for Image Recognition

Neural Networks require large amounts of memory and compute to process h...

Guided Patch-Grouping Wavelet Transformer with Spatial Congruence for Ultra-High Resolution Segmentation

Most existing ultra-high resolution (UHR) segmentation methods always st...

HRFNet: High-Resolution Forgery Network for Localizing Satellite Image Manipulation

Existing high-resolution satellite image forgery localization methods re...

Learning Mutually Local-global U-nets For High-resolution Retinal Lesion Segmentation in Fundus Images

Diabetic retinopathy is the most important complication of diabetes. Ear...

Learning to Downsample for Segmentation of Ultra-High Resolution Images

Segmentation of ultra-high resolution images with deep learning is chall...

Please sign up or login with your details

Forgot password? Click here to reset