Non-parametric spatially constrained local prior for scene parsing on real-world data

06/23/2020
by   Ligang Zhang, et al.
0

Scene parsing aims to recognize the object category of every pixel in scene images, and it plays a central role in image content understanding and computer vision applications. However, accurate scene parsing from unconstrained real-world data is still a challenging task. In this paper, we present the non-parametric Spatially Constrained Local Prior (SCLP) for scene parsing on realistic data. For a given query image, the non-parametric SCLP is learnt by first retrieving a subset of most similar training images to the query image and then collecting prior information about object co-occurrence statistics between spatial image blocks and between adjacent superpixels from the retrieved subset. The SCLP is powerful in capturing both long- and short-range context about inter-object correlations in the query image and can be effectively integrated with traditional visual features to refine the classification results. Our experiments on the SIFT Flow and PASCAL-Context benchmark datasets show that the non-parametric SCLP used in conjunction with superpixel-level visual features achieves one of the top performance compared with state-of-the-art approaches.

READ FULL TEXT

page 2

page 6

page 8

page 16

page 18

research
02/24/2018

Spatially Constrained Location Prior for Scene Parsing

Semantic context is an important and useful cue for scene parsing in com...
research
11/04/2020

Multi-layer Feature Aggregation for Deep Scene Parsing Models

Scene parsing from images is a fundamental yet challenging problem in vi...
research
10/17/2017

Scene Parsing with Global Context Embedding

We present a scene parsing method that utilizes global context informati...
research
04/20/2016

Scene Parsing with Integration of Parametric and Non-parametric Models

We adopt Convolutional Neural Networks (CNNs) to be our parametric model...
research
07/23/2023

EnTri: Ensemble Learning with Tri-level Representations for Explainable Scene Recognition

Scene recognition based on deep-learning has made significant progress, ...
research
12/26/2017

Segmenting Sky Pixels in Images

Outdoor scene parsing models are often trained on ideal datasets and pro...
research
11/19/2014

Visual Noise from Natural Scene Statistics Reveals Human Scene Category Representations

Our perceptions are guided both by the bottom-up information entering ou...

Please sign up or login with your details

Forgot password? Click here to reset