Holistic Multi-View Building Analysis in the Wild with Projection Pooling

08/23/2020
by   Zbigniew Wojna, et al.
5

We address six different classification tasks related to fine-grained building attributes: construction type, number of floors, pitch, and geometry of the roof, facade material, and occupancy class. Tackling such a problem of remote building analysis became possible only recently due to growing large-scale datasets of urban scenes. To this end, we introduce a new benchmarking dataset, consisting of 49426 top-view and street-view images of 9674 buildings. These photos are further assembled, together with the geometric metadata. The dataset showcases a variety of real-world challenges, such as occlusions, blur, partially visible objects, and a broad spectrum of buildings. We propose a new projection pooling layer, creating a unified, top-view representation of the top-view and the side views in a high-dimensional space. It allows us to utilize the building and imagery metadata seamlessly. Introducing this layer improves classification accuracy – compared to highly tuned baseline models – indicating its suitability for building analysis.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 9

page 19

page 20

page 21

page 22

page 23

page 25

10/03/2020

Bounding Boxes Are All We Need: Street View Image Classification via Context Encoding of Detected Buildings

Street view images have been increasingly used in tasks like urban land ...
10/27/2021

TMBuD: A dataset for urban scene building detection

Building recognition and 3D reconstruction of human made structures in u...
10/14/2019

Building Information Modeling and Classification by Visual Learning At A City Scale

In this paper, we provide two case studies to demonstrate how artificial...
07/25/2019

Simultaneous multi-view instance detection with learned geometric soft-constraints

We propose to jointly learn multi-view geometry and warping between view...
03/28/2019

SpaceNet MVOI: a Multi-View Overhead Imagery Dataset

Detection and segmentation of objects in overheard imagery is a challeng...
03/27/2019

Privacy Protection in Street-View Panoramas using Depth and Multi-View Imagery

The current paradigm in privacy protection in street-view images is to d...
10/27/2018

3D Terrain Segmentation in the SWIR Spectrum

We focus on the automatic 3D terrain segmentation problem using hyperspe...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.