Socioeconomic correlations of urban patterns inferred from aerial images: interpreting activation maps of Convolutional Neural Networks

04/10/2020
by   Jacob Levy Abitbol, et al.
0

Urbanisation is a great challenge for modern societies, promising better access to economic opportunities while widening socioeconomic inequalities. Accurately tracking how this process unfolds has been challenging for traditional data collection methods, while remote sensing information offers an alternative to gather a more complete view on these societal changes. By feeding a neural network with satellite images one may recover the socioeconomic information associated to that area, however these models lack to explain how visual features contained in a sample, trigger a given prediction. Here we close this gap by predicting socioeconomic status across France from aerial images and interpreting class activation mappings in terms of urban topology. We show that the model disregards the spatial correlations existing between urban class and socioeconomic status to derive its predictions. These results pave the way to build interpretable models, which may help to better track and understand urbanisation and its consequences.

READ FULL TEXT

page 3

page 4

page 5

page 13

page 14

page 15

page 16

page 17

research
08/11/2017

GlobeNet: Convolutional Neural Networks for Typhoon Eye Tracking from Remote Sensing Imagery

Advances in remote sensing technologies have made it possible to use hig...
research
08/25/2021

Understanding of Kernels in CNN Models by Suppressing Irrelevant Visual Features in Images

Deep learning models have shown their superior performance in various vi...
research
07/18/2018

Take a Look Around: Using Street View and Satellite Images to Estimate House Prices

When an individual purchases a home, they simultaneously purchase its st...
research
02/09/2023

3D reconstruction of spherical images: A review of techniques, applications, and prospects

3D reconstruction plays an increasingly important role in modern photogr...
research
03/16/2020

RSVQA: Visual Question Answering for Remote Sensing Data

This paper introduces the task of visual question answering for remote s...
research
02/25/2022

Sensing accident-prone features in urban scenes for proactive driving and accident prevention

In urban cities, visual information along and on roadways is likely to d...

Please sign up or login with your details

Forgot password? Click here to reset