Census-Independent Population Estimation using Representation Learning

10/06/2021
by   Isaac Neal, et al.
UNICEF
0

Knowledge of population distribution is critical for building infrastructure, distributing resources, and monitoring the progress of sustainable development goals. Although censuses can provide this information, they are typically conducted every ten years with some countries having forgone the process for several decades. Population can change in the intercensal period due to rapid migration, development, urbanisation, natural disasters, and conflicts. Census-independent population estimation approaches using alternative data sources, such as satellite imagery, have shown promise in providing frequent and reliable population estimates locally. Existing approaches, however, require significant human supervision, for example annotating buildings and accessing various public datasets, and therefore, are not easily reproducible. We explore recent representation learning approaches, and assess the transferability of representations to population estimation in Mozambique. Using representation learning reduces required human supervision, since features are extracted automatically, making the process of population estimation more sustainable and likely to be transferable to other regions or countries. We compare the resulting population estimates to existing population products from GRID3, Facebook (HRSL) and WorldPop. We observe that our approach matches the most accurate of these maps, and is interpretable in the sense that it recognises built-up areas to be an informative indicator of population.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 6

page 8

page 9

page 11

04/26/2021

Towards Sustainable Census Independent Population Estimation in Mozambique

Reliable and frequent population estimation is key for making policies a...
04/02/2020

Patterns of population displacement during mega-fires in California detected using Facebook Disaster Maps

Facebook Disaster Maps (FBDM) is the first platform providing analysis-r...
12/15/2017

Mapping the world population one building at a time

High resolution datasets of population density which accurately map spar...
04/15/2021

Micro-Estimates of Wealth for all Low- and Middle-Income Countries

Many critical policy decisions, from strategic investments to the alloca...
07/29/2021

Mapping Vulnerable Populations with AI

Humanitarian actions require accurate information to efficiently delegat...
02/23/2021

The SpaceNet Multi-Temporal Urban Development Challenge

Building footprints provide a useful proxy for a great many humanitarian...
01/05/2020

Decline of war or end of positive check? Analysis of change in war size distribution between 1816-2007

This study examines whether there has been a decline in the risk of deat...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction

Accurate population maps are critical for planning infrastructure and distributing resources, including public health interventions and disaster relief, as well as monitoring well-being e.g. through the fulfillment of sustainable development goals [20]. Censuses provide a ‘gold standard’ population map by surveying every individual household nationally. However, this is an extremely expensive endeavor, and therefore they are typically conducted every ten years [21]. During the intercensal period projections of the population are available at a coarser enumeration level that is estimated either using birth, death, and migration rates [20], or through combining sample household surveys using small area estimation [21]. Estimating finer-resolution intercensal population, e.g., over a grid, has received significant interest in the last decade, and several population maps, e.g. WorldPop [17], High-Resolution Settlement Layer (HRSL) [15, 23] and GRID3 [2], have been made available publicly to aid humanitarian initiatives. These approaches primarily use satellite imagery as a predictor, and can be broadly categorized as census-dependent and census-independent

based on their use of census as response variable

[25].

Census-independent population estimation approaches (§2.1) using microcensus (survey data) are gaining prominence since they can improve the spatial and temporal resolution of census-dependent approaches (§2.2). However, finding census-independent methods that are sustainable and transferable, and informative data sources that are reliable and easy to procure remain active areas of research. Existing approaches rely heavily on hand-crafted features that often require manual curation, and the features used in modelling vary significantly between publications and countries where population is being estimated, making them less sustainable for repeated use, and less transferable to other regions and countries. For example, these approaches often use objects in satellite imagery, e.g., buildings and cars, [6] and distribution of services, e.g., school density [16] and road networks [25], as indicators of population. Detecting building footprints usually requires manual annotation and curation while information on road networks and school density can be incomplete, unreliable, and difficult to procure.

Recent advances in representation learning have demonstrated that features, or representations

, automatically extracted from images through end-to-end training of a deep neural network can significantly improve the performance in many computer vision tasks in a sustainable manner by removing the need for hand-crafted features

[19]. Additionally, transfer learning can leverage features learned from a vast amount of annotated data from a separate task to improve performance on tasks lacking sufficient annotated data [1]. Furthermore, explainable AI has provided meaningful insight from these, so called ‘black box’, models to explain the decisions made by them, enhancing their transparency [18]

. Representation learning can vastly simplify the problem of estimating population from satellite imagery by removing the need for handcrafted features, manual data procurement, and human supervision, thus improving the sustainability and transferability of the process. Additionally, transfer learning removes the need for large scale training data, allowing fine-tuning on limited microcensus with minimal computational resources. Finally, these methods provide interpretation of model outcome, promoting trust around the estimated population among the end-users.

We assess the utility of representation learning in census-independent population estimation from very-high-resolution () satellite imagery using a retrospective microcensus in two districts of Mozambique. To the best of our knowledge, we are the first to explore the potential of such approach, and in using both very-high ( spatial) resolution satellite imagery and microcensus in this manner. We observe that the proposed approach is able to produce a reliable medium-resolution () population density map with minimal human supervision and computational resources. We find that this approach performs similar to the more elaborate approach of using building footprints to estimate population, and outperforms techniques using only public datasets to estimate population in our ROIs (Table 3). It also completely avoids manual annotation of satellite images and manual access to public datasets making it potentially more transferable to other countries using only very-high-resolution satellite imagery and gridded microcensus. Additionally, we observe that this approach learns to predict population in a reasonable manner by using built-up area as an indicator of population. We refer to this approach as Sustainable Census-Independent Population Estimation or SCIPE (see Figure 1 for an illustration), with our core motivation being developing population estimation methods that are easy to use, computationally efficient, and that can produce frequent and explainable population maps with associated uncertainty values. This will help humanitarian organizations extrapolate local microcensus information to regional level with ease, and provide more confidence in using the estimated population map in conjunction with existing ones.

Performance
ROI Input Resolution Output Resolution Input Data Cost Validation MeAPE
Kano and Kaduna, Nigeria [26] (Maxar) High (Maxar) Survey (same region) - 0.98
Sri Lanka [6]
(Object shape data)
12- (Settlement Layer)
(Night time Lights)
Village level
Free (Landsat)
High (Maxar)
Train / test split 28 0.58
Bo, Sierra Leone [9] (Landsat) City district level Free (public data) LOOCV 11 -
Nigeria [16]
(Maxar),
(WorldPop),
various (OSM school
density, household size)
Free (OSM,
WorldPop)
High (Maxar)
Train / test split - 0.26
Table 1: Summary of recent literature on census-independent population estimation. NOTE: ROI is region of interest, LOOCV is leave one out cross validation, MeAPEis median absolute percent error.

2 Background

In this section, we provide a detailed overview of the existing literature on census-independent population estimation (§2.1 and Table 1) and the application of deep neural networks in intercensal census-dependent population estimation (§2.2 and Table 2).

2.1 Census-independent population estimation

Census-dependent population estimation, also known as population disaggregation or top-down estimation, either uses census data to train a predictive model that can estimate population of a grid tile directly [20], or to train a model to estimate a weighted surface that can be used to distribute coarse resolution projected data across a finer resolution grid [5]. Census-independent population estimation, also known as bottom-up estimation, instead relies on locally conducted microcensuses to learn a predictive model that can estimate population at non-surveyed grid tiles.

Weber et al.[26] used very-high-resolution satellite imagery to estimate the number of under-5s in two states in northern Nigeria in three stages: first, by building a binary settlement layer at

resolution using support vector machine (SVM) with “various low-level contextual image features”

[26, §2.3]

, second, by classifying “blocks” constructed from OpenStreetMap data using “a combination of supervised image segmentation and manual correction of errors” in 8 residential types (6 urban, 1 rural and 1 non-residential)

[26, §2.4]

, and finally, by modelling population count of each residential type with separate log-normal distributions using microcensus. The predictions were validated against a separate survey from the same region, and were found to be highly correlated with this data

[26, §3.3].

Engstrom et al. [6]

used LASSO regularized Poisson regression and Random Forest models to predict village level population in Sri Lanka. The authors used a variety of remote sensing indicators at various resolutions as predictors, both coarser-resolution publicly available ones such as night time lights, elevation, slope, and tree cover, and finer-resolution proprietary ones such as built up area metrics, car and shadow shapefiles, and land type classifications

[6, Table 1]. The authors observed that publicly available data can explain a large amount of variation in population density for these regions, particularly in rural areas, and the addition of proprietary object footprints further improved performance. Their population estimates were highly correlated with census counts at the village level [6, Table 4].

Hillson et al. [9] explored the use of resolution Landsat 5 thematic mapper (TM) imagery to estimate population densities and counts for 20 neighborhoods in the city of Bo, Sierra Leone. The authors used 379 candidate Landsat features generated manually, which was reduced to 159 covariates through “trial-and-error” [9, p. 10] and removal of highly correlated (Pearson’s ) pairs, and finally, an optimal regression model was learned using only 6 of these covariates [9, Table 7]. These estimates were then validated through leave-one-out cross-validation on the districts surveyed. The approach estimated population density at the coarse neighborhood level with low relative error for most neighborhoods [9, Table 10].

Performance
ROI Input Shape
Input
Resolution
Output
Resolution
Input
Data Cost
Validation %RMSE MAPE
Tanzania [5] (Landsat) Free Train / test split 51.5 - -
USA [20] (Landsat) Free
Future census
- 49.8 0.94
India [11]
(Landsat)
(Sentinel-1 radar)
(Village level)
Free Train / test split 24.3 21.5 0.93
Table 2:

Summary of recent literature on deep learning driven census-dependent intercensal population estimation. NOTE: Input Resolution indicates the spatial resolution of imagery input to model (i.e. after reprojection and resizing).

%RMSE is percent root mean squared error, MAPE is mean absolute percent error.

Leasure et al. [16] used a hierarchical Bayesian model to estimate population at resolution grid cells nationally in Nigeria, and focused on “provid[ing] robust probabilistic estimates of uncertainty at any spatial scale” [16, p. 4]. The authors used the same settlement map as Weber et al.[26] to remove unsettled grid cells prior to population density estimation, and used additional geospatial covariates, including school density, average household size, and WorldPop gridded population estimates. WorldPop population estimates were generated using a census-dependent approach, so the proposed method in some sense integrates information from census into otherwise census-independent population predictions. The predicted population estimates, however, were not highly correlated with the true population counts [16, Table 3].

2.2 Deep Learning for Intercensal Population Estimation

There are several recent approaches that apply deep learning methods to intercensal population estimation using free and readily available high-resolution satellite imagery as opposed to relatively expensive very-high resolution imagery, and census as opposed to microcensus, potentially due to the prohibitive cost of collecting sufficient microcensus for training a custom deep neural network from scratch. HRSL uses very-high resolution imagery to focus on building footprint identification using a feedforward neural network and weakly supervised learning, and redistributes the census proportionally to the fraction of built-up area

[23], but does not use census as the response variable.

Doupe et al. [5] used an adapted VGG [22]convolutional neural network (CNN) trained on a concatenation of low resolution Landsat-7 satellite images (7 channels) and night-time light images (1 channel). The VGG network was trained on observations generated from 18,421 population labeled enumeration areas from the 2002 Tanzanian census, and validated on observations generated from 7,150 labeled areas from the 2009 Kenyan census. The authors proposed using the output of the VGG network as a weighted surface for population disaggregation from regional population totals. This approach significantly outperformed AsiaPop (a precursor to WorldPop) in RMSE, %RMSE, and MAE evaluation metrics [5, Table 1].

Robinson et al. [20] trained an adapted VGG [22] CNN on Landsat-7 imagery from the year 2000 and US data from the year 2004, and validated it on Landsat and data from the year 2010. The authors split the US into 15 regions, and trained a model for each with around 800,000 training samples in total. Instead of predicting population count directly, the authors classified image patches into log scale population bands, and determined final population count by the network output weighted average of band centroids. Existing approaches for projecting data outperformed the final network when validated against the 2010 US census [20, Table 1]

, however the fitted model displayed an understanding of population, evidenced through visualizing the images that produced the highest probabilities for each population band

[20, Figure 5].

Hu et al. [11] generated population density maps at the village level in rural India using a custom VGG CNN based end-to-end learning. The authors used freely available high-resolution Landsat-8 imagery ( resolution, RGB channels only) and Sentinel-1 radar imagery ( resolution, converted to RGB) images of villages as predictor, and respective population from the 2011 Indian census as response. The training set included 350,000 villages and validation set included 150,000 villages across 32 states, and the resulting model outperformed two previous deep learning based approaches[20, 5]. The authors observed that the approach performed better at a coarser district level resolution than a finer village level resolution [11, Table 2].

Both census-dependent and census-independent approaches have their advantages and drawbacks. While census-dependent estimation is cheaper to perform using existing data, the results can be misleading if the projected intercensal population count is inaccurate, and due to the limited resolution of both data and publicly available satellite imagery, these approaches exclusively predict population at a coarser spatial resolution. Census-independent estimation uses microcensus, which can be collected more frequently and is available at a finer scale, and although this data can be relatively expensive to collect in large enough quantities, it provides ‘ground truth’ information at a finer scale which is not available for census-dependent approaches.

3 Methods and Data

In this section we discuss some recent advancements in the principles and tools for self-supervised learning, partly in the context of remote sensing (§3.1), provide details of SCIPE, and the datasets used, i.e., satellite imagery and microcensus.

3.1 Representation and Transfer Learning

Representation Learning learns a vector representation of an image by transforming the image, for example, using deep neural network, such that the corresponding representation can be used for other tasks such as regression or classification using existing tools [1]

. The learned representation can be used for transfer learning, i.e., using the transformation learned from a separate task, e.g., ImageNet classification, for a different one, e.g., population estimation

[19]. Intuitively, this happens since a pre-trained network, although designed for a separate task, can extract meaningful features that can be informative for population estimation (see for example Figure 2a).

Supervised pre-training

is a common approach for representation learning where a network is trained in a supervised learning context with a vast amount of annotated training data such as ImageNet. Once the network has been trained on this task, the output of the penultimate layer (or a different layer) of this pre-trained network can be used as a vector representation of the respective input image, and can be used as a predictor for further downstream analysis

[19]. This approach works well in practice but its performance is inherently limited by the size of the dataset used for supervised learning which can be ‘small’ [3]. To mitigate this issue, representation learning using unsupervised methods such as Tile2Vec [13], and in particular, self-supervised approaches have become popular. Compared to supervised learning which maximizes the objective function of a pre-defined task such as classification, self-supervised learning generates pseudolabels from a pretext task in the absence of ground truth data, and different algorithms differ in the way they define the pretext tasks [14].

In the context of population estimation, we focus on methods that either assume that the latent representations form clusters [3] or make them invariant to certain class of distortions [27]. Our intuition is that grid tiles can be grouped together based on population. This is a common practice in census-independent population estimation, i.e., to split regions in categories and model these categories separately, e.g., see [16] and [5]. We also observe this pattern in the representation space where built-up area separates well from uninhabited regions (see Figure 5b). Additionally, we expect the population count of a grid tile to remain unchanged even if, for example, it is rotated, converted to grayscale, or resized.

Figure 2: ResNet-50 ImageNet predictions and architecture. a) ImageNet class predictions for very-high-resolution satellite image tiles. Although the classes are irrelevant, the network shows an intrinsic understanding of the difference between built-up area, vegetation, and road. b)

Diagram of ResNet-50 encoder. Residual blocks between Input and Global Average Pooling are comprised of convolutional layers with interleaved batch normalization layers.

DeepCluster [3] (and DeepClusterV2) jointly learns parameters of a deep neural network and the cluster assignments of its representations. It works by iteratively generating representations using an encoder model that transforms the image to a vector, clustering these representations using a -means clustering algorithm, and using these cluster assignments as pseudo-labels to retrain the encoder. The intuition behind this being that CNNs, even without training, can find partially useful representations, and therefore clusters, due to their convolutional structure. This weak signal can be exploited to bootstrap a process of iterative improvements to the representation and cluster quality.

SwAV [4] clusters the representation while simultaneously enforcing consistency between cluster assignments produced for different distortions. This involves applying augmentations to each image, yielding two different views of the image, which are then fed through the model, clustered, and compared to train the model. In particular, to enforce consistent cluster assignments between the views of the image, the cluster assignment of a view is predicted from the representation of another view of the same image. SwAV applies horizontal flips, color distortion and Gaussian blur after randomly cropping and resizing the image [4, p. 15]. Cropping affects the population of a grid tile, however, since satellite imagery alone can estimate population with some uncertainty, we assume that cropping will change population within this level of uncertainty. Although cropping is used as a data augmentation step in the existing pre-trained network, we avoid cropping as data augmentation when fine-tuning the network to predict population in §3.3.

Barlow Twins [27] also works by applying augmentations to each image, yielding two views of the image, which are then fed through the model to produce two representations of the original image. To avoid trivial constant solutions of existing self-supervised learning approaches aiming to achieve invariance to distortions, Barlow Twins considers a redundancy-reduction approach, i.e., the network is optimized by maximizing the correlation along the main diagonal of the cross correlation matrix in the representation space to achieve invariance, while minimizing the correlation in all other positions to reduce redundancy of representations. Barlow Twins applies cropping, resizing, horizontal flipping, color jittering, converting to grayscale, Gaussian blurring, and solarization as distortions [27, p. 3].

3.2 Satellite Imagery and microcensus

Satellite Imagery We used proprietary resolution satellite imagery (Vivid 2.0 from Maxar, WorldView-2 satellite) covering across two districts in Mozambique: Boane (BOA) and Magude (MGD). The Vivid 2.0 data product is intended as a base map for analysis. It has worldwide coverage and is updated annually with priority given to the low cloud coverage images, and hence images can be from different time periods and different sensors in the Maxar constellation. The product is provided already mosaicked and colour-balanced, increasing the transferability of any methods/algorithms developed using this data. The data are provided in a three-band combination of red, green and blue. The NIR band is not provided as part of the VIVID 2.0 data product. The procured data was a mosaic of images, mostly from 2018 and 2019 (83% and 17% for BOA and 43% and 33% for MGD, remainder from 2011 to 2020).

Microcensus We used microcensus from 2019 conducted by SpaceSUR and GroundWork in these two districts, funded by UNICEF. The survey was conducted at a household level (with respective GPS locations available), and households were exhaustively sampled over several primary sampling units (PSUs) where PSUs were defined using natural boundaries such as road. We aggregated the household survey data to a grid to generate population counts producing 474 labelled grid tiles.

Non-representative tiles

Since the imagery and microcensus were not perfectly aligned temporally, and the PSUs had natural boundaries, many tiles contained either unsurveyed buildings or surveyed buildings absent in the imagery. Thus, the dataset contained both developed tiles (i.e. with many buildings) labeled as low population, or undeveloped tiles labeled as high population. Although such ‘outlier’ tiles can be addressed with robust training, they cannot be used for validation. We, therefore, manually examined each grid tile by comparing the GPS location of surveyed buildings with those appearing in the imagery, and excluded those with a mismatch, leaving 199 curated tiles (CT).

Zero-population tiles Since the microcensus was conducted in settled areas, we had no labels for uninhabited tiles. Although this does not pose a problem when comparing the performance of different models on the available microcensus (Table 2), the models do not learn to predict zero population when applied to an entire district which will include many uninhabitated areas. To resolve this, we identified 75 random tiles (50 from BOA, 25 from MGD) with zero population (ZT) guided by HRSL, i.e., from regions where HRSL showed zero population. We selected more ZTs from BOA to improve regional population estimates (see Figure 3b). Thus, we had 274 grid tiles in total.

3.3 Models and Training

We use a ResNet-50 [8] CNN architecture to estimate population from grid tiles. The model architecture is shown in Figure 2b with dimensional input and 49 convolutional layers followed by a Global Average Pooling layer which results in a 2048 dimensional latent representation. We used the pre-trained ResNet-50 models trained on ImageNet using methods described in §3.1 after resizing the grid tiles of size ( RGB) to

, and used these (representation, population) pairs to train a prediction model using Random Forest. The hyperparameters of the model were chosen using a grid search over

num_estimators , min_samples_split and min_samples_leaf

. A linear regression head can also be trained to predict population in an end-to-end manner. This yields several advantages: rapid inference on GPUs, a simple pipeline, and a simple method for determining uncertainty. However, we observed that the Random Forest model outperformed the linear regression head.

Pre-trained model We used pre-trained ResNet50 models described in §3.1 to extract representations, and also fine-tuned these models with microcensus.

Fine-tuning We fine-tuned the pretrained models using a combination of curated and zero grid tiles after attaching a linear regression head following the global average pooling layer and minimizing the

loss between observed and predicted population. Given the labelled grid tiles (number of grid tiles vary depending on experimental set-up), we randomly split them into training and validation sets (80-20%). Due to the limited number of tiles in the dataset, we apply random dihedral transformations (i.e. reflections and rotations) to tiles to augment the training set, avoiding transformations that could affect the validity of the population count e.g. crops that could remove buildings. We use Adam optimizer to minimize the loss function which takes about

minute with a batch size of on a single Nvidia GTX 1070 with

of VRAM. During training, first, the network was frozen (i.e., the weights were kept fixed) and only the regression head was trained for 5 epochs with a learning rate of

, and second, the entire network was trained using a discriminative learning rate [10], where the learning rate is large at the top of the network, and is reduced in the earlier layers, avoiding large changes to the earlier layers of the model which typically extract more general features, and focusing training on the domain-specific later layers. The base learning rate at the top of the network was , and it was decreased in the preceding stages to a minimum of . We used early stopping to halt training when validation loss plateaued (i.e., no improvement for 2 or more epochs) to avoid overfitting.

Figure 3: Regional population map comparison and zero population tiles. a) Gridded population count estimates over Boane (top), and comparison against microcensus (bottom). Year indicates target year for estimation where known, otherwise when estimates were published. We do not compare our results on the microcensus as this was our training and validation data. b) Examples of zero population tiles from §3.2.

.

Features used MeAPE MeAE IQR AggPE Hand-crafted features: Public Only -0.22 57.8% 5.05 8.60 21.5% Footprint Only 0.47 44.5% 3.75 5.86 02.2% Public + Footprint 0.46 48.8% 4.63 5.11 07.6% Representation Learning: Supervised 0.20 54.7% 5.36 7.97 02.0% Supervised (FT) 0.33 52.9% 4.72 6.23 05.5% SWAV 0.34 51.6% 6.60 4.33 00.8% SWAV (FT) 0.41 46.9% 5.83 4.35 03.5% DeepCluster 0.26 50.3% 4.60 6.03 06.7% DeepCluster (FT) 0.13 62.5% 5.98 8.32 06.8% Barlow Twins 0.27 51.9% 5.40 6.65 02.8% Barlow Twins (FT) 0.39 44.0% 3.91 6.32 01.1% Null Model: None -0.12 76.45% 7.57 10.0 01.7% Existing Maps GRID3 0.22 51.7% 4.25 7.11 26.7% HRSL -0.12 70.7% 5.04 7.94 46.8% WorldPop -0.41 86.8% 5.85 8.18 77.9% Table 3: Population model validation performance for (top) manually and automatically extracted features, along with (bottom) test performance of existing maps. See §4 for metric definitions. IQR is interquartile range of absolute errors. Bold indicates best in category. FT is fine-tuning. Figure 4: Clockwise from left: Difference between SCIPE and GRID3 population maps for Boane, the respective scatter plot, and examples of survey tiles from regions where they differ.

3.4 Evaluation Metrics and Cross-validation

Evaluation Metrics We compare the different methods against several evaluation metrics, i.e., R-squared, median absolute error (MeAE), median absolute percentage error (MeAPE), and aggregated percentage error (AggPE) (to capture average error at regional levels characterised by ), as follows,

MeAE
AggPE

These evaluation metrics capture different aspects of the prediction, and each has different significance. For example, may be dominated by large population counts while MeAPE may be dominated by small population counts.

Null Model As ‘null model’ we predict population as the mean of the training set irrespective of feature values. We used this as an initial baseline to ensure any perceived performance when transferring features from ImageNet is not trivial.

Baseline

To properly assess the performance of automatic feature extraction, we compared to results when using hand-crafted features and public datasets to predict population that is more common for census-independent population estimation. We took a variety of public features (Landsat imagery, land cover classification, OSM road data, night-time lights), along with building footprints automatically extracted from each image tile using a U-Net model pre-trained on SpaceNet and fine-tuned with ‘dot-annotation’ from non-surveyed buildings, and using these features to train a Random Forest model.

Cross-validation We compare the different approaches to population estimation using cross-validation. For each region, we partitioned the data into four subsets spatially, and formed validation folds by taking the union of these subsets across the two regions. We reported the evaluation metrics over pooled predictions from the four validation folds covering the entire microcensus. When fine-tuning, we trained one network for each fold separately (to avoid data leakage) resulting in four networks.

4 Results

In this section, we compare the performance of several self-supervised learning frameworks using cross-validation, apply the best performing model to predict a regional map of Boane, and compare it against existing maps from GRID3, HRSL and WorldPop where all of these methods take a census-dependent approach to population estimation within our ROIs, and cannot be regarded as ‘ground-truth’. We show the interpretability of the framework using uncertainty quantification and activation maps.

Model selection Table 3 shows the cross-validation results for population estimation using Random Forest regression on representations extracted using ResNet-50 model with curated tiles only. We observe that, 1) representations extracted using any pre-trained network outperformed estimation using publicly available features in all but MeAE metric, 2) fine-tuning any of the representation learning frameworks with microcensus, besides DeepCluster, resulted in an improvement of the performance of the framework, 3) although all of the representation learning framework (best ) outperformed than the null model (), the baseline models trained with building footprint area (best ) as a feature still outperformed them in and MeAE, and 4). Barlow Twins overall had lower error metrics and the second largest metric among the fine-tuned models, so we consider this model for further analysis. We did not evaluate the performance of Tile2Vec since the available pre-trained model required an NIR band for input data, which Vivid 2.0 lacks.

Regional Population Estimation We use representations learned with a ResNet50 architecture pre-trained on ImageNet using Barlow Twins and fine-tuned using curated and zero grid tiles (with 80-20 random train/validation split of all tiles, no cross-validation) to extract representations for our survey tiles. These representations are used to train a Random Forest model (§3.3), which is used to produce a population map for Boane district. The map is shown in Figure 3a along with three existing population maps from WorldPop, HRSL and GRID3. We observe that, with respect to our ‘ground truth’ microcensus, 1) GRID3 provides a more accurate population map of Boane than HRSL and WorldPop, but usually underestimates population, 2) WorldPop lacks the finer details of the other population maps, and underestimates population, 3) although the settlement map provided by HRSL matches that of SCIPE and GRID3 well, its similarity with SCIPE is less than that of GRID3, and 4) SCIPE and GRID3 provide visually similar settlement map, and the population estimates are also more similar in scale compared to HRSL and WorldPop.

Census We additionally compare the aggregated population estimate in Boane with 2019 census projection from 2017 census, and we observe that SCIPE overestimates population by 29%. Although projected census is not the ground truth, the discrepancy in estimated population is potentially due to SCIPE not modelling zero population explicitly. SCIPE can be extended by using, for example, a zero-inflated population model to model the zero-population better. We leave this as future work.

Since GRID3 provides a more accurate population map than HRSL and WorldPop, we compare it against SCIPE in more detail. Figure 4 shows the difference in population maps produced by these two approaches. We observe that, 1) the estimated population of these approaches matched well quantitatively (Spearman’s 0.70, Pearson’s 0.79), 2) there are regions where SCIPE underestimated population, and these are areas where microcensus was not available, and 3) there are regions where GRID3 underestimated population, and they usually coincided with regions where microcensus was available and SCIPE could potentially provide better estimates. Therefore, there is a high level of agreement between the two products and they provide similar estimates, and discrepancies appear in regions that lack microcensus for training. A more detailed comparison of these two population maps will be valuable, and may lead to both improved population estimation through ensemble learning and better microcensus data collection through resolving model disagreements. However, this is beyond the scope of this work.

Uncertainty To further assess the quality of the estimated population map, we quantify the uncertainty and qualitatively assess their ‘explanations’. We can assess the uncertainty of predictions in several ways either at the level of the representation learning or at the level of the Random Forest population model. For the former, we can apply Monte Carlo dropout [7] by placing dropout layers (

) after each stage of the ResNet models, and predicting multiple population value for each grid tile. For the latter, the uncertainty can be quantified from the output of the individual decision trees in the Random Forest model without perturbing the representation. Figure

5c shows Random Forest model predictions on fine-tuned Barlow Twins features and their associated uncertainties. We observe that the estimated uncertainty matches the intuition of higher estimated population having higher uncertainty.

Explanation To assess the outcome of the model, we use regression activation maps (RAMs) [24] that show the discriminative regions of input image that is informative of the outcome of the model. It is widely reported that building footprint area is an important indicator of population, and we observe that a fine-tuned Barlow Twins model produces RAM plots that show a clear focus on built-up area, which agrees with the intuition (see Figure 5a). To further explore if SCIPE focuses on built-up area to estimate population, we observe that population estimates using SCIPE and that using building footprints (as presented in Table 3) show high correlation (Spearman’s 0.68, Pearson’s 0.74 over Boane region) (see Figure 5d) corroborating this observation.

Embedding Finally, we visualize the representations available from the fine-tuned Barlow Twins model to assess if they meaningfully separate in terms of population, and we observe that this is indeed the situation (see Figure 5b).

Figure 5: Activation maps, embedding visualization, and comparison of SCIPE with microcensus data and footprint based estimates. a) Tiles and their associated regression activation maps (RAMs) from fine-tuned Barlow Twins model b) Plot of t-SNE embeddings of representations from Barlow Twins for 75 random tiles and 75 microcensus tiles from Boane and Magude (main), with embeddings coloured by population (bottom left) and region (bottom right) c) Predicted over observed plot over microcensus with prediction uncertainty d) Comparison between SCIPE estimates and building footprint based estimates on the microcensus grid tiles.

5 Discussion

We find representation learning to be an effective tool for estimating population at a medium-resolution from limited local microcensus. Although this approach did not outperform building footprint area based estimations; it is fast, does not require human supervision, and only relies on very-high-resolution satellite images, making it sustainable and transferable in the sense that users can extrapolate their own local microcensus with relative ease, and also quantify uncertainty and capture explanations.

There is likely a hard limit to the predictive power of satellite imagery alone, owed to the difficulty of distinguishing inhabited and uninhabited areas in some contexts. For example, Robinson et al.[20] gave the example of Walt Disney World which is built to look like a settled area but has population. To address this issue, an interesting extension of SCIPE will be to use multiple data sources, such as night-time light, land-cover data, altitude and slope information, location of services, of possibly different resolutions in the model alongside very-high-resolution imagery without changing its core focus, i.e., of using pre-trained network and fine-tuning them with limited amount of microcensus. This can potentially improve the prediction of population in areas that are uninhabited. We have also used a Random Forest model which effectively treats grid tiles as independent and identically distributed samples which they are not. Considering the spatial arrangement of grid tiles can improve estimation further by using broader contextual information around it, for example to establish the socioeconomic status or land use of the surrounding areas.

Ideally, we would like to use self-supervised learning framework directly on satellite images to learn appropriate representation, rather than relying on pre-trained networks and fine-tuning. This will, however, require a vast quantity of training data, and has not been the focus of this work. In this work we have focused on sustainability, both in terms of human annotation and computational resources which prohibits training from scratch, and have shown that existing tools can be used to produce reliable population estimates. The proposed framework should also be validated externally on a larger scale. We explored population of a single district in Mozambique while existing population maps are available over the whole of Africa. Assessing the utility of SCIPE better would require further large scale validation both in different regions of Mozambique (which is our immediate focus), and in other countries (which is our long term goal), to make population maps more frequent, accessible, reliable and reproducible.

SCIPE avoids several typical bottlenecks associated with census-independent population estimation. While some methods require tedious manual annotation of built up area or potentially incomplete public features, SCIPE extracts features automatically using only satellite images. SCIPE is extremely fast, requires negligible GPU time, and provides meaningful population estimates. Microcensus data may not be available in all countries or regions, and can be expensive to gather, but this cost is far lower than that of conducting census on a regular basis. Very-high-resolution satellite imagery can also be expensive, but has become more accessible in recent years when used for humanitarian purposes [6, p. 14]. Given that many development agencies benefit from subsidised access to the Maxar very-high-resolution imagery these population maps could be produced relatively quickly for specific regions of focus, for example, when vaccination programmes are being planned. This approach, therefore, would contribute towards the UNs stated need for a data revolution [12] by allowing regularly updated estimates of population between census enumeration periods supporting a range of humanitarian activities as well as general governmental and NGO planning and allocation of resources.

References

  • [1] Y. Bengio, A. Courville, and P. Vincent (2013) Representation learning: a review and new perspectives. External Links: ISSN 0162-8828, 2160-9292, Document Cited by: §1, §3.1.
  • [2] M. Bondarenko, P. Jones, D. Leasure, A. Lazar, and A. Tatem (2020-11) Gridded population estimates disaggregated from mozambique’s fourth general population and housing census (2017 census), version 1.1. University of Southampton. External Links: Document Cited by: §1.
  • [3] M. Caron, P. Bojanowski, A. Joulin, and M. Douze (2018)

    Deep clustering for unsupervised learning of visual features

    .
    In Proceedings of the ECCV, External Links: Document Cited by: §3.1, §3.1, §3.1.
  • [4] M. Caron, I. Misra, J. Mairal, P. Goyal, P. Bojanowski, and A. Joulin (2020) Unsupervised learning of visual features by contrasting cluster assignments. In Proceedings of NeurIPS, Cited by: §3.1.
  • [5] P. Doupe, E. Bruzelius, J. Faghmous, and S. G. Ruchman (2016) Equitable development through deep learning: the case of sub-national population density estimation. In Proceedings of ACM DEV, pp. 1–10. External Links: Document Cited by: §2.1, §2.2, §2.2, Table 2, §3.1.
  • [6] R. Engstrom, D. Newhouse, and V. Soundararajan (2020-08) Estimating small-area population density in Sri Lanka using surveys and Geo-spatial data. PLoS ONE 15 (8), pp. e0237063 (en). External Links: ISSN 1932-6203, Document Cited by: Table 1, §1, §2.1, §5.
  • [7] Y. Gal and Z. Ghahramani (2016) Dropout as a bayesian approximation: representing model uncertainty in deep learning. In Proceedings of ICML, pp. 1050–1059. External Links: Document Cited by: §4.
  • [8] K. He, X. Zhang, S. Ren, and J. Sun (2016) Deep residual learning for image recognition. In Proceedings of CVPR, External Links: Document Cited by: §3.3.
  • [9] R. Hillson, A. Coates, J. D. Alejandre, K. H. Jacobsen, R. Ansumana, A. S. Bockarie, U. Bangura, J. M. Lamin, and D. A. Stenger (2019) Estimating the size of urban populations using Landsat images: a case study of Bo, Sierra Leone, West Africa. Int. J. Health Geogr. (en). External Links: Document Cited by: Table 1, §2.1.
  • [10] J. Howard and S. Gugger (2020)

    Deep learning for coders with fastai and pytorch

    .
    O’Reilly Media. Cited by: §3.3.
  • [11] W. Hu, J. H. Patel, Z. Robert, P. Novosad, S. Asher, Z. Tang, M. Burke, D. Lobell, and S. Ermon (2019) Mapping missing population in rural india: a deep learning approach with satellite imagery. External Links: Document Cited by: §2.2, Table 2.
  • [12] (2014-11) Independent expert advisory group on a data revolution for sustainable development. A world that counts: mobilising the data revolution for sustainable development.. External Links: Document Cited by: §5.
  • [13] N. Jean, S. Wang, A. Samar, G. Azzari, D. Lobell, and S. Ermon (2019) Tile2Vec: unsupervised representation learning for spatially distributed data. In Proceedings of the AAAI, External Links: Document Cited by: §3.1.
  • [14] L. Jing and Y. Tian (2020) Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey. IEEE Trans. Pattern Anal. Mach. Intell.. External Links: ISSN 0162-8828, 2160-9292, 1939-3539, Document Cited by: §3.1.
  • [15] Cited by: §1.
  • [16] D. R. Leasure, W. C. Jochem, E. M. Weber, V. Seaman, and A. J. Tatem (2020-09-29) National population mapping from sparse survey data: a hierarchical bayesian modeling framework to account for uncertainty. PNAS. External Links: Document Cited by: Table 1, §1, §2.1, §3.1.
  • [17] C. Linard, M. Gilbert, R. W. Snow, A. M. Noor, and A. J. Tatem (2012) Population distribution, settlement patterns and accessibility across africa in 2010. PLoS ONE. External Links: Document Cited by: §1.
  • [18] P. Linardatos, V. Papastefanopoulos, and S. Kotsiantis (2020)

    Explainable AI: A Review of Machine Learning Interpretability Methods

    .
    Entropy (en). External Links: ISSN 1099-4300, Document Cited by: §1.
  • [19] A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson (2014) CNN features off-the-shelf: an astounding baseline for recognition. In Proceedings of CVPR Workshops, Vol. , pp. 512–519. External Links: Document Cited by: §1, §3.1, §3.1.
  • [20] C. Robinson, F. Hohman, and B. Dilkina (2017) A deep learning approach for population estimation from satellite imagery. In Proceedings of ACM SIGSPATIAL Workshop on Geospatial Humanities, Cited by: §1, §2.1, §2.2, §2.2, Table 2, §5.
  • [21] R. Shearmur (2010) Editorial - A world without data? The unintended consequences of fashion in geography. Urban Geography. External Links: Document Cited by: §1.
  • [22] K. Simonyan and A. Zisserman (2015) Very deep convolutional networks for large-scale image recognition. In Proceedings of ICLR, Cited by: §2.2, §2.2.
  • [23] T. G. Tiecke, X. Liu, A. Zhang, A. Gros, N. Li, G. Yetman, T. Kilic, S. Murray, B. Blankespoor, E. B. Prydz, and H. H. Dang (2017) Mapping the world population one building at a time. Note: arXiv: 1712.05839 External Links: Document Cited by: §1, §2.2.
  • [24] Z. Wang and J. Yang (2018) Diabetic retinopathy detection via deep convolutional networks for discriminative localization and visual explanation. In Proceedings of AAAI Workshops, External Links: Document Cited by: §4.
  • [25] N. Wardrop, W. Jochem, T. Bird, H. Chamberlain, D. Clarke, D. Kerr, L. Bengtsson, S. Juran, V. Seaman, and A. Tatem (2018) Spatially disaggregated population estimates in the absence of national population and housing census data. PNAS. External Links: Document Cited by: §1, §1.
  • [26] E. M. Weber, V. Y. Seaman, R. N. Stewart, T. J. Bird, A. J. Tatem, J. J. McKee, B. L. Bhaduri, J. J. Moehl, and A. E. Reith (2018) Census-independent population mapping in northern nigeria. Remote Sens. Environ. External Links: Document Cited by: Table 1, §2.1, §2.1.
  • [27] J. Zbontar, L. Jing, I. Misra, Y. LeCun, and S. Deny (2021) Barlow twins: self-supervised learning via redundancy reduction. External Links: 2103.03230 Cited by: §3.1, §3.1.