Learning to Map Nearly Anything

09/16/2019
by   Tawfiq Salem, et al.
0

Looking at the world from above, it is possible to estimate many properties of a given location, including the type of land cover and the expected land use. Historically, such tasks have relied on relatively coarse-grained categories due to the difficulty of obtaining fine-grained annotations. In this work, we propose an easily extensible approach that makes it possible to estimate fine-grained properties from overhead imagery. In particular, we propose a cross-modal distillation strategy to learn to predict the distribution of fine-grained properties from overhead imagery, without requiring any manual annotation of overhead imagery. We show that our learned models can be used directly for applications in mapping and image localization.

READ FULL TEXT

page 1

page 2

page 3

research
02/07/2018

Fine-Grained Land Use Classification at the City Scale Using Ground-Level Images

We perform fine-grained land use mapping at the city scale using ground-...
research
12/29/2020

Learning a Dynamic Map of Visual Appearance

The appearance of the world varies dramatically not only from place to p...
research
06/25/2020

Estimating Displaced Populations from Overhead

We introduce a deep learning approach to perform fine-grained population...
research
06/15/2023

Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding

Current Vision and Language Models (VLMs) demonstrate strong performance...
research
02/19/2019

Using Conditional Generative Adversarial Networks to Generate Ground-Level Views From Overhead Imagery

This paper develops a deep-learning framework to synthesize a ground-lev...
research
07/29/2023

Sat2Cap: Mapping Fine-Grained Textual Descriptions from Satellite Images

We propose a novel weakly supervised approach for creating maps using fr...
research
08/02/2018

What Goes Where: Predicting Object Distributions from Above

In this work, we propose a cross-view learning approach, in which images...

Please sign up or login with your details

Forgot password? Click here to reset