Image-Conditioned Graph Generation for Road Network Extraction

10/31/2019
by   Davide Belli, et al.
12

Deep generative models for graphs have shown great promise in the area of drug design, but have so far found little application beyond generating graph-structured molecules. In this work, we demonstrate a proof of concept for the challenging task of road network extraction from image data. This task can be framed as image-conditioned graph generation, for which we develop the Generative Graph Transformer (GGT), a deep autoregressive model that makes use of attention mechanisms for image conditioning and the recurrent generation of graphs. We benchmark GGT on the application of road network extraction from semantic segmentation data. For this, we introduce the Toulouse Road Network dataset, based on real-world publicly-available data. We further propose the StreetMover distance: a metric based on the Sinkhorn distance for effectively evaluating the quality of road network generation. The code and dataset are publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/22/2023

Learning Subpocket Prototypes for Generalizable Structure-based Drug Design

Generating molecules with high binding affinities to target proteins (a....
research
06/28/2020

Scalable Deep Generative Modeling for Sparse Graphs

Learning graph generative models is a challenging task for deep learning...
research
11/24/2018

DEFactor: Differentiable Edge Factorization-based Probabilistic Graph Generation

Generating novel molecules with optimal properties is a crucial step in ...
research
06/08/2023

Neighborhood Attention Makes the Encoder of ResUNet Stronger for Accurate Road Extraction

In the domain of remote sensing image interpretation, road extraction fr...
research
10/12/2021

Satellite Image Semantic Segmentation

In this paper, we propose a method for the automatic semantic segmentati...
research
11/27/2020

Road Scene Graph: A Semantic Graph-Based Scene Representation Dataset for Intelligent Vehicles

Rich semantic information extraction plays a vital role on next-generati...
research
07/19/2020

Sat2Graph: Road Graph Extraction through Graph-Tensor Encoding

Inferring road graphs from satellite imagery is a challenging computer v...

Please sign up or login with your details

Forgot password? Click here to reset