Multi-task learning from fixed-wing UAV images for 2D/3D city modeling

by   Mohammad R. Bayanlou, et al.

Single-task learning in artificial neural networks will be able to learn the model very well, and the benefits brought by transferring knowledge thus become limited. In this regard, when the number of tasks increases (e.g., semantic segmentation, panoptic segmentation, monocular depth estimation, and 3D point cloud), duplicate information may exist across tasks, and the improvement becomes less significant. Multi-task learning has emerged as a solution to knowledge-transfer issues and is an approach to scene understanding which involves multiple related tasks each with potentially limited training data. Multi-task learning improves generalization by leveraging the domain-specific information contained in the training data of related tasks. In urban management applications such as infrastructure development, traffic monitoring, smart 3D cities, and change detection, automated multi-task data analysis for scene understanding based on the semantic, instance, and panoptic annotation, as well as monocular depth estimation, is required to generate precise urban models. In this study, a common framework for the performance assessment of multi-task learning methods from fixed-wing UAV images for 2D/3D city modeling is presented.



There are no comments yet.


page 3

page 4


SOSD-Net: Joint Semantic Object Segmentation and Depth Estimation from Monocular images

Depth estimation and semantic segmentation play essential roles in scene...

Multi-Task Learning with Labeled and Unlabeled Tasks

In multi-task learning, a learner is given a collection of prediction ta...

A Generalized Multi-Task Learning Approach to Stereo DSM Filtering in Urban Areas

City models and height maps of urban areas serve as a valuable data sour...

UniNet: A Unified Scene Understanding Network and Exploring Multi-Task Relationships through the Lens of Adversarial Attacks

Scene understanding is crucial for autonomous systems which intend to op...

News Cover Assessment via Multi-task Learning

Online personalized news product needs a suitable cover for the article....

Multi-task human analysis in still images: 2D/3D pose, depth map, and multi-part segmentation

While many individual tasks in the domain of human analysis have recentl...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.