Evaluation of Multimodal Semantic Segmentation using RGB-D Data

03/31/2021
by   Jiesi Hu, et al.
0

Our goal is to develop stable, accurate, and robust semantic scene understanding methods for wide-area scene perception and understanding, especially in challenging outdoor environments. To achieve this, we are exploring and evaluating a range of related technology and solutions, including AI-driven multimodal scene perception, fusion, processing, and understanding. This work reports our efforts on the evaluation of a state-of-the-art approach for semantic segmentation with multiple RGB and depth sensing data. We employ four large datasets composed of diverse urban and terrain scenes and design various experimental methods and metrics. In addition, we also develop new strategies of multi-datasets learning to improve the detection and recognition of unseen objects. Extensive experiments, implementations, and results are reported in the paper.

READ FULL TEXT

page 2

page 4

page 7

page 10

research
11/13/2020

Efficient RGB-D Semantic Segmentation for Indoor Scene Analysis

Analyzing scenes thoroughly is crucial for mobile robots acting in diffe...
research
11/26/2020

Polarization-driven Semantic Segmentation via Efficient Attention-bridged Fusion

Semantic Segmentation (SS) is promising for outdoor scene perception in ...
research
06/09/2022

Beyond RGB: Scene-Property Synthesis with Neural Radiance Fields

Comprehensive 3D scene understanding, both geometrically and semanticall...
research
06/03/2021

Towards urban scenes understanding through polarization cues

Autonomous robotics is critically affected by the robustness of its scen...
research
03/06/2021

Perception Framework through Real-Time Semantic Segmentation and Scene Recognition on a Wearable System for the Visually Impaired

As the scene information, including objectness and scene type, are impor...
research
08/06/2023

Syn-Mediverse: A Multimodal Synthetic Dataset for Intelligent Scene Understanding of Healthcare Facilities

Safety and efficiency are paramount in healthcare facilities where the l...
research
11/20/2020

Bridging Scene Understanding and Task Execution with Flexible Simulation Environments

Significant progress has been made in scene understanding which seeks to...

Please sign up or login with your details

Forgot password? Click here to reset