SIGNet: Semantic Instance Aided Unsupervised 3D Geometry Perception

12/13/2018
by   Yue Meng, et al.
10

Unsupervised learning for visual perception of 3D geometry is of great interest to autonomous systems. Recent works on unsupervised learning have made considerable progress on geometry perception; however, they perform poorly on dynamic objects and scenarios with dark and noisy environments. In contrast, supervised learning algorithms, which are robust, require large labeled geometric data-set. This paper introduces SIGNet, a novel framework that provides robust geometry perception without requiring geometrically informative labels. Specifically, SIGNet integrates semantic information to make unsupervised robust geometric predictions for dynamic objects in low lighting and noisy environments. SIGNet is shown to improve upon the state of art unsupervised learning for geometry perception by 30 for depth prediction). In particular, SIGNet improves the dynamic object class performance by 39

READ FULL TEXT

page 9

page 10

page 11

page 12

page 13

page 14

page 15

page 17

research
05/16/2023

Real-time Simultaneous Multi-Object 3D Shape Reconstruction, 6DoF Pose Estimation and Dense Grasp Prediction

Robotic manipulation systems operating in complex environments rely on p...
research
12/29/2016

Meta-Unsupervised-Learning: A supervised approach to unsupervised learning

We introduce a new paradigm to investigate unsupervised learning, reduci...
research
06/29/2021

Unsupervised Technique To Conversational Machine Reading

Conversational machine reading (CMR) tools have seen a rapid progress in...
research
11/30/2020

Learning a metacognition for object perception

Beyond representing the external world, humans also represent their own ...
research
02/27/2019

DeepLO: Geometry-Aware Deep LiDAR Odometry

Recently, learning-based ego-motion estimation approaches have drawn str...
research
07/09/2019

Incremental Semantic Mapping with Unsupervised On-line Learning

This paper introduces an incremental semantic mapping approach, with on-...
research
08/19/2016

Fundamental principles of cortical computation: unsupervised learning with prediction, compression and feedback

There has been great progress in understanding of anatomical and functio...

Please sign up or login with your details

Forgot password? Click here to reset