3D Annotation Of Arbitrary Objects In The Wild

09/15/2021
by   Kenneth Blomqvist, et al.
11

Recent years have produced a variety of learning based methods in the context of computer vision and robotics. Most of the recently proposed methods are based on deep learning, which require very large amounts of data compared to traditional methods. The performance of the deep learning methods are largely dependent on the data distribution they were trained on, and it is important to use data from the robot's actual operating domain during training. Therefore, it is not possible to rely on pre-built, generic datasets when deploying robots in real environments, creating a need for efficient data collection and annotation in the specific operating conditions the robots will operate in. The challenge is then: how do we reduce the cost of obtaining such datasets to a point where we can easily deploy our robots in new conditions, environments and to support new sensors? As an answer to this question, we propose a data annotation pipeline based on SLAM, 3D reconstruction, and 3D-to-2D geometry. The pipeline allows creating 3D and 2D bounding boxes, along with per-pixel annotations of arbitrary objects without needing accurate 3D models of the objects prior to data collection and annotation. Our results showcase almost 90 2D bounding box detection across a variety of objects and scenes, while speeding up the annotation process by several orders of magnitude compared to traditional manual annotation.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
12/01/2022

Embracing Annotation Efficient Learning (AEL) for Digital Pathology and Natural Images

Jitendra Malik once said, "Supervision is the opium of the AI researcher...
research
01/19/2022

Semi-automatic 3D Object Keypoint Annotation and Detection for the Masses

Creating computer vision datasets requires careful planning and lots of ...
research
10/16/2019

LOST: A flexible framework for semi-automatic image annotation

State-of-the-art computer vision approaches rely on huge amounts of anno...
research
11/16/2022

RF-Annotate: Automatic RF-Supervised Image Annotation of Common Objects in Context

Wireless tags are increasingly used to track and identify common items o...
research
07/18/2018

Robot Learning in Homes: Improving Generalization and Reducing Dataset Bias

Data-driven approaches to solving robotic tasks have gained a lot of tra...
research
09/16/2023

Pour me a drink: Robotic Precision Pouring Carbonated Beverages into Transparent Containers

With the growing emphasis on the development and integration of service ...
research
10/13/2020

Towards Data-efficient Modeling for Wake Word Spotting

Wake word (WW) spotting is challenging in far-field not only because of ...

Please sign up or login with your details

Forgot password? Click here to reset