A novel method for object detection using deep learning and CAD models

Object Detection (OD) is an important computer vision problem for industry, which can be used for quality control in the production lines, among other applications. Recently, Deep Learning (DL) methods have enabled practitioners to train OD models performing well on complex real world images. However, the adoption of these models in industry is still limited by the difficulty and the significant cost of collecting high quality training datasets. On the other hand, when applying OD to the context of production lines, CAD models of the objects to be detected are often available. In this paper, we introduce a fully automated method that uses a CAD model of an object and returns a fully trained OD model for detecting this object. To do this, we created a Blender script that generates realistic labeled datasets of images containing the object, which are then used for training the OD model. The method is validated experimentally on two practical examples, showing that this approach can generate OD models performing well on real images, while being trained only on synthetic images. The proposed method has potential to facilitate the adoption of object detection models in industry as it is easy to adapt for new objects and highly flexible. Hence, it can result in significant costs reduction, gains in productivity and improved products quality.

READ FULL TEXT

page 3

page 4

research
06/21/2017

Object Detection Using Deep CNNs Trained on Synthetic Images

The need for large annotated image datasets for training Convolutional N...
research
05/16/2023

A Novel Strategy for Improving Robustness in Computer Vision Manufacturing Defect Detection

Visual quality inspection in high performance manufacturing can benefit ...
research
05/05/2022

Text Detection on Technical Drawings for the Digitization of Brown-field Processes

This paper addresses the issue of autonomously detecting text on technic...
research
06/03/2023

Towards Complex Real-World Safety Factory Inspection: A High-Quality Dataset for Safety Clothing and Helmet Detection

Safety clothing and helmets play a crucial role in ensuring worker safet...
research
06/11/2021

Small Object Detection for Near Real-Time Egocentric Perception in a Manual Assembly Scenario

Detecting small objects in video streams of head-worn augmented reality ...
research
10/28/2019

Addressing the Sim2Real Gap in Robotic 3D Object Classification

Object classification with 3D data is an essential component of any scen...
research
11/25/2022

CAD2Render: A Modular Toolkit for GPU-accelerated Photorealistic Synthetic Data Generation for the Manufacturing Industry

The use of computer vision for product and assembly quality control is b...

Please sign up or login with your details

Forgot password? Click here to reset