Performance Evaluation of Low-Cost Machine Vision Cameras for Image-Based Grasp Verification

03/23/2020
by   Deebul Nair, et al.
0

Grasp verification is advantageous for autonomous manipulation robots as they provide the feedback required for higher level planning components about successful task completion. However, a major obstacle in doing grasp verification is sensor selection. In this paper, we propose a vision based grasp verification system using machine vision cameras, with the verification problem formulated as an image classification task. Machine vision cameras consist of a camera and a processing unit capable of on-board deep learning inference. The inference in these low-power hardware are done near the data source, reducing the robot's dependence on a centralized server, leading to reduced latency, and improved reliability. Machine vision cameras provide the deep learning inference capabilities using different neural accelerators. Although, it is not clear from the documentation of these cameras what is the effect of these neural accelerators on performance metrics such as latency and throughput. To systematically benchmark these machine vision cameras, we propose a parameterized model generator that generates end to end models of Convolutional Neural Networks(CNN). Using these generated models we benchmark latency and throughput of two machine vision cameras, JeVois A33 and Sipeed Maix Bit. Our experiments demonstrate that the selected machine vision camera and the deep learning models can robustly verify grasp with 97 accuracy.

READ FULL TEXT

page 1

page 2

page 5

page 6

research
03/09/2022

VGQ-CNN: Moving Beyond Fixed Cameras and Top-Grasps for Grasp Quality Prediction

We present the Versatile Grasp Quality Convolutional Neural Network (VGQ...
research
05/27/2023

ColibriUAV: An Ultra-Fast, Energy-Efficient Neuromorphic Edge Processing UAV-Platform with Event-Based and Frame-Based Cameras

The interest in dynamic vision sensor (DVS)-powered unmanned aerial vehi...
research
02/26/2020

Graphcore C2 Card performance for image-based deep learning application: A Report

Recently, Graphcore has introduced an IPU Processor for accelerating mac...
research
06/10/2023

On Robot Grasp Learning Using Equivariant Models

Real-world grasp detection is challenging due to the stochasticity in gr...
research
04/15/2020

Neuromorphic Eye-in-Hand Visual Servoing

Robotic vision plays a major role in factory automation to service robot...
research
05/12/2023

Vision and Control for Grasping Clear Plastic Bags

We develop two novel vision methods for planning effective grasps for cl...
research
07/21/2023

A Benchmarking Study on Vision-Based Grasp Synthesis Algorithms

In this paper, we present a benchmarking study of vision-based grasp syn...

Please sign up or login with your details

Forgot password? Click here to reset