Can I teach a robot to replicate a line art

Line art is arguably one of the fundamental and versatile modes of expression. We propose a pipeline for a robot to look at a grayscale line art and redraw it. The key novel elements of our pipeline are: a) we propose a novel task of mimicking line drawings, b) to solve the pipeline we modify the Quick-draw dataset to obtain supervised training for converting a line drawing into a series of strokes c) we propose a multi-stage segmentation and graph interpretation pipeline for solving the problem. The resultant method has also been deployed on a CNC plotter as well as a robotic arm. We have trained several variations of the proposed methods and evaluate these on a dataset obtained from Quick-draw. Through the best methods we observe an accuracy of around 98 architecture we adapted from. This therefore allows for deployment of the method on robots for replicating line art in a reliable manner. We also show that while the rule-based vectorization methods do suffice for simple drawings, it fails for more complicated sketches, unlike our method which generalizes well to more complicated distributions.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 8

research
10/14/2022

TSP-Bot: Robotic TSP Pen Art using High-DoF Manipulators

TSP art is an art form for drawing an image using piecewise-continuous l...
research
03/20/2023

AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Models

It is a time-consuming and tedious work for manually colorizing anime li...
research
04/13/2022

Geometric Understanding of Sketches

Sketching is used as a ubiquitous tool of expression by novices and expe...
research
06/27/2022

Learn Fast, Segment Well: Fast Object Segmentation Learning on the iCub Robot

The visual system of a robot has different requirements depending on the...
research
01/22/2021

The Role of Edges in Line Drawing Perception

It has often been conjectured that the effectiveness of line drawings ca...
research
08/22/2023

A Semi-automatic Oriental Ink Painting Framework for Robotic Drawing from 3D Models

Creating visually pleasing stylized ink paintings from 3D models is a ch...
research
03/23/2020

Neural Contours: Learning to Draw Lines from 3D Shapes

This paper introduces a method for learning to generate line drawings fr...

Please sign up or login with your details

Forgot password? Click here to reset