A Semi-automatic Oriental Ink Painting Framework for Robotic Drawing from 3D Models

08/22/2023
by   Hao Jin, et al.
0

Creating visually pleasing stylized ink paintings from 3D models is a challenge in robotic manipulation. We propose a semi-automatic framework that can extract expressive strokes from 3D models and draw them in oriental ink painting styles by using a robotic arm. The framework consists of a simulation stage and a robotic drawing stage. In the simulation stage, geometrical contours were automatically extracted from a certain viewpoint and a neural network was employed to create simplified contours. Then, expressive digital strokes were generated after interactive editing according to user's aesthetic understanding. In the robotic drawing stage, an optimization method was presented for drawing smooth and physically consistent strokes to the digital strokes, and two oriental ink painting styles termed as Noutan (shade) and Kasure (scratchiness) were applied to the strokes by robotic control of a brush's translation, dipping and scraping. Unlike existing methods that concentrate on generating paintings from 2D images, our framework has the advantage of rendering stylized ink paintings from 3D models by using a consumer-grade robotic arm. We evaluate the proposed framework by taking 3 standard models and a user-defined model as examples. The results show that our framework is able to draw visually pleasing oriental ink paintings with expressive strokes.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

page 10

page 11

research
10/14/2022

Stroke-based Rendering and Planning for Robotic Performance of Artistic Drawing

We present a new robotic drawing system based on stroke-based rendering ...
research
10/14/2022

TSP-Bot: Robotic TSP Pen Art using High-DoF Manipulators

TSP art is an art form for drawing an image using piecewise-continuous l...
research
08/09/2022

From Scratch to Sketch: Deep Decoupled Hierarchical Reinforcement Learning for Robotic Sketching Agent

We present an automated learning framework for a robotic sketching agent...
research
08/16/2021

Autocomplete Repetitive Stroking with Image Guidance

Image-guided drawing can compensate for the lack of skills but often req...
research
09/30/2020

Multi-Pen Robust Robotic 3D Drawing Using Closed-Loop Planning

This paper develops a flexible and robust robotic system for autonomous ...
research
05/12/2020

Making Robots Draw A Vivid Portrait In Two Minutes

Significant progress has been made with artistic robots. However, existi...
research
10/17/2019

Can I teach a robot to replicate a line art

Line art is arguably one of the fundamental and versatile modes of expre...

Please sign up or login with your details

Forgot password? Click here to reset