Calligraphic Stylisation Learning with a Physiologically Plausible Model of Movement and Recurrent Neural Networks

09/24/2017
by   Daniel Berio, et al.
0

We propose a computational framework to learn stylisation patterns from example drawings or writings, and then generate new trajectories that possess similar stylistic qualities. We particularly focus on the generation and stylisation of trajectories that are similar to the ones that can be seen in calligraphy and graffiti art. Our system is able to extract and learn dynamic and visual qualities from a small number of user defined examples which can be recorded with a digitiser device, such as a tablet, mouse or motion capture sensors. Our system is then able to transform new user drawn traces to be kinematically and stylistically similar to the training examples. We implement the system using a Recurrent Mixture Density Network (RMDN) combined with a representation given by the parameters of the Sigma Lognormal model, a physiologically plausible model of movement that has been shown to closely reproduce the velocity and trace of human handwriting gestures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/29/2018

Auto-conditioned Recurrent Mixture Density Networks for Complex Trajectory Generation

Recent advancements in machine learning research have given rise to recu...
research
07/31/2018

Traj2User: exploiting embeddings for computing similarity of users mobile behavior

Semantic trajectories are high level representations of user movements w...
research
08/03/2022

Neural Dynamic Movement Primitives – a survey

One of the most important challenges in robotics is producing accurate t...
research
11/25/2021

SCLAiR : Supervised Contrastive Learning for User and Device Independent Airwriting Recognition

Airwriting Recognition is the problem of identifying letters written in ...
research
05/31/2021

Scene-aware Generative Network for Human Motion Synthesis

We revisit human motion synthesis, a task useful in various real world a...
research
10/24/2018

Deep Learning Scooping Motion using Bilateral Teleoperations

We present bilateral teleoperation system for task learning and robot mo...
research
08/16/2019

Wi-Fringe: Leveraging Text Semantics in WiFi CSI-Based Device-Free Named Gesture Recognition

The lack of adequate training data is one of the major hurdles in WiFi-b...

Please sign up or login with your details

Forgot password? Click here to reset