Generative Art Using Neural Visual Grammars and Dual Encoders

05/01/2021
by   Chrisantha Fernando, et al.
42

Whilst there are perhaps only a few scientific methods, there seem to be almost as many artistic methods as there are artists. Artistic processes appear to inhabit the highest order of open-endedness. To begin to understand some of the processes of art making it is helpful to try to automate them even partially. In this paper, a novel algorithm for producing generative art is described which allows a user to input a text string, and which in a creative response to this string, outputs an image which interprets that string. It does so by evolving images using a hierarchical neural Lindenmeyer system, and evaluating these images along the way using an image text dual encoder trained on billions of images and their associated text from the internet. In doing so we have access to and control over an instance of an artistic process, allowing analysis of which aspects of the artistic process become the task of the algorithm, and which elements remain the responsibility of the artist.

READ FULL TEXT

page 7

page 9

page 10

page 14

page 15

page 16

page 17

page 19

research
04/23/2018

Guided Attention for Large Scale Scene Text Verification

Many tasks are related to determining if a particular text string exists...
research
03/10/2022

LoopITR: Combining Dual and Cross Encoder Architectures for Image-Text Retrieval

Dual encoders and cross encoders have been widely used for image-text re...
research
06/01/2018

Block Palindromes: A New Generalization of Palindromes

We propose a new generalization of palindromes and gapped palindromes ca...
research
03/17/2020

A New Implementation of Manacher's Algorithm

Manacher's algorithm is optimal for the longest palindromic substring pr...
research
07/03/2023

Sampling the lattice Nambu-Goto string using Continuous Normalizing Flows

Effective String Theory (EST) represents a powerful non-perturbative app...
research
05/24/2023

A Neural Space-Time Representation for Text-to-Image Personalization

A key aspect of text-to-image personalization methods is the manner in w...

Please sign up or login with your details

Forgot password? Click here to reset