FontTransformer: Few-shot High-resolution Chinese Glyph Image Synthesis via Stacked Transformers

10/12/2022
by   Yitian Liu, et al.
0

Automatic generation of high-quality Chinese fonts from a few online training samples is a challenging task, especially when the amount of samples is very small. Existing few-shot font generation methods can only synthesize low-resolution glyph images that often possess incorrect topological structures or/and incomplete strokes. To address the problem, this paper proposes FontTransformer, a novel few-shot learning model, for high-resolution Chinese glyph image synthesis by using stacked Transformers. The key idea is to apply the parallel Transformer to avoid the accumulation of prediction errors and utilize the serial Transformer to enhance the quality of synthesized strokes. Meanwhile, we also design a novel encoding scheme to feed more glyph information and prior knowledge to our model, which further enables the generation of high-resolution and visually-pleasing glyph images. Both qualitative and quantitative experimental results demonstrate the superiority of our method compared to other existing approaches in the few-shot Chinese font synthesis task.

READ FULL TEXT

page 6

page 12

page 13

page 14

page 17

page 18

page 22

page 23

research
10/11/2019

Artistic Glyph Image Synthesis via One-Stage Few-Shot Learning

Automatic generation of artistic glyph images is a challenging task that...
research
03/25/2023

DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Quality

Vector font synthesis is a challenging and ongoing problem in the fields...
research
12/17/2020

Taming Transformers for High-Resolution Image Synthesis

Designed to learn long-range interactions on sequential data, transforme...
research
08/25/2020

Residual Network Based Direct Synthesis of EM Structures: A Study on One-to-One Transformers

We propose using machine learning models for the direct synthesis of on-...
research
12/20/2021

StyleSwin: Transformer-based GAN for High-resolution Image Generation

Despite the tantalizing success in a broad of vision tasks, transformers...
research
05/13/2022

FontNet: Closing the gap to font designer performance in font synthesis

Font synthesis has been a very active topic in recent years because manu...
research
10/13/2021

DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning

Automatic font generation based on deep learning has aroused a lot of in...

Please sign up or login with your details

Forgot password? Click here to reset