Look Closer to Supervise Better: One-Shot Font Generation via Component-Based Discriminator

04/30/2022
by   Yuxin Kong, et al.
0

Automatic font generation remains a challenging research issue due to the large amounts of characters with complicated structures. Typically, only a few samples can serve as the style/content reference (termed few-shot learning), which further increases the difficulty to preserve local style patterns or detailed glyph structures. We investigate the drawbacks of previous studies and find that a coarse-grained discriminator is insufficient for supervising a font generator. To this end, we propose a novel Component-Aware Module (CAM), which supervises the generator to decouple content and style at a more fine-grained level, i.e., the component level. Different from previous studies struggling to increase the complexity of generators, we aim to perform more effective supervision for a relatively simple generator to achieve its full potential, which is a brand new perspective for font generation. The whole framework achieves remarkable results by coupling component-level supervision with adversarial learning, hence we call it Component-Guided GAN, shortly CG-GAN. Extensive experiments show that our approach outperforms state-of-the-art one-shot font generation methods. Furthermore, it can be applied to handwritten word synthesis and scene text image editing, suggesting the generalization of our approach.

READ FULL TEXT

page 1

page 2

page 4

page 7

page 9

page 10

page 12

page 15

research
01/13/2020

Separating Content from Style Using Adversarial Learning for Recognizing Text in the Wild

In this work we propose to improve text recognition from a new perspecti...
research
01/24/2023

Few-shot Font Generation by Learning Style Difference and Similarity

Few-shot font generation (FFG) aims to preserve the underlying global st...
research
05/12/2022

D3T-GAN: Data-Dependent Domain Transfer GANs for Few-shot Image Generation

As an important and challenging problem, few-shot image generation aims ...
research
09/23/2020

Few-shot Font Generation with Localized Style Representations and Factorization

Automatic few-shot font generation is in high demand because manual desi...
research
10/02/2020

MGD-GAN: Text-to-Pedestrian generation through Multi-Grained Discrimination

In this paper, we investigate the problem of text-to-pedestrian synthesi...
research
04/11/2022

XMP-Font: Self-Supervised Cross-Modality Pre-training for Few-Shot Font Generation

Generating a new font library is a very labor-intensive and time-consumi...
research
05/31/2023

Control4D: Dynamic Portrait Editing by Learning 4D GAN from 2D Diffusion-based Editor

Recent years have witnessed considerable achievements in editing images ...

Please sign up or login with your details

Forgot password? Click here to reset