Editing Text in the Wild

08/08/2019
by   Liang Wu, et al.
4

In this paper, we are interested in editing text in natural images, which aims to replace or modify a word in the source image with another one while maintaining its realistic look. This task is challenging, as the styles of both background and text need to be preserved so that the edited image is visually indistinguishable from the source image. Specifically, we propose an end-to-end trainable style retention network (SRNet) that consists of three modules: text conversion module, background inpainting module and fusion module. The text conversion module changes the text content of the source image into the target text while keeping the original text style. The background inpainting module erases the original text, and fills the text region with appropriate texture. The fusion module combines the information from the two former modules, and generates the edited text images. To our knowledge, this work is the first attempt to edit text in natural images at the word level. Both visual effects and quantitative results on synthetic and real-world dataset (ICDAR 2013) fully confirm the importance and necessity of modular decomposition. We also conduct extensive experiments to validate the usefulness of our method in various real-world applications such as text image synthesis, augmented reality (AR) translation, information hiding, etc.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 7

page 8

research
04/20/2023

Scene Style Text Editing

In this work, we propose a task called "Scene Style Text Editing (SSTE)"...
research
07/23/2021

RewriteNet: Realistic Scene Text Image Generation via Editing Text in Real-world Image

Scene text editing (STE), which converts a text in a scene image into th...
research
12/03/2018

EnsNet: Ensconce Text in the Wild

A new method is proposed for removing text from natural images. The chal...
research
12/05/2022

Exploring Stroke-Level Modifications for Scene Text Editing

Scene text editing (STE) aims to replace text with the desired one while...
research
06/05/2023

User-friendly Image Editing with Minimal Text Input: Leveraging Captioning and Injection Techniques

Recent text-driven image editing in diffusion models has shown remarkabl...
research
10/05/2022

Inharmonious Region Localization with Auxiliary Style Feature

With the prevalence of image editing techniques, users can create fantas...
research
05/27/2019

Transcribing Content from Structural Images with Spotlight Mechanism

Transcribing content from structural images, e.g., writing notes from mu...

Please sign up or login with your details

Forgot password? Click here to reset