FONTNET: On-Device Font Understanding and Prediction Pipeline

by   Rakshith S, et al.

Fonts are one of the most basic and core design concepts. Numerous use cases can benefit from an in depth understanding of Fonts such as Text Customization which can change text in an image while maintaining the Font attributes like style, color, size. Currently, Text recognition solutions can group recognized text based on line breaks or paragraph breaks, if the Font attributes are known multiple text blocks can be combined based on context in a meaningful manner. In this paper, we propose two engines: Font Detection Engine, which identifies the font style, color and size attributes of text in an image and a Font Prediction Engine, which predicts similar fonts for a query font. Major contributions of this paper are three-fold: First, we developed a novel CNN architecture for identifying font style of text in images. Second, we designed a novel algorithm for predicting similar fonts for a given query font. Third, we have optimized and deployed the entire engine On-Device which ensures privacy and improves latency in real time applications such as instant messaging. We achieve a worst case On-Device inference time of 30ms and a model size of 4.5MB for both the engines.



There are no comments yet.


page 1

page 2

page 3

page 4


STRIDE : Scene Text Recognition In-Device

Optical Character Recognition (OCR) systems have been widely used in var...

ScreenSeg: On-Device Screenshot Layout Analysis

We propose a novel end-to-end solution that performs a Hierarchical Layo...

Dual Adversarial Inference for Text-to-Image Synthesis

Synthesizing images from a given text description involves engaging two ...

DeepStyle: Multimodal Search Engine for Fashion and Interior Design

In this paper, we propose a multimodal search engine that combines visua...

On- Device Information Extraction from Screenshots in form of tags

We propose a method to make mobile screenshots easily searchable. In thi...

VoiceMoji: A Novel On-Device Pipeline for Seamless Emoji Insertion in Dictation

Most of the speech recognition systems recover only words in the speech ...

WebMIaS on Docker: Deploying Math-Aware Search in a Single Line of Code

Math informational retrieval (MIR) search engines are absent in the wide...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.