Deep CNN-based Speech Balloon Detection and Segmentation for Comic Books

02/21/2019
by   David Dubray, et al.
0

We develop a method for the automated detection and segmentation of speech balloons in comic books, including their carrier and tails. Our method is based on a deep convolutional neural network that was trained on annotated pages of the Graphic Narrative Corpus. More precisely, we are using a fully convolutional network approach inspired by the U-Net architecture, combined with a VGG-16 based encoder. The trained model delivers state-of-the-art performance with an F1-score of over 0.94. Qualitative results suggest that wiggly tails, curved corners, and even illusory contours do not pose a major problem. Furthermore, the model has learned to distinguish speech balloons from captions. We compare our model to earlier results and discuss some possible applications.

READ FULL TEXT

page 6

page 7

research
10/15/2020

Deep Convolutional Neural Network-based Inverse Filtering Approach for Speech De-reverberation

In this paper, we introduce a spectral-domain inverse filtering approach...
research
04/01/2022

Autonomous crater detection on asteroids using a fully-convolutional neural network

This paper shows the application of autonomous Crater Detection using th...
research
08/17/2020

Exploiting Fully Convolutional Network and Visualization Techniques on Spontaneous Speech for Dementia Detection

In this paper, we exploit a Fully Convolutional Network (FCN) to analyze...
research
11/08/2018

Microscopic Nuclei Classification, Segmentation and Detection with improved Deep Convolutional Neural Network (DCNN) Approaches

Due to cellular heterogeneity, cell nuclei classification, segmentation,...
research
01/07/2020

Automated Pavement Crack Segmentation Using Fully Convolutional U-Net with a Pretrained ResNet-34 Encoder

Automated pavement crack segmentation is a challenging task because of i...
research
06/24/2023

Semantic Segmentation of Porosity in 4D Spatio-Temporal X-ray μCT of Titanium Coated Ni wires using Deep Learning

A fully convolutional neural network was used to measure the evolution o...
research
12/09/2017

Deep Koalarization: Image Colorization using CNNs and Inception-ResNet-v2

We review some of the most recent approaches to colorize gray-scale imag...

Please sign up or login with your details

Forgot password? Click here to reset