DeepScribe: Localization and Classification of Elamite Cuneiform Signs Via Deep Learning

06/02/2023
by   Edward C. Williams, et al.
0

Twenty-five hundred years ago, the paperwork of the Achaemenid Empire was recorded on clay tablets. In 1933, archaeologists from the University of Chicago's Oriental Institute (OI) found tens of thousands of these tablets and fragments during the excavation of Persepolis. Many of these tablets have been painstakingly photographed and annotated by expert cuneiformists, and now provide a rich dataset consisting of over 5,000 annotated tablet images and 100,000 cuneiform sign bounding boxes. We leverage this dataset to develop DeepScribe, a modular computer vision pipeline capable of localizing cuneiform signs and providing suggestions for the identity of each sign. We investigate the difficulty of learning subtasks relevant to cuneiform tablet transcription on ground-truth data, finding that a RetinaNet object detector can achieve a localization mAP of 0.78 and a ResNet classifier can achieve a top-5 sign classification accuracy of 0.89. The end-to-end pipeline achieves a top-5 classification accuracy of 0.80. As part of the classification module, DeepScribe groups cuneiform signs into morphological clusters. We consider how this automatic clustering approach differs from the organization of standard, printed sign lists and what we may learn from it. These components, trained individually, are sufficient to produce a system that can analyze photos of cuneiform tablets from the Achaemenid period and provide useful transliteration suggestions to researchers. We evaluate the model's end-to-end performance on locating and classifying signs, providing a roadmap to a linguistically-aware transliteration system, then consider the model's potential utility when applied to other periods of cuneiform writing.

READ FULL TEXT

page 4

page 12

page 14

page 31

research
08/14/2022

BDSL 49: A Comprehensive Dataset of Bangla Sign Language

Language is a method by which individuals express their thoughts. Each l...
research
03/18/2020

Rethinking Object Detection in Retail Stores

The convention standard for object detection uses a bounding box to repr...
research
08/22/2023

CNN based Cuneiform Sign Detection Learned from Annotated 3D Renderings and Mapped Photographs with Illumination Augmentation

Motivated by the challenges of the Digital Ancient Near Eastern Studies ...
research
07/08/2022

ASL-Homework-RGBD Dataset: An annotated dataset of 45 fluent and non-fluent signers performing American Sign Language homeworks

We are releasing a dataset containing videos of both fluent and non-flue...
research
11/19/2018

Scalable Logo Recognition using Proxies

Logo recognition is the task of identifying and classifying logos. Logo ...
research
03/29/2023

A Video-based End-to-end Pipeline for Non-nutritive Sucking Action Recognition and Segmentation in Young Infants

We present an end-to-end computer vision pipeline to detect non-nutritiv...
research
10/01/2014

Learning to Transfer Privileged Information

We introduce a learning framework called learning using privileged infor...

Please sign up or login with your details

Forgot password? Click here to reset