AI Chat AI Image Generator AI Video Text to Speech

Solving Historical Dictionary Codes with a Neural Language Model

10/09/2020

∙

by Christopher Chu, et al.

∙

∙

We solve difficult word-based substitution codes by constructing a decoding lattice and searching that lattice with a neural language model. We apply our method to a set of enciphered letters exchanged between US Army General James Wilkinson and agents of the Spanish Crown in the late 1700s and early 1800s, obtained from the US Library of Congress. We are able to decipher 75.1 cipher-word tokens correctly.

Christopher Chu
4 publications
Raphael Valenti
1 publication
Kevin Knight
28 publications

page 4

page 9

research

∙ 03/13/2018

Neural Lattice Language Models

In this work, we propose a new language modeling paradigm that has the a...

0 Jacob Buckman, et al. ∙

research

∙ 04/23/2018

Spell Once, Summon Anywhere: A Two-Level Open-Vocabulary Language Model

We show how to deploy recurrent neural networks within a hierarchical Ba...

0 Sebastian J. Mielke, et al. ∙

research

∙ 01/04/2020

Transformer-based language modeling and decoding for conversational speech recognition

We propose a way to use a transformer-based language model in conversati...

0 Kareem Nassar, et al. ∙

research

∙ 05/25/2022

Segmenting Numerical Substitution Ciphers

Deciphering historical substitution ciphers is a challenging problem. Ex...

0 Nada Aldarrab, et al. ∙

research

∙ 04/06/2021

LT-LM: a novel non-autoregressive language model for single-shot lattice rescoring

Neural network-based language models are commonly used in rescoring appr...

0 Anton Mitrofanov, et al. ∙

research

∙ 07/01/2019

LSTM Language Models for LVCSR in First-Pass Decoding and Lattice-Rescoring

LSTM based language models are an important part of modern LVCSR systems...

0 Eugen Beck, et al. ∙

research

∙ 04/12/2019

IIT (BHU) Varanasi at MSR-SRST 2018: A Language Model Based Approach for Natural Language Generation

This paper describes our submission system for the Shallow Track of Surf...

0 Shreyansh Singh, et al. ∙