The Person Index Challenge: Extraction of Persons from Messy, Short Texts

11/16/2020
by   Markus Schröder, et al.
0

When persons are mentioned in texts with their first name, last name and/or middle names, there can be a high variation which of their names are used, how their names are ordered and if their names are abbreviated. If multiple persons are mentioned consecutively in very different ways, especially short texts can be perceived as "messy". Once ambiguous names occur, associations to persons may not be inferred correctly. Despite these eventualities, in this paper we ask how well an unsupervised algorithm can build a person index from short texts. We define a person index as a structured table that distinctly catalogs individuals by their names. First, we give a formal definition of the problem and describe a procedure to generate ground truth data for future evaluations. To give a first solution to this challenge, a baseline approach is implemented. By using our proposed evaluation strategy, we test the performance of the baseline and suggest further improvements. For future research the source code is publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/12/2023

Improving the Quality of Neural Machine Translation Through Proper Translation of Name Entities

In this paper, we have shown a method of improving the quality of neural...
research
08/23/2023

Computational Dating for the Nuzi Cuneiform Archive: The Least Squares Constrained by Family Trees and Synchronisms

We introduce a computational method of dating for an archive in ancient ...
research
11/27/2019

Sideways Transliteration: How to Transliterate Multicultural Person Names?

In a global setting, texts contain transliterated names from many cultur...
research
08/10/2017

Location Name Extraction from Targeted Text Streams using Gazetteer-based Statistical Language Models

Extracting location names from informal and unstructured texts requires ...
research
03/25/2021

Towards a Model to Appraise and Suggest Identifier Names

Unknowingly, identifiers in the source code of a software system play a ...
research
07/08/2020

Understanding the impact of the alphabetical ordering of names in user interfaces: a gender bias analysis

Listing people alphabetically on an electronic output device is a tradit...
research
08/26/2022

Race and ethnicity data for first, middle, and last names

We provide the largest compiled publicly available dictionaries of first...

Please sign up or login with your details

Forgot password? Click here to reset