Data Augmentation for Robust Character Detection in Fantasy Novels

02/09/2023
by   Arthur Amalvy, et al.
0

Named Entity Recognition (NER) is a low-level task often used as a foundation for solving higher level NLP problems. In the context of character detection in novels, NER false negatives can be an issue as they possibly imply missing certain characters or relationships completely. In this article, we demonstrate that applying a straightforward data augmentation technique allows training a model achieving higher recall, at the cost of a certain amount of precision regarding ambiguous entities. We show that this decrease in precision can be mitigated by giving the model more local context, which resolves some of the ambiguities.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset