SlugNERDS: A Named Entity Recognition Tool for Open Domain Dialogue Systems

05/10/2018
by   Kevin K. Bowden, et al.
0

In dialogue systems, the tasks of named entity recognition (NER) and named entity linking (NEL) are vital preprocessing steps for understanding user intent, especially in open domain interaction where we cannot rely on domain-specific inference. UCSC's effort as one of the funded teams in the 2017 Amazon Alexa Prize Contest has yielded Slugbot, an open domain social bot, aimed at casual conversation. We discovered several challenges specifically associated with both NER and NEL when building Slugbot, such as that the NE labels are too coarse-grained or the entity types are not linked to a useful ontology. Moreover, we have discovered that traditional approaches do not perform well in our context: even systems designed to operate on tweets or other social media data do not work well in dialogue systems. In this paper, we introduce Slugbot's Named Entity Recognition for dialogue Systems (SlugNERDS), a NER and NEL tool which is optimized to address these issues. We describe two new resources that we are building as part of this work: SlugEntityDB and SchemaActuator. We believe these resources will be useful for the research community.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/24/2020

Domain-Transferable Method for Named Entity Recognition Task

Named Entity Recognition (NER) is a fundamental task in the fields of na...
research
09/06/2019

#MeTooMaastricht: Building a chatbot to assist survivors of sexual harassment

Inspired by the recent social movement of #MeToo, we are building a chat...
research
09/07/2021

Joint model for intent and entity recognition

The semantic understanding of natural dialogues composes of several part...
research
07/29/2021

Addressing Barriers to Reproducible Named Entity Recognition Evaluation

To address what we believe is a looming crisis of unreproducible evaluat...
research
09/10/2023

Learning Personalized User Preference from Cold Start in Multi-turn Conversations

This paper presents a novel teachable conversation interaction system th...
research
01/11/2017

Generalisation in Named Entity Recognition: A Quantitative Analysis

Named Entity Recognition (NER) is a key NLP task, which is all the more ...
research
09/24/2018

Recognizing Film Entities in Podcasts

In this paper, we propose a Named Entity Recognition (NER) system to ide...

Please sign up or login with your details

Forgot password? Click here to reset