Named Entities troubling your Neural Methods? Build NE-Table: A neural approach for handling Named Entities

04/22/2018
by   Janarthanan Rajendran, et al.
0

Many natural language processing tasks require dealing with Named Entities (NEs) in the texts themselves and sometimes also in external knowledge sources. While this is often easy for humans, recent neural methods that rely on learned word embeddings for NLP tasks have difficulty with it, especially with out of vocabulary or rare NEs. In this paper, we propose a new neural method for this problem, and present empirical evaluations on a structured Question-Answering task, three related Goal-Oriented dialog tasks and a reading-comprehension-based task. They show that our proposed method can be effective in dealing with both in-vocabulary and out of vocabulary (OOV) NEs. We create extended versions of dialog bAbI tasks 1,2 and 4 and Out-of-vocabulary (OOV) versions of the CBT test set which will be made publicly available online.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/06/2019

Dialog State Tracking: A Neural Reading Comprehension Approach

Dialog state tracking is used to estimate the current belief state of a ...
research
05/29/2021

Annotation Inconsistency and Entity Bias in MultiWOZ

MultiWOZ is one of the most popular multi-domain task-oriented dialog da...
research
11/18/2020

Out-of-Task Training for Dialog State Tracking Models

Dialog state tracking (DST) suffers from severe data sparsity. While man...
research
09/16/2020

Knowledge Graphs for Multilingual Language Translation and Generation

The Natural Language Processing (NLP) community has recently seen outsta...
research
01/11/2023

Multimodal Inverse Cloze Task for Knowledge-based Visual Question Answering

We present a new pre-training method, Multimodal Inverse Cloze Task, for...
research
06/01/2017

Learning to Compute Word Embeddings On the Fly

Words in natural language follow a Zipfian distribution whereby some wor...
research
05/03/2018

Hierarchical Pointer Memory Network for Task Oriented Dialogue

We observe that end-to-end memory networks (MN) trained for task-oriente...

Please sign up or login with your details

Forgot password? Click here to reset