NER-MQMRC: Formulating Named Entity Recognition as Multi Question Machine Reading Comprehension

05/12/2022
by   Anubhav Shrimal, et al.
0

NER has been traditionally formulated as a sequence labeling task. However, there has been recent trend in posing NER as a machine reading comprehension task (Wang et al., 2020; Mengge et al., 2020), where entity name (or other information) is considered as a question, text as the context and entity value in text as answer snippet. These works consider MRC based on a single question (entity) at a time. We propose posing NER as a multi-question MRC task, where multiple questions (one question per entity) are considered at the same time for a single text. We propose a novel BERT-based multi-question MRC (NER-MQMRC) architecture for this formulation. NER-MQMRC architecture considers all entities as input to BERT for learning token embeddings with self-attention and leverages BERT-based entity representation for further improving these token embeddings for NER task. Evaluation on three NER datasets show that our proposed architecture leads to average 2.5 times faster training and 2.3 times faster inference as compared to NER-SQMRC framework based models by considering all entities together in a single pass. Further, we show that our model performance does not degrade compared to single-question based MRC (NER-SQMRC) (Devlin et al., 2019) leading to F1 gain of +0.41 AE-Pub, Ecommerce5PT and Twitter datasets respectively. We propose this architecture primarily to solve large scale e-commerce attribute (or entity) extraction from unstructured text of a magnitude of 50k+ attributes to be extracted on a scalable production environment with high performance and optimised training and inference runtimes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/20/2023

Named Entity Recognition via Machine Reading Comprehension: A Multi-Task Learning Approach

Named Entity Recognition (NER) aims to extract and classify entity menti...
research
08/24/2019

Query-Based Named Entity Recognition

In this paper, we propose a new strategy for the task of named entity re...
research
11/10/2019

Knowledge Guided Named Entity Recognition

In this work, we try to perform Named Entity Recognition (NER) with exte...
research
08/29/2019

Remedying BiLSTM-CNN Deficiency in Modeling Cross-Context for NER

Recent researches prevalently used BiLSTM-CNN as a core module for NER i...
research
07/30/2020

Neural Modeling for Named Entities and Morphology (NEMO^2)

Named Entity Recognition (NER) is a fundamental NLP task, commonly formu...
research
05/06/2023

NER-to-MRC: Named-Entity Recognition Completely Solving as Machine Reading Comprehension

Named-entity recognition (NER) detects texts with predefined semantic la...
research
08/19/2016

Who did What: A Large-Scale Person-Centered Cloze Dataset

We have constructed a new "Who-did-What" dataset of over 200,000 fill-in...

Please sign up or login with your details

Forgot password? Click here to reset