Multi-Task Learning of Query Intent and Named Entities using Transfer Learning

04/28/2021
by   Ryan Siskind, et al.
0

Named entity recognition (NER) has been studied extensively and the earlier algorithms were based on sequence labeling like Hidden Markov Models (HMM) and conditional random fields (CRF). These were followed by neural network based deep learning models. Recently, BERT has shown new state of the art accuracy in sequence labeling tasks like NER. In this short article, we study various approaches to task specific NER. Task specific NER has two components - identifying the intent of a piece of text (like search queries), and then labeling the query with task specific named entities. For example, we consider the task of labeling Target store locations in a search query (which could be entered in a search box or spoken in a device like Alexa or Google Home). Store locations are highly ambiguous and sometimes it is difficult to differentiate between say a location and a non-location. For example, "pickup my order at orange store" has "orange" as the store location, while "buy orange at target" has "orange" as a fruit. We explore this difficulty by doing multi-task learning which we call global to local transfer of information. We jointly learn the query intent (i.e. store lookup) and the named entities by using multiple loss functions in our BERT based model and find interesting results.

READ FULL TEXT
research
06/12/2018

Named Entity Recognition with Extremely Limited Data

Traditional information retrieval treats named entity recognition as a p...
research
03/16/2023

BanglaCoNER: Towards Robust Bangla Complex Named Entity Recognition

Named Entity Recognition (NER) is a fundamental task in natural language...
research
05/26/2018

Connecting Distant Entities with Induction through Conditional Random Fields for Named Entity Recognition: Precursor-Induced CRF

This paper presents a method of designing specific high-order dependency...
research
02/15/2020

Deeper Task-Specificity Improves Joint Entity and Relation Extraction

Multi-task learning (MTL) is an effective method for learning related ta...
research
05/01/2020

Recurrent Interaction Network for Jointly Extracting Entities and Classifying Relations

Named entity recognition (NER) and Relation extraction (RE) are two fund...
research
12/18/2018

Predicting user intent from search queries using both CNNs and RNNs

Predicting user behaviour on a website is a difficult task, which requir...
research
02/19/2023

Intent Identification and Entity Extraction for Healthcare Queries in Indic Languages

Scarcity of data and technological limitations for resource-poor languag...

Please sign up or login with your details

Forgot password? Click here to reset