Concept Transfer Learning for Adaptive Language Understanding

06/03/2017
by   Su Zhu, et al.
0

Semantic transfer is an important problem of the language understanding (LU), which is about how the recognition pattern of a semantic concept benefits other associated concepts. In this paper, we propose a new semantic representation based on combinatory concepts. Semantic slot is represented as a composition of different atomic concepts in different semantic dimensions. Specifically, we propose the concept transfer learning methods for extending combinatory concepts in LU. The concept transfer learning makes use of the common ground of combinatory concepts shown in the literal description. Our methods are applied to two adaptive LU problems: semantic slot refinement and domain adaptation, and respectively evaluated on two benchmark LU datasets: ATIS and DSTC 2&3. The experiment results show that the concept transfer learning is very efficient for semantic slot refinement and domain adaptation in the LU.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/29/2018

Zero-Shot Adaptive Transfer for Conversational Language Understanding

Conversational agents such as Alexa and Google Assistant constantly need...
research
03/22/2020

Prior Knowledge Driven Label Embedding for Slot Filling in Natural Language Understanding

Traditional slot filling in natural language understanding (NLU) predict...
research
11/05/2020

Language Model is All You Need: Natural Language Understanding as Question Answering

Different flavors of transfer learning have shown tremendous impact in a...
research
11/14/2022

Renewing Iterative Self-labeling Domain Adaptation with Application to the Spine Motion Prediction

The area of transfer learning comprises supervised machine learning meth...
research
11/02/2021

Adapting to the Long Tail: A Meta-Analysis of Transfer Learning Research for Language Understanding Tasks

Natural language understanding (NLU) has made massive progress driven by...
research
01/30/2021

Fundamentals of Semantic Numeration Systems. Can the Context be Calculated?

This work is the first to propose the concept of a semantic numeration s...
research
07/10/2021

Prediction of concept lengths for fast concept learning in description logics

Concept learning approaches based on refinement operators explore partia...

Please sign up or login with your details

Forgot password? Click here to reset