Intent-calibrated Self-training for Answer Selection in Open-domain Dialogues

07/13/2023
by   Wentao Deng, et al.
0

Answer selection in open-domain dialogues aims to select an accurate answer from candidates. Recent success of answer selection models hinges on training with large amounts of labeled data. However, collecting large-scale labeled data is labor-intensive and time-consuming. In this paper, we introduce the predicted intent labels to calibrate answer labels in a self-training paradigm. Specifically, we propose the intent-calibrated self-training (ICAST) to improve the quality of pseudo answer labels through the intent-calibrated answer selection paradigm, in which we employ pseudo intent labels to help improve pseudo answer labels. We carry out extensive experiments on two benchmark datasets with open-domain dialogues. The experimental results show that ICAST outperforms baselines consistently with 1 Specifically, it improves 2.06 compared with the strongest baseline with only 5

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/10/2022

Estimating Soft Labels for Out-of-Domain Intent Detection

Out-of-Domain (OOD) intent detection is important for practical dialog s...
research
10/13/2022

An Open-World Lottery Ticket for Out-of-Domain Intent Classification

Most existing methods of Out-of-Domain (OOD) intent classification, whic...
research
03/15/2021

Semi-supervised learning by selective training with pseudo labels via confidence estimation

We propose a novel semi-supervised learning (SSL) method that adopts sel...
research
05/28/2023

Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery

Generalized intent discovery aims to extend a closed-set in-domain inten...
research
02/15/2022

Debiased Pseudo Labeling in Self-Training

Deep neural networks achieve remarkable performances on a wide range of ...
research
01/27/2022

Confidence May Cheat: Self-Training on Graph Neural Networks under Distribution Shift

Graph Convolutional Networks (GCNs) have recently attracted vast interes...
research
04/20/2023

Effective Open Intent Classification with K-center Contrastive Learning and Adjustable Decision Boundary

Open intent classification, which aims to correctly classify the known i...

Please sign up or login with your details

Forgot password? Click here to reset