UniNL: Aligning Representation Learning with Scoring Function for OOD Detection via Unified Neighborhood Learning

10/19/2022
by   Yutao Mou, et al.
0

Detecting out-of-domain (OOD) intents from user queries is essential for avoiding wrong operations in task-oriented dialogue systems. The key challenge is how to distinguish in-domain (IND) and OOD intents. Previous methods ignore the alignment between representation learning and scoring function, limiting the OOD detection performance. In this paper, we propose a unified neighborhood learning framework (UniNL) to detect OOD intents. Specifically, we design a K-nearest neighbor contrastive learning (KNCL) objective for representation learning and introduce a KNN-based scoring function for OOD detection. We aim to align representation learning with scoring function. Experiments and analysis on two benchmark datasets show the effectiveness of our method.

READ FULL TEXT
research
10/17/2022

Watch the Neighbors: A Unified K-Nearest Neighbor Contrastive Learning Framework for OOD Intent Discovery

Discovering out-of-domain (OOD) intent is important for developing new s...
research
05/28/2023

Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery

Generalized intent discovery aims to extend a closed-set in-domain inten...
research
12/08/2021

Revisiting Contrastive Learning through the Lens of Neighborhood Component Analysis: an Integrated Framework

As a seminal tool in self-supervised representation learning, contrastiv...
research
09/22/2022

Oracle Analysis of Representations for Deep Open Set Detection

The problem of detecting a novel class at run time is known as Open Set ...
research
05/29/2021

Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learning

Detecting Out-of-Domain (OOD) or unknown intents from user queries is es...
research
11/15/2021

Contrastive Representation Learning with Trainable Augmentation Channel

In contrastive representation learning, data representation is trained s...
research
05/22/2023

uCTRL: Unbiased Contrastive Representation Learning via Alignment and Uniformity for Collaborative Filtering

Because implicit user feedback for the collaborative filtering (CF) mode...

Please sign up or login with your details

Forgot password? Click here to reset