Detecting Unusual Input-Output Associations in Multivariate Conditional Data

12/21/2016
by   Charmgil Hong, et al.
0

Despite tremendous progress in outlier detection research in recent years, the majority of existing methods are designed only to detect unconditional outliers that correspond to unusual data patterns expressed in the joint space of all data attributes. Such methods are not applicable when we seek to detect conditional outliers that reflect unusual responses associated with a given context or condition. This work focuses on multivariate conditional outlier detection, a special type of the conditional outlier detection problem, where data instances consist of multi-dimensional input (context) and output (responses) pairs. We present a novel outlier detection framework that identifies abnormal input-output associations in data with the help of a decomposable conditional probabilistic model that is learned from all data instances. Since components of this model can vary in their quality, we combine them with the help of weights reflecting their reliability in assessment of outliers. We study two ways of calculating the component weights: global that relies on all data, and local that relies only on instances similar to the target instance. Experimental results on data from various domains demonstrate the ability of our framework to successfully identify multivariate conditional outliers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/03/2017

Detection of Abnormal Input-Output Associations

We study a novel outlier detection problem that aims to identify abnorma...
research
05/15/2015

MCODE: Multivariate Conditional Outlier Detection

Outlier detection aims to identify unusual data instances that deviate f...
research
04/22/2021

Conditional Selective Inference for Robust Regression and Outlier Detection using Piecewise-Linear Homotopy Continuation

In practical data analysis under noisy environment, it is common to firs...
research
07/26/2022

Multivariate Functional Outlier Detection using the FastMUOD Indices

We present definitions and properties of the fast massive unsupervised o...
research
07/02/2020

Outlier Detection through Null Space Analysis of Neural Networks

Many machine learning classification systems lack competency awareness. ...
research
06/14/2021

Outlier detection in multivariate functional data through a contaminated mixture model

This work is motivated by an application in an industrial context, where...
research
02/17/2019

A feature-based framework for detecting technical outliers in water-quality data from in situ sensors

Outliers due to technical errors in water-quality data from in situ sens...

Please sign up or login with your details

Forgot password? Click here to reset