Regression with Sensor Data Containing Incomplete Observations

04/26/2023
by   Takayuki Katsuki, et al.
0

This paper addresses a regression problem in which output label values are the results of sensing the magnitude of a phenomenon. A low value of such labels can mean either that the actual magnitude of the phenomenon was low or that the sensor made an incomplete observation. This leads to a bias toward lower values in labels and its resultant learning because labels may have lower values due to incomplete observations, even if the actual magnitude of the phenomenon was high. Moreover, because an incomplete observation does not provide any tags indicating incompleteness, we cannot eliminate or impute them. To address this issue, we propose a learning algorithm that explicitly models incomplete observations corrupted with an asymmetric noise that always has a negative value. We show that our algorithm is unbiased as if it were learned from uncorrupted data that does not involve incomplete observations. We demonstrate the advantages of our algorithm through numerical experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2020

A Machine Learning Approach for Flagging Incomplete Bid-rigging Cartels

We propose a new method for flagging bid rigging, which is particularly ...
research
01/05/2007

Missing values : processing with the Kohonen algorithm

The processing of data which contain missing values is a complicated and...
research
07/24/2023

Extending Path-Dependent NJ-ODEs to Noisy Observations and a Dependent Observation Framework

The Path-Dependent Neural Jump ODE (PD-NJ-ODE) is a model for predicting...
research
04/02/2018

Process Control with Highly Left Censored Data

The need to control industrial processes, detecting changes in process p...
research
08/14/2016

Computation of the incomplete gamma function for negative values of the argument

An algorithm for computing the incomplete gamma function γ^*(a,z) for re...
research
08/07/2014

Updating with incomplete observations

Currently, there is renewed interest in the problem, raised by Shafer in...

Please sign up or login with your details

Forgot password? Click here to reset