Evaluating and Characterizing Incremental Learning from Non-Stationary Data

06/18/2018
by   Alejandro Cervantes, et al.
0

Incremental learning from non-stationary data poses special challenges to the field of machine learning. Although new algorithms have been developed for this, assessment of results and comparison of behaviors are still open problems, mainly because evaluation metrics, adapted from more traditional tasks, can be ineffective in this context. Overall, there is a lack of common testing practices. This paper thus presents a testbed for incremental non-stationary learning algorithms, based on specially designed synthetic datasets. Also, test results are reported for some well-known algorithms to show that the proposed methodology is effective at characterizing their strengths and weaknesses. It is expected that this methodology will provide a common basis for evaluating future contributions in the field.

READ FULL TEXT
research
09/18/2018

Non-Stationary Covariance Estimation using the Stochastic Score Approximation for Large Spatial Data

We introduce computational methods that allow for effective estimation o...
research
11/20/2021

Learning Non-Stationary Time-Series with Dynamic Pattern Extractions

The era of information explosion had prompted the accumulation of a trem...
research
04/25/2023

Real-time Safety Assessment of Dynamic Systems in Non-stationary Environments: A Review of Methods and Techniques

Real-time safety assessment (RTSA) of dynamic systems is a critical task...
research
01/28/2023

TIDo: Source-free Task Incremental Learning in Non-stationary Environments

This work presents an incremental learning approach for autonomous agent...
research
10/04/2011

Two Projection Pursuit Algorithms for Machine Learning under Non-Stationarity

This thesis derives, tests and applies two linear projection algorithms ...
research
11/26/2020

Comparative Analysis of Extreme Verification Latency Learning Algorithms

One of the more challenging real-world problems in computational intelli...
research
12/25/2018

Vector Field-based Simulation of Tree-Like Non-Stationary Geostatistical Models

In this work, a new non-stationary multiple point geostatistical algorit...

Please sign up or login with your details

Forgot password? Click here to reset