Implicit Context-aware Learning and Discovery for Streaming Data Analytics

10/18/2019
by   Kin Gwn Lore, et al.
0

The performance of machine learning model can be further improved if contextual cues are provided as input along with base features that are directly related to an inference task. In offline learning, one can inspect historical training data to identify contextual clusters either through feature clustering, or hand-crafting additional features to describe a context. While offline training enjoys the privilege of learning reliable models based on already-defined contextual features, online training for streaming data may be more challenging – the data is streamed through time, and the underlying context during a data generation process may change. Furthermore, the problem is exacerbated when the number of possible context is not known. In this study, we propose an online-learning algorithm involving the use of a neural network-based autoencoder to identify contextual changes during training, then compares the currently-inferred context to a knowledge base of learned contexts as training advances. Results show that classifier-training benefits from the automatically discovered contexts which demonstrates quicker learning convergence during contextual changes compared to current methods.

READ FULL TEXT
research
03/15/2021

TinyOL: TinyML with Online-Learning on Microcontrollers

Tiny machine learning (TinyML) is a fast-growing research area committed...
research
08/11/2021

Deep Pairwise Learning To Rank For Search Autocomplete

Autocomplete (a.k.a "Query Auto-Completion", "AC") suggests full queries...
research
09/13/2021

Contrastive Learning for Context-aware Neural Machine TranslationUsing Coreference Information

Context-aware neural machine translation (NMT) incorporates contextual i...
research
02/22/2021

Individualized Context-Aware Tensor Factorization for Online Games Predictions

Individual behavior and decisions are substantially influenced by their ...
research
03/21/2023

Learning Context-aware Classifier for Semantic Segmentation

Semantic segmentation is still a challenging task for parsing diverse co...
research
07/19/2023

Contextual Reliability: When Different Features Matter in Different Contexts

Deep neural networks often fail catastrophically by relying on spurious ...
research
08/16/2022

Context-Aware Streaming Perception in Dynamic Environments

Efficient vision works maximize accuracy under a latency budget. These w...

Please sign up or login with your details

Forgot password? Click here to reset