Auxiliary Network: Scalable and agile online learning for dynamic system with inconsistently available inputs

08/26/2020
by   Rohit Agarwal, et al.
7

Streaming classification methods assume the number of input features is fixed and always received. But in many real-world scenarios demand is some input features are reliable while others are unreliable or inconsistent. In this paper, we propose a novel deep learning-based model called Auxiliary Network (Aux-Net), which is scalable and agile. It employs a weighted ensemble of classifiers to give a final outcome. The Aux-Net model is based on the hedging algorithm and online gradient descent. It employs a model of varying depth in an online setting using single pass learning. Aux-Net is a foundational work towards scalable neural network model for a dynamic complex environment requiring ad hoc or inconsistent input data. The efficacy of Aux-Net is shown on public dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/09/2023

Aux-Drop: Handling Haphazard Inputs in Online Learning Using Auxiliary Dropouts

Many real-world applications based on online learning produce streaming ...
research
09/02/2021

End-to-End Demand Response Model Identification and Baseline Estimation with Deep Learning

This paper proposes a novel end-to-end deep learning framework that simu...
research
01/22/2019

Driver Distraction Identification with an Ensemble of Convolutional Neural Networks

The World Health Organization (WHO) reported 1.25 million deaths yearly ...
research
05/22/2019

Convergence Analyses of Online ADAM Algorithm in Convex Setting and Two-Layer ReLU Neural Network

Nowadays, online learning is an appealing learning paradigm, which is of...
research
04/20/2020

Self-Supervised Feature Extraction for 3D Axon Segmentation

Existing learning-based methods to automatically trace axons in 3D brain...
research
06/25/2020

Deep Residual 3D U-Net for Joint Segmentation and Texture Classification of Nodules in Lung

In this work we present a method for lung nodules segmentation, their te...
research
06/13/2016

A Probabilistic-Based Model for Binary CSP

This work introduces a probabilistic-based model for binary CSP that pro...

Please sign up or login with your details

Forgot password? Click here to reset