Neural Network Entropy (NNetEn): EEG Signals and Chaotic Time Series Separation by Entropy Features, Python Package for NNetEn Calculation

03/31/2023
by   Andrei Velichko, et al.
0

Entropy measures are effective features for time series classification problems. Traditional entropy measures, such as Shannon entropy, use probability distribution function. However, for the effective separation of time series, new entropy estimation methods are required to characterize the chaotic dynamic of the system. Our concept of Neural Network Entropy (NNetEn) is based on the classification of special datasets (MNIST-10 and SARS-CoV-2-RBV1) in relation to the entropy of the time series recorded in the reservoir of the LogNNet neural network. NNetEn estimates the chaotic dynamics of time series in an original way. Based on the NNetEn algorithm, we propose two new classification metrics: R2 Efficiency and Pearson Efficiency. The efficiency of NNetEn is verified on separation of two chaotic time series of sine mapping using dispersion analysis (ANOVA). For two close dynamic time series (r = 1.1918 and r = 1.2243), the F-ratio has reached the value of 124 and reflects high efficiency of the introduced method in classification problems. The EEG signal classification for healthy persons and patients with Alzheimer disease illustrates the practical application of the NNetEn features. Our computations demonstrate the synergistic effect of increasing classification accuracy when applying traditional entropy measures and the NNetEn concept conjointly. An implementation of the algorithms in Python is presented.

READ FULL TEXT

page 14

page 15

page 20

page 21

research
07/18/2021

A method for estimating the entropy of time series using artificial neural network

Measuring the predictability and complexity of time series is an essenti...
research
09/18/2018

Range entropy: A bridge between signal complexity and self-similarity

Sample entropy (SampEn) has been accepted as an alternate, and sometimes...
research
06/30/2018

Methods of nonlinear dynamics and the construction of cryptocurrency crisis phenomena precursors

This article demonstrates the possibility of constructing indicators of ...
research
02/25/2022

Novel techniques for improvement the NNetEn entropy calculation for short and noisy time series

Entropy is a fundamental concept of information theory. It is widely use...
research
03/31/2023

Never a Dull Moment: Distributional Properties as a Baseline for Time-Series Classification

The variety of complex algorithmic approaches for tackling time-series c...
research
04/17/2013

Unsupervised model-free representation learning

Numerous control and learning problems face the situation where sequence...
research
05/30/2021

An improved LogNNet classifier for IoT application

The internet of things devices suffer of low memory while good accuracy ...

Please sign up or login with your details

Forgot password? Click here to reset