Dynamic Time Warping as a New Evaluation for Dst Forecast with Machine Learning

06/08/2020
by   Brecht Laperre, et al.
0

Models based on neural networks and machine learning are seeing a rise in popularity in space physics. In particular, the forecasting of geomagnetic indices with neural network models is becoming a popular field of study. These models are evaluated with metrics such as the root-mean-square error (RMSE) and Pearson correlation coefficient. However, these classical metrics sometimes fail to capture crucial behavior. To show where the classical metrics are lacking, we trained a neural network, using a long short-term memory network, to make a forecast of the disturbance storm time index at origin time t with a forecasting horizon of 1 up to 6 hours, trained on OMNIWeb data. Inspection of the model's results with the correlation coefficient and RMSE indicated a performance comparable to the latest publications. However, visual inspection showed that the predictions made by the neural network were behaving similarly to the persistence model. In this work, a new method is proposed to measure whether two time series are shifted in time with respect to each other, such as the persistence model output versus the observation. The new measure, based on Dynamical Time Warping, is capable of identifying results made by the persistence model and shows promising results in confirming the visual observations of the neural network's output. Finally, different methodologies for training the neural network are explored in order to remove the persistence behavior from the results.

READ FULL TEXT
research
12/16/2021

Simultaneous Multivariate Forecast of Space Weather Indices using Deep Neural Network Ensembles

Solar radio flux along with geomagnetic indices are important indicators...
research
11/17/2019

Comparison of Deep learning models on time series forecasting : a case study of Dissolved Oxygen Prediction

Deep learning has achieved impressive prediction performance in the fiel...
research
01/16/2020

Stream-Flow Forecasting of Small Rivers Based on LSTM

Stream-flow forecasting for small rivers has always been of great import...
research
09/04/2019

Multifractal Description of Streamflow and Suspended Sediment Concentration Data from Indian River Basins

This study investigates the multifractality of streamflow data of 192 st...
research
03/24/2019

A mixture of experts model for predicting persistent weather patterns

Weather and atmospheric patterns are often persistent. The simplest weat...
research
09/24/2020

Cloud Cover Nowcasting with Deep Learning

Nowcasting is a field of meteorology which aims at forecasting weather o...
research
06/02/2023

Comparing a composite model versus chained models to locate a nearest visual object

Extracting information from geographic images and text is crucial for au...

Please sign up or login with your details

Forgot password? Click here to reset