Explaining Full-disk Deep Learning Model for Solar Flare Prediction using Attribution Methods

07/29/2023
by   Chetraj Pandey, et al.
0

This paper contributes to the growing body of research on deep learning methods for solar flare prediction, primarily focusing on highly overlooked near-limb flares and utilizing the attribution methods to provide a post hoc qualitative explanation of the model's predictions. We present a solar flare prediction model, which is trained using hourly full-disk line-of-sight magnetogram images and employs a binary prediction mode to forecast ≥M-class flares that may occur within the following 24-hour period. To address the class imbalance, we employ a fusion of data augmentation and class weighting techniques; and evaluate the overall performance of our model using the true skill statistic (TSS) and Heidke skill score (HSS). Moreover, we applied three attribution methods, namely Guided Gradient-weighted Class Activation Mapping, Integrated Gradients, and Deep Shapley Additive Explanations, to interpret and cross-validate our model's predictions with the explanations. Our analysis revealed that full-disk prediction of solar flares aligns with characteristics related to active regions (ARs). In particular, the key findings of this study are: (1) our deep learning models achieved an average TSS=0.51 and HSS=0.35, and the results further demonstrate a competent capability to predict near-limb solar flares and (2) the qualitative analysis of the model explanation indicates that our model identifies and uses features associated with ARs in central and near-limb locations from full-disk magnetograms to make corresponding predictions. In other words, our models learn the shape and texture-based characteristics of flaring ARs even at near-limb areas, which is a novel and critical capability with significant implications for operational forecasting.

READ FULL TEXT

page 10

page 11

page 12

page 13

research
08/30/2023

Exploring Deep Learning for Full-disk Solar Flare Prediction with Empirical Insights from Guided Grad-CAM Explanations

This study progresses solar flare prediction research by presenting a fu...
research
08/04/2023

Explainable Deep Learning-based Solar Flare Prediction with post hoc Attention for Operational Forecasting

This paper presents a post hoc analysis of a deep learning-based full-di...
research
04/07/2022

Predicting Solar Flares Using CNN and LSTM on Two Solar Cycles of Active Region Data

We consider the flare prediction problem that distinguishes flare-immine...
research
03/12/2021

How to Train Your Flare Prediction Model: Revisiting Robust Sampling of Rare Events

We present a case study of solar flare forecasting by means of metadata ...
research
12/27/2019

Interpreting LSTM Prediction on Solar Flare Eruption with Time-series Clustering

We conduct a post hoc analysis of solar flare predictions made by a Long...
research
12/28/2020

Shape-based Feature Engineering for Solar Flare Prediction

Solar flares are caused by magnetic eruptions in active regions (ARs) on...
research
11/10/2020

Debugging Tests for Model Explanations

We investigate whether post-hoc model explanations are effective for dia...

Please sign up or login with your details

Forgot password? Click here to reset