Context-Aware Neural Video Compression on Solar Dynamics Observatory

09/19/2023
by   Atefeh Khoshkhahtinat, et al.
0

NASA's Solar Dynamics Observatory (SDO) mission collects large data volumes of the Sun's daily activity. Data compression is crucial for space missions to reduce data storage and video bandwidth requirements by eliminating redundancies in the data. In this paper, we present a novel neural Transformer-based video compression approach specifically designed for the SDO images. Our primary objective is to efficiently exploit the temporal and spatial redundancies inherent in solar images to obtain a high compression ratio. Our proposed architecture benefits from a novel Transformer block called Fused Local-aware Window (FLaWin), which incorporates window-based self-attention modules and an efficient fused local-aware feed-forward (FLaFF) network. This architectural design allows us to simultaneously capture short-range and long-range information while facilitating the extraction of rich and diverse contextual representations. Moreover, this design choice results in reduced computational complexity. Experimental results demonstrate the significant contribution of the FLaWin Transformer block to the compression performance, outperforming conventional hand-engineered video codecs such as H.264 and H.265 in terms of rate-distortion trade-off.

READ FULL TEXT

page 2

page 3

research
10/12/2022

Attention-Based Generative Neural Image Compression on Solar Dynamics Observatory

NASA's Solar Dynamics Observatory (SDO) mission gathers 1.4 terabytes of...
research
09/19/2023

Multi-spectral Entropy Constrained Neural Compression of Solar Imagery

Missions studying the dynamic behaviour of the Sun are defined to captur...
research
08/10/2022

Ghost-free High Dynamic Range Imaging with Context-aware Transformer

High dynamic range (HDR) deghosting algorithms aim to generate ghost-fre...
research
12/31/2021

CSformer: Bridging Convolution and Transformer for Compressive Sensing

Convolution neural networks (CNNs) have succeeded in compressive image s...
research
05/29/2023

Solar Irradiance Anticipative Transformer

This paper proposes an anticipative transformer-based model for short-te...
research
09/08/2023

CNN Injected Transformer for Image Exposure Correction

Capturing images with incorrect exposure settings fails to deliver a sat...

Please sign up or login with your details

Forgot password? Click here to reset