Data-driven Cloud Clustering via a Rotationally Invariant Autoencoder

03/08/2021
by   Takuya Kurihana, et al.
12

Advanced satellite-born remote sensing instruments produce high-resolution multi-spectral data for much of the globe at a daily cadence. These datasets open up the possibility of improved understanding of cloud dynamics and feedback, which remain the biggest source of uncertainty in global climate model projections. As a step towards answering these questions, we describe an automated rotation-invariant cloud clustering (RICC) method that leverages deep learning autoencoder technology to organize cloud imagery within large datasets in an unsupervised fashion, free from assumptions about predefined classes. We describe both the design and implementation of this method and its evaluation, which uses a sequence of testing protocols to determine whether the resulting clusters: (1) are physically reasonable, (i.e., embody scientifically relevant distinctions); (2) capture information on spatial distributions, such as textures; (3) are cohesive and separable in latent space; and (4) are rotationally invariant, (i.e., insensitive to the orientation of an image). Results obtained when these evaluation protocols are applied to RICC outputs suggest that the resultant novel cloud clusters capture meaningful aspects of cloud physics, are appropriately spatially coherent, and are invariant to orientations of input images. Our results support the possibility of using an unsupervised data-driven approach for automated clustering and pattern discovery in cloud imagery.

READ FULL TEXT

page 5

page 10

page 12

page 13

page 14

page 15

page 19

page 20

09/29/2022

AICCA: AI-driven Cloud Classification Atlas

Clouds play an important role in the Earth's energy budget and their beh...
11/05/2019

Cumulo: A Dataset for Learning Cloud Classes

One of the greatest sources of uncertainty in future climate projections...
09/30/2022

Cloud Classification with Unsupervised Deep Learning

We present a framework for cloud characterization that leverages modern ...
10/03/2020

Generating the Cloud Motion Winds Field from Satellite Cloud Imagery Using Deep Learning Approach

Cloud motion winds (CMW) are routinely derived by tracking features in s...
12/01/2021

Analyzing High-Resolution Clouds and Convection using Multi-Channel VAEs

Understanding the details of small-scale convection and storm formation ...
09/23/2016

A Rotation Invariant Latent Factor Model for Moveme Discovery from Static Poses

We tackle the problem of learning a rotation invariant latent factor mod...