Information-Theoretic Methods for Identifying Relationships among Climate Variables

12/19/2014
by   Kevin H. Knuth, et al.
0

Information-theoretic quantities, such as entropy, are used to quantify the amount of information a given variable provides. Entropies can be used together to compute the mutual information, which quantifies the amount of information two variables share. However, accurately estimating these quantities from data is extremely challenging. We have developed a set of computational techniques that allow one to accurately compute marginal and joint entropies. These algorithms are probabilistic in nature and thus provide information on the uncertainty in our estimates, which enable us to establish statistical significance of our findings. We demonstrate these methods by identifying relations between cloud data from the International Satellite Cloud Climatology Project (ISCCP) and data from other sources, such as equatorial pacific sea surface temperatures (SST).

READ FULL TEXT
research
06/30/2019

Estimating Information-Theoretic Quantities with Random Forests

Information-theoretic quantities, such as mutual information and conditi...
research
06/22/2021

A Practical Unified Notation for Information-Theoretic Quantities in ML

Information theory is of importance to machine learning, but the notatio...
research
02/03/2005

Estimating mutual information and multi--information in large networks

We address the practical problems of estimating the information relation...
research
02/24/2022

Estimators of Entropy and Information via Inference in Probabilistic Models

Estimating information-theoretic quantities such as entropy and mutual i...
research
03/05/2022

Quantifying the Predictability of ENSO Complexity Using a Statistically Accurate Multiscale Stochastic Model and Information Theory

An information-theoretic framework is developed to assess the predictabi...
research
10/13/2020

Gaussianizing the Earth: Multidimensional Information Measures for Earth Data Analysis

Information theory is an excellent framework for analyzing Earth system ...
research
03/21/2022

Information-theoretic analyses of neural data to minimize the effect of researchers' assumptions in predictive coding studies

Studies investigating neural information processing often implicitly ask...

Please sign up or login with your details

Forgot password? Click here to reset