The dually flat structure for singular models

11/23/2020
by   Naomichi Nakajima, et al.
0

The dually flat structure introduced by Amari-Nagaoka is highlighted in information geometry and related fields. In practical applications, however, the underlying pseudo-Riemannian metric may often be degenerate, and such an excellent geometric structure is rarely defined on the entire space. To fix this trouble, in the present paper, we propose a novel generalization of the dually flat structure for a certain class of singular models from the viewpoint of Lagrange and Legendre singularity theory - we introduce a quasi-Hessian manifold endowed with a possibly degenerate metric and a particular symmetric cubic tensor, which exceeds the concept of statistical manifolds and is adapted to the theory of (weak) contrast functions. In particular, we establish Amari-Nagaoka's extended Pythagorean theorem and projection theorem in this general setup, and consequently, most of applications of these theorems are suitably justified even for such singular cases. This work is motivated by various interests with different backgrounds from Frobenius structure in mathematical physics to Deep Learning in data science.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/17/2021

A singular Riemannian geometry approach to Deep Neural Networks I. Theoretical foundations

Deep Neural Networks are widely used for solving complex problems in sev...
research
05/15/2023

Torification of Delzant polytope as dually flat space and its applications

In this paper we study dually flat spaces arising from Delzant polytopes...
research
02/18/2020

Foundations of Structural Statistics: Statistical Manifolds

Upon a consistent topological statistical theory the application of stru...
research
11/26/2022

Information Geometry of Dynamics on Graphs and Hypergraphs

We introduce a new information-geometric structure of dynamics on discre...
research
10/22/2020

Deep Learning is Singular, and That's Good

In singular models, the optimal set of parameters forms an analytic set ...
research
02/12/2021

A more accurate view of the Flat Wall Theorem

We introduce a supporting combinatorial framework for the Flat Wall Theo...
research
06/29/2020

Number Theory meets Wireless Communications: an introduction for dummies like us

In this chapter we introduce the theory of Diophantine approximation via...

Please sign up or login with your details

Forgot password? Click here to reset