Gaussian random projections of convex cones: approximate kinematic formulae and applications
share
Understanding the stochastic behavior of random projections of geometric sets constitutes a fundamental problem in high dimension probability that finds wide applications in diverse fields. This paper provides a kinematic description for the behavior of Gaussian random projections of closed convex cones, in analogy to that of randomly rotated cones studied in [ALMT14]. Formally, let K be a closed convex cone in ℝ^n, and G∈ℝ^m× n be a Gaussian matrix with i.i.d. 𝒩(0,1) entries. We show that GK≡{Gμ: μ∈ K} behaves like a randomly rotated cone in ℝ^m with statistical dimension min{δ(K),m}, in the following kinematic sense: for any fixed closed convex cone L in ℝ^m, δ(L)+δ(K)≪ m ⇒ L∩ GK = {0} with high probability, δ(L)+δ(K)≫ m ⇒ L∩ GK ≠{0} with high probability. A similar kinematic description is obtained for G^-1L≡{μ∈ℝ^n: Gμ∈ L}. The practical usefulness and broad applicability of the prescribed approximate kinematic formulae are demonstrated in a number of distinct problems arising from statistical learning, mathematical programming and asymptotic geometric analysis. In particular, we prove (i) new phase transitions of the existence of cone constrained maximum likelihood estimators in logistic regression, (ii) new phase transitions of the cost optimum of deterministic conic programs with random constraints, and (iii) a local version of the Gaussian Dvoretzky-Milman theorem that describes almost deterministic, low-dimensional behaviors of subspace sections of randomly projected convex sets.
READ FULL TEXT