How well can we learn large factor models without assuming strong factors?

10/23/2019
by   Yinchu Zhu, et al.
0

In this paper, we consider the problem of learning models with a latent factor structure. The focus is to find what is possible and what is impossible if the usual strong factor condition is not imposed. We study the minimax rate and adaptivity issues in two problems: pure factor models and panel regression with interactive fixed effects. For pure factor models, if the number of factors is known, we develop adaptive estimation and inference procedures that attain the minimax rate. However, when the number of factors is not specified a priori, we show that there is a tradeoff between validity and efficiency: any confidence interval that has uniform validity for arbitrary factor strength has to be conservative; in particular its width is bounded away from zero even when the factors are strong. Conversely, any data-driven confidence interval that does not require as an input the exact number of factors (including weak ones) and has shrinking width under strong factors does not have uniform coverage and the worst-case coverage probability is at most 1/2. For panel regressions with interactive fixed effects, the tradeoff is much better. We find that the minimax rate for learning the regression coefficient does not depend on the factor strength and propose a simple estimator that achieves this rate.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

07/25/2021

Adaptive Estimation and Uniform Confidence Bands for Nonparametric IV

We introduce computationally simple, data-driven procedures for estimati...
06/11/2020

On Worst-case Regret of Linear Thompson Sampling

In this paper, we consider the worst-case regret of Linear Thompson Samp...
04/06/2018

High-dimensional Adaptive Minimax Sparse Estimation with Interactions

High-dimensional linear regression with interaction effects is broadly a...
08/04/2019

Learning Latent Factors from Diversified Projections and its Applications to Over-Estimated and Weak Factors

Estimations and applications of factor models often rely on the crucial ...
10/22/2019

Minimax Rate Optimal Adaptive Nearest Neighbor Classification and Regression

k Nearest Neighbor (kNN) method is a simple and popular statistical meth...
07/06/2017

Project Makespan Estimation: Computational Load of Interval and Point Estimates

The estimation of project completion time is to be repeated several time...
07/17/2017

An optimal unrestricted learning procedure

We study learning problems in the general setup, for arbitrary classes o...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.