Adaptive Principal Component Regression with Applications to Panel Data

07/03/2023
by   Anish Agarwal, et al.
0

Principal component regression (PCR) is a popular technique for fixed-design error-in-variables regression, a generalization of the linear regression setting in which the observed covariates are corrupted with random noise. We provide the first time-uniform finite sample guarantees for online (regularized) PCR whenever data is collected adaptively. Since the proof techniques for analyzing PCR in the fixed design setting do not readily extend to the online setting, our results rely on adapting tools from modern martingale concentration to the error-in-variables setting. As an application of our bounds, we provide a framework for experiment design in panel data settings when interventions are assigned adaptively. Our framework may be thought of as a generalization of the synthetic control and synthetic interventions frameworks, where data is collected via an adaptive intervention assignment policy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2020

On Principal Component Regression in a High-Dimensional Error-in-Variables Setting

We analyze the classical method of Principal Component Regression (PCR) ...
research
06/04/2019

How many variables should be entered in a principal component regression equation?

We study least squares linear regression over N uncorrelated Gaussian fe...
research
11/25/2022

Strategyproof Decision-Making in Panel Data Settings and Beyond

We propose a framework for decision-making in the presence of strategic ...
research
05/05/2021

Policy Learning with Adaptively Collected Data

Learning optimal policies from historical data enables the gains from pe...
research
06/13/2020

Synthetic Interventions

We develop a method to help quantify the impact different levels of mobi...
research
09/02/2020

Simultaneous inference for Berkson errors-in-variables regression under fixed design

In various applications of regression analysis, in addition to errors in...
research
06/25/2020

Active Online Domain Adaptation

Online machine learning systems need to adapt to domain shifts. Meanwhil...

Please sign up or login with your details

Forgot password? Click here to reset