Personalized Policy Learning using Longitudinal Mobile Health Data

01/09/2020
by   Xinyu Hu, et al.
0

We address the personalized policy learning problem using longitudinal mobile health application usage data. Personalized policy represents a paradigm shift from developing a single policy that may prescribe personalized decisions by tailoring. Specifically, we aim to develop the best policy, one per user, based on estimating random effects under generalized linear mixed model. With many random effects, we consider new estimation method and penalized objective to circumvent high-dimension integrals for marginal likelihood approximation. We establish consistency and optimality of our method with endogenous app usage. We apply our method to develop personalized push ("prompt") schedules in 294 app users, with a goal to maximize the prompt response rate given past app usage and other contextual factors. We found the best push schedule given the same covariates varied among the users, thus calling for personalized policies. Using the estimated personalized policies would have achieved a mean prompt response rate of 23 improvement on the observed rate (11 user engagement at 3 months after download. The proposed method compares favorably to existing estimation methods including using the R function "glmer" in a simulation study.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/23/2020

Rapidly Personalizing Mobile Health Treatment Policies with Limited Data

In mobile health (mHealth), reinforcement learning algorithms that adapt...
research
06/16/2022

User Engagement in Mobile Health Applications

Mobile health apps are revolutionizing the healthcare ecosystem by impro...
research
03/04/2022

Interpretable Off-Policy Learning via Hyperbox Search

Personalized treatment decisions have become an integral part of modern ...
research
01/03/2023

Deep Spectral Q-learning with Application to Mobile Health

Dynamic treatment regimes assign personalized treatments to patients seq...
research
06/24/2020

Design and Evaluation of Personalized Free Trials

Free trial promotions, where users are given a limited time to try the p...
research
02/28/2018

Hybrid User Behavioral Analysis with Deep Neural Network for Notifications/Pop-ups Recommendation

With the emergence of mobile and wearable devices, push notification bec...
research
02/28/2018

DNN-based with Click-sequence-aware Mechanism for Notifications/Pop-ups Recommendation

With the emergence of mobile and wearable devices, push notification bec...

Please sign up or login with your details

Forgot password? Click here to reset