The Future will be Different than Today: Model Evaluation Considerations when Developing Translational Clinical Biomarker

07/13/2021
by   Yichen Lu, et al.
0

Finding translational biomarkers stands center stage of the future of personalized medicine in healthcare. We observed notable challenges in identifying robust biomarkers as some with great performance in one scenario often fail to perform well in new trials (e.g. different population, indications). With rapid development in the clinical trial world (e.g. assay, disease definition), new trials very likely differ from legacy ones in many perspectives and in development of biomarkers this heterogeneity should be considered. In response, we recommend considering building in the heterogeneity when evaluating biomarkers. In this paper, we present one evaluation strategy by using leave-one-study-out (LOSO) in place of conventional cross-validation (cv) methods to account for the potential heterogeneity across trials used for building and testing the biomarkers. To demonstrate the performance of K-fold vs LOSO cv in estimating the effect size of biomarkers, we leveraged data from clinical trials and simulation studies. In our assessment, LOSO cv provided a more objective estimate of the future performance. This conclusion remained true across different evaluation metrics and different statistical methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2021

Model-based Pre-clinical Trials for Medical Devices Using Statistical Model Checking

Clinical trials are considered as the golden standard for medical device...
research
02/22/2023

Patient stratification in multi-arm trials: a two-stage procedure with Bayesian profile regression

Precision medicine is an emerging field that takes into account individu...
research
11/20/2017

Treatment Effect Quantification for Time-to-event Endpoints -- Estimands, Analysis Strategies, and beyond

A draft addendum to ICH E9 has been released for public consultation in ...
research
07/07/2020

Statistical design considerations for trials that study multiple indications

Breakthroughs in cancer biology have defined new research programs empha...
research
02/04/2021

Improving the assessment of the probability of success in late stage drug development

There are several steps to confirming the safety and efficacy of a new m...
research
02/21/2019

Towards More Flexible False Positive Control in Phase III Randomized Clinical Trials

Phase III randomized clinical trials play a monumentally critical role i...
research
09/10/2022

Pay Attention to Hard Trials

Performance of speaker recognition systems is evaluated on test trials. ...

Please sign up or login with your details

Forgot password? Click here to reset