Omics-based tests (OBTs) combine high-dimensional omics features into clinical prediction modelsthat predict diagnosis, prognosis, or treatment effects. Past incidences of premature implementa-tion of OBTs into clinical trials have demonstrated the need for increased rigour in their clinicalevaluation. However, their performance assessment is often limited to classification metrics such assensitivity and specificity, with little regard for formal analysis of clinical decision-making. Decisioncurve analysis (DCA) complements classification metrics by combining classical assessment of pre-dictive performance with the consequences of using a test or model to guide clinical decisions. InDCA, the best clinical decision strategy, such as diagnosing or treating based on an OBT, is the onethat maximizes the concept of net benefit: the net number of true positives (or negatives) providedby a given clinical decision strategy. Before reaching real patients, we must be sufficiently confi-dent that new OBTs actually provide superior clinical decision strategies, as compared to default,standard-of-care strategies. Trained on hundreds to thousands of features, OBTs are particularlyprone to chance results. In this context, the present work develops parametric Bayesian approachesto DCA that allow uncertainty quantification around four fundamental concerns when evaluatingOBT-guided clinical decision strategies: (i) which strategies are clinically useful, (ii) what is thebest available decision strategy, (iii) direct pairwise comparisons between strategies, and (iv) whatis the consequence of the current level of uncertainty. We evaluate the methods using simulationstudies and present a comprehensive case study. We also provide an application to a recently-developed OBT for multi-cancer early detection. Software implementation of the method is freelyavailable in the bayesDCA R package. Ultimately, the Bayesian DCA workflow may help cliniciansand health policymakers make better-informed decisions when choosing and implementing clinicaldecision strategies based on OBTs.
View record