Improved estimation of overall survival and progression-free survival for state transition modeling
Publication: Journal of Comparative Effectiveness Research
Abstract
Aim: National Institute for Health and Care Excellence guidance (Technical Support Document 19) highlights a key challenge of state transition models (STMs) being their difficulty in achieving a satisfactory fit to the observed within-trial endpoints. Fitting poorly to data over the trial period can then have implications for long-term extrapolations. A novel estimation approach is defined in which the predicted overall survival (OS) and progression-free survival (PFS) extrapolations from an STM are optimized to provide closer estimates of the within-trial endpoints. Materials & methods: An STM was fitted to the SQUIRE trial data in non-small-cell lung cancer (obtained from Project Data Sphere). Two methods were used: a standard approach whereby the maximum likelihood was utilized for the individual transitions and the best-fitting parametric model selected based on AIC/BIC, and a novel approach in which parameters were optimized by minimizing the area between the STM-predicted OS and PFS curves and the corresponding OS and PFS Kaplan–Meier curves. Sensitivity analyses were conducted to assess uncertainty. Results: The novel approach resulted in closer estimations to the OS and PFS Kaplan–Meier for all combinations of parametric distributions analyzed compared with the standard approach. Though the uncertainty associated with the novel approach was slightly larger, it provided better estimates to the restricted mean survival time in 10 of the 12 parametric distributions analyzed. Conclusion: A novel approach is defined which provides an alternative STM estimation method enabling improved fits to modeled endpoints, which can easily be extended to more complex model structures.
Tweetable abstract
A key challenge of state transition models is their difficulty in achieving a satisfactory fit to the observed within-trial endpoints, with implications for long-term extrapolations and medical decision making. In this new Methodology article, the authors explore a novel method that helps address some of these challenges.
Plain language summary
A key challenge of state transition models is their difficulty in achieving a satisfactory fit to the observed within-trial endpoints (such as overall survival [OS] and progression-free survival [PFS]). This can have implications for long-term extrapolations and, therefore, for medical decision making as well. A novel approach is defined which provides an alternative estimation method that enables improved fits to modeled endpoints. This approach resulted in closer estimations to the OS and PFS Kaplan–Meier curves for all combinations of parametric distributions analyzed compared with the standard approach. This addresses some of the challenges that are discussed when modeling state transition models, and can easily be extended to more complex model structures.
Formats available
You can view the full content in the following formats:
Supplementary Material
References
Papers of special note have been highlighted as: • of interest; •• of considerable interest
1.
Rutherford MJ, Lambert PC, Sweeting MJ et al. NICE DSU Technical Support Document 21: Flexible Methods for Survival Analysis (2020). https://nicedsu.sites.sheffield.ac.uk/tsds/completed-or-in-progress.
2.
Woods BS, Sideris E, Palmer S, Latimer N, Soares M. Partitioned survival and state transition models for healthcare decision making in oncology: where are we now? Value Health 23(12), 1613–1621 (2020).
3.
Latimer NR. Survival analysis for economic evaluations alongside clinical trials–extrapolation with patient-level data: inconsistencies, limitations, and a practical guide. Med. Decis. Making 33(6), 743–754 (2013).
• Highlights the importance of long-term extrapolation of clinical trial data for use in healthcare decision making, and the need for a systematic approach to reduce the possibility of bias in cost-effectiveness results.
4.
Woods BS, Sideris E, Palmer S, Latimer N, Soares M. NICE DSU Technical Support Document 19: Partitioned Survival Analysis For Decision modeling In Health Care: A Critical Review (2017). https://nicedsu.sites.sheffield.ac.uk/tsds/completed-or-in-progress
•• Highlights the key challenge of state transition models with regards to their inability to achieve a satisfactory fit to the observed within-trial overall survival, and the need for an alternative approach to help solve this problem.
5.
Billingham LJ, Abrams KR, Jones DR. Methods for the analysis of quality-of-life and survival data in health technology assessment. Health Tech. Assess. 3(10), 1–152 (1999).
6.
García-Albéniz X, Maurel J, Hernán MA. Why post-progression survival and post-relapse survival are not appropriate measures of efficacy in cancer randomized clinical trials. Int. J. Cancer 136(10), 2444–2447 (2015).
• Highlights the issues of selection bias in relation to modeling of post-progression survival, which impacts the modeling of overall survival endpoints in state transition models.
7.
National Institute for Health and Care Excellence (NICE). Trastuzumab emtansine for adjuvant treatment of HER2-positive early breast cancer [TA632] (2020). www.nice.org.uk/guidance/ta632/evidence
• Provides a good visualisation of the issue; i.e., difficulty in achieving a satisfactory fit to within-trial endpoints when using a state transition model.
8.
National Institute for Health and Care Excellence (NICE). Enzalutamide for hormone-relapsed non-metastatic prostate cancer [TA580] (2019). www.nice.org.uk/guidance/ta580/evidence
• Compares use cases of multi-state models and partitioned survival models, and the differences in assumptions required.
9.
Williams C, Lewsey JD, Mackay DF, Briggs AH. Estimation of survival probabilities for use in cost-effectiveness analyses: a comparison of a multi-state modeling survival analysis approach with partitioned survival and Markov decision-analytic modeling. Med. Decis. Making 37(4), 427–439 (2017).
10.
Thatcher N, Hirsch FR, Luft AV et al. Necitumumab plus gemcitabine and cisplatin versus gemcitabine and cisplatin alone as first-line therapy in patients with stage IV squamous non-small-cell lung cancer (SQUIRE): an open-label, randomised, controlled phase 3 trial. Lancet Oncol. 16(7), 763–774 (2015).
11.
Green AK, Reeder‐Hayes KE, Corty RW et al. The Project Data Sphere Initiative: accelerating cancer research by sharing data. Oncologist 20(5), 464–e20 (2015). https://data.projectdatasphere.org/projectdatasphere/html/home
•• Provides a framework for the modeling of a multi-state model, and is compared in the paper as a standard approach to compare against.
12.
Williams C, Lewsey JD, Briggs AH, Mackay DF. Cost-effectiveness analysis in R using a multi-state modeling survival analysis framework: a tutorial. Med. Decis. Making 37(4), 340–352 (2017).
13.
Xia F, George SL, Wang X. A multi-state model for designing clinical trials for testing overall survival allowing for crossover after progression. Stat. Biopharm. Res. 8(1), 12–21 (2016).
14.
Fleischer F, Gaschler-Markefski B, Bluhmki E. A statistical model for the dependence between progression-free survival and overall survival. Stat. Med. 28(21), 2669–2686 (2009).
15.
National Institute for Health and Care Excellence (NICE). Durvalumab for maintenance treatment of unresectable non-small-cell lung cancer after platinum-based chemoradiation [TA578] (2019). www.nice.org.uk/guidance/ta578/evidence .
16.
National Institute for Health and Care Excellence (NICE). Blinatumomab for treating acute lymphoblastic leukaemia in remission with minimal residual disease activity [TA589] (2019). www.nice.org.uk/guidance/ta589/evidence
17.
Kaplan EL, Meier P. Nonparametric estimation from incomplete observations. J. Am. Stat. Assoc. 53(282), 457 (1958).
18.
Thom H. Deterministic and probabilistic analysis of a simple Markov model: how different could they be? App. Health Econ. Health Pol. 20(3), 447–449 (2022).
Information & Authors
Information
Published In
Copyright
© 2023 Cytel. This work is licensed under the Attribution-NonCommercial-NoDerivatives 4.0 Unported License
History
Received: 1 March 2023
Accepted: 23 November 2023
Published online: 15 December 2023
Keywords:
Topics
Authors
Metrics & Citations
Metrics
Article Usage
Article usage data only available from February 2023. Historical article usage data, showing the number of article downloads, is available upon request.
Citations
How to Cite
Improved estimation of overall survival and progression-free survival for state transition modeling. (2023) Journal of Comparative Effectiveness Research. DOI: 10.57264/cer-2023-0031
Export citation
Select the citation format you wish to export for this article or chapter.
