R WE ready for reimbursement? A round up of developments in real-world evidence relating to health technology assessment
Publication: Journal of Comparative Effectiveness Research
Abstract
Highlighting the latest developments in both real-world evidence as it relates to health technology assessment and acceptance of real-world evidence by health technology assessment agencies.
Real-world evidence (RWE) has experienced an explosion of interest within the last decade, as a result of the availability of more data sources and a plethora of applications across a product lifecycle [1]. Given the breadth of use cases of RWE, it is no surprise that it is sometimes considered as a valuable tool in the health technology assessment (HTA) process. Barriers to the widespread adoption and acceptance of RWE by HTA agencies do however remain [2]. The focus of this bi-monthly series is therefore to highlight developments in both RWE as it relates to HTA and acceptance of RWE by HTA agencies, and we kick off the series discussing news of interest for each.
RWE initiative relating to HTA: RCT-DUPLICATE
A recent study from the randomized controlled trial (RCT)-DUPLICATE initiative reported the findings from the first ten trial emulations evaluating cardiovascular outcomes of antidiabetic or antiplatelet medications using RWD from three US healthcare claims data sources [3]. Patients were selected according to corresponding RCT inclusion/exclusion criteria, and end points similarly matched in claims data. Analyses were prespecified and a protocol registered before study initiation. Propensity score matching was used to balance a priori defined confounders. In six of the ten studies, ‘regulatory agreement’ was achieved, meaning that the RWE study was able to replicate the direction and significance of the RCT finding and in nine of the ten studies, regulatory or estimate agreement criteria was fulfilled, the latter of which meaning the RWE hazard ratio landed within the 95% CI of the RCT hazard ratio. Taken together this study demonstrates that in certain circumstances RWE may be able to support causal conclusions, providing options when RCTs may not be feasible.
Given the body of evidence presented to regulators typically forms the core of that subsequently presented to HTA bodies and payers, it is vital that those involved in HTA/market access remain aware of these developments and proactively consider any potential impact for HTA. The outcomes from Franklin et al., however, may not translate directly into outcomes that would be important for HTA decisions [3]. For example, the measure of ‘regulatory agreement’ may not translate into a similar concept of ‘HTA agreement’, as HTA bodies are more concerned with the magnitude of effect and implications for cost–effectiveness estimates rather than simply the existence and direction of an effect.
Nonetheless, RCTs conducted in ‘ideal and controlled situations’ and effectiveness estimates from RWE collected in the ‘real-world’ may be interpreted as answering different research questions and; therefore, we would not necessarily expect to obtain the same estimates, even after aligning inclusion/exclusion criteria and adjusting for pre-exposure confounders. While perhaps not the case for regulators, the research question being answered by the real-world study is actually the question of most interest to HTA bodies, albeit in practice the potential for bias limits the extent to which RWE can be used to drive HTA decision making. Therefore initiatives like RCT DUPLICATE provide more information as to when HTAs can rely on RWE for decision making around effectiveness. To this end, Franklin et al. replicated regulatory processes by registering a protocol before analyzing the study outcomes. This is not a strict requirement for analyses conducted for HTA purposes (e.g., indirect treatment comparisons) but could be part of the guidance that HTAs could provide outlining what types of RWE they will consider in their decision making, aligned with recent RWE transparency initiatives [4,5].
HTA acceptance of RWE: G-BA & Zolgensma
Evidence available at the time of reimbursement decision making for rare disease therapeutics may have a higher degree of uncertainty; studies may be considered too short to assess long-term outcomes, lacking in important patient relevant outcomes and/or feature no standard of care comparison. In 2020, the Federal Joint Committee (G-BA) in Germany passed legislation with the remit to mandate the collection of post-launch RWE for advanced therapy medicinal products. The G-BA subsequently commissioned the Institute for Quality and Efficacy in HealthCare (IQWiG) to develop scientific concepts for the generation of routine practice data and their analysis for benefit assessment of drugs in Germany, particularly with regards to quantifying the added benefit of a new drug. IQWiG concluded that high-quality registries are most likely to help inform benefit assessment, while other RWE sources, such as electronic medical records and claims data, were less promising due to concerns over insufficient data quality and completeness [6]. Novartis' gene therapy for spinal muscular atrophy (SMA), Zolgensma, was the first drug to have post-approval RWE mandated by the G-BA in February 2021. In line with the recommendations of the IQWiG report referred to above, Novartis will have to perform a registry based study to include up to 500 children with presymptomatic SMA and SMA type 1 and type 2, and effectiveness compared with Biogen’s Spinraza.
While German authorities have long been viewed as reluctant to use RWE to support decision making regarding reimbursement of new drugs, these recent advancements demonstrate a commitment to utilzing RWE, particularly in situations where there is significant unmet need and obvious barriers to the generation of head-to-head comparative evidence. Their focus on registry studies may; however, appear to some to be overly restrictive, particularly in light of the RCT-DUPLICATE results noted above.
As we look into the future, it will be interesting to see if the approach taken in the case of Zolgensma becomes the new norm in Germany for rare diseases. If so, a few considerations arise. While SMA benefits from the availability of high quality registries, this may not always be the case. In addition, if the disease is of such rarity that there would be insufficient numbers of patients in a single country to provide a robust answer on real world effectiveness, data from other countries may need to be considered. The German authorities should be commended for beginning to map out a pathway for the use of RWE in their assessments to enable patient access to medicines, and we will be following with interest to see how this guidance develops in the future.
Financial & competing interests disclosure
The author SV Ramagopalan has received an honorarium from Future Science Group for the contribution of this work. The authors have no other relevant affiliations or financial involvement with any organization or entity with a financial interest in or financial conflict with the subject matter or materials discussed in the manuscript apart from those disclosed. Both authors are employees of F. Hoffmann-La Roche.
No writing assistance was utilized in the production of this manuscript.
References
1.
Ramagopalan SV, Wasiak R. Life after COVID-19: R WE going to help? J. Comp. Eff. Res. 9(8), 525–526 (2020).
2.
Sammon CJ, Leahy TP, Gsteiger S, Ramagopalan S. Real-world evidence and nonrandomized data in health technology assessment: using existing methods to address unmeasured confounding? J. Comp. Eff. Res. 9(14), 969–972 (2020).
3.
Franklin JM, Patorno E, Desai RJ et al. Emulating Randomized clinical trials with nonrandomized real-world evidence studies: first results from the RCT DUPLICATE Initiative. Circulation 143(10), 1002–1013 (2021).
4.
ISPOR – Real-World Evidence Transparency Initiative (2021). www.ispor.org/strategic-initiatives/real-world-evidence/real-world-evidence-transparency-initiative
5.
Wang SV, Pinheiro S, Hua W et al. STaRT-RWE: structured template for planning and reporting on the implementation of real world evidence studies. BMJ 372, m4856 (2021).
6.
[A19–43] Wissenschaftliche Ausarbeitung von Konzepten zur Generierung versorgungsnaher Daten und deren Auswertung zum Zwecke der Nutzenbewertung von Arzneimitteln nach § 35a SGB V - Rapid Report. Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG) (2021). www.iqwig.de/projekte/a19-43.html
Information & Authors
Information
Published In
Pages: 797 - 799
PubMed: 33955236
Copyright
© 2021 Future Medicine Ltd.
History
Received: 20 April 2021
Accepted: 20 April 2021
Published online: 6 May 2021
Keywords:
Topics
Authors
Metrics & Citations
Metrics
Article Usage
Article usage data only available from February 2023. Historical article usage data, showing the number of article downloads, is available upon request.
Citations
How to Cite
R WE ready for reimbursement? A round up of developments in real-world evidence relating to health technology assessment. (2021) Journal of Comparative Effectiveness Research. DOI: 10.2217/cer-2021-0098
Export citation
Select the citation format you wish to export for this article or chapter.
Citing Literature
- Alexa Vidalis, Oscar Dumoulin, Mrunmayee Godbole, Catia C Proenca, The role and value of real-world evidence in health technology decision-making in France, Germany, Italy, Spain, and the UK: insights on external control arms, International Journal of Technology Assessment in Health Care, 10.1017/S0266462324004720, 41, 1, (2025).
- Alejandra Castanon, Benjamin D Bray, Sreeram V Ramagopalan, R WE ready for reimbursement? A round up of developments in real-world evidence relating to health technology assessment: part 15, Journal of Comparative Effectiveness Research, 10.57264/cer-2024-0033, 13, 5, (2024).
- Ben Bray, Sreeram V Ramagopalan, R WE ready for reimbursement? A round up of developments in real-world evidence relating to health technology assessment: part 12, Journal of Comparative Effectiveness Research, 10.57264/cer-2023-0092, 12, 7, (2023).
- V. G. Borovskaya, A. A. Kurylev, Role of RWD / RWE in health technology assessment, Real-World Data & Evidence, 10.37489/2782-3784-myrwd-26, 3, 1, (01-08), (2023).
- Amy Lewis, Vasiliki Valla, Paraskevi Charitou, Anna Karapatsia, Angeliki Koukoura, Konstantina Tzelepi, Jon I. Bergsteinsson, Myrsini Ouzounelli, Efstathios Vassiliadis, Digital Health Technologies for Medical Devices – Real World Evidence Collection – Challenges and Solutions Towards Clinical Evidence, International Journal of Digital Health, 10.29337/ijdh.49, 2, 1, (8), (2022).
- Laura Dormer, Celebrating 10 years of the Journal of Comparative Effectiveness Research, Journal of Comparative Effectiveness Research, 10.2217/cer-2021-0249, 11, 1, (1-6), (2021).
- Paul Arora, Sreeram V Ramagopalan, R WE ready for reimbursement? A round-up of developments in real-world evidence relating to health technology assessment: part 26, Journal of Comparative Effectiveness Research, 10.57264/cer-2026-0074, 0, 0, (undefined).
