Transporting Comparative Effectiveness Evidence Between Countries: Considerations for Health Technology Assessments.
Journal
PharmacoEconomics
ISSN: 1179-2027
Titre abrégé: Pharmacoeconomics
Pays: New Zealand
ID NLM: 9212404
Informations de publication
Date de publication:
27 Oct 2023
27 Oct 2023
Historique:
accepted:
03
10
2023
medline:
28
10
2023
pubmed:
28
10
2023
entrez:
27
10
2023
Statut:
aheadofprint
Résumé
Internal validity is often the primary concern for health technology assessment agencies when assessing comparative effectiveness evidence. However, the increasing use of real-world data from countries other than a health technology assessment agency's target population in effectiveness research has increased concerns over the external validity, or "transportability", of this evidence, and has led to a preference for local data. Methods have been developed to enable a lack of transportability to be addressed, for example by accounting for cross-country differences in disease characteristics, but their consideration in health technology assessments is limited. This may be because of limited knowledge of the methods and/or uncertainties in how best to utilise them within existing health technology assessment frameworks. This article aims to provide an introduction to transportability, including a summary of its assumptions and the methods available for identifying and adjusting for a lack of transportability, before discussing important considerations relating to their use in health technology assessment settings, including guidance on the identification of effect modifiers, guidance on the choice of target population, estimand, study sample and methods, and how evaluations of transportability can be integrated into health technology assessment submission and decision processes.
Identifiants
pubmed: 37891433
doi: 10.1007/s40273-023-01323-1
pii: 10.1007/s40273-023-01323-1
doi:
Types de publication
Journal Article
Langues
eng
Subventions
Organisme : Yorkshire Cancer Research
ID : S406NL
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/T025166/1/
Pays : United Kingdom
Informations de copyright
© 2023. The Author(s).
Références
National Institute for Health and Care Excellence. NICE real-world evidence framework. National Institute for Health and Care Excellence; 2022. London.
Institute for Quality and Efficiency in Health Care. General methods. Version 6.0. Institute for Quality and Efficiency in Health Care; 2020. Germany.
Makady A, Ham RT, de Boer A, Hillege H, Klungel O, Goettsch W. Policies for use of real-world data in health technology assessment (HTA): a comparative study of six HTA agencies. Value Health. 2017;20(4):520–32.
doi: 10.1016/j.jval.2016.12.003
pubmed: 28407993
Hernán MA, Hernández-Díaz S. Beyond the intention-to-treat in comparative effectiveness research. Clin Trials. 2012;9(1):48–55.
doi: 10.1177/1740774511420743
pubmed: 21948059
Westreich D, Edwards JK, Lesko CR, Stuart E, Cole SR. Transportability of trial results using inverse odds of sampling weights. Am J Epidemiol. 2017;186(8):1010–4.
doi: 10.1093/aje/kwx164
pubmed: 28535275
pmcid: 5860052
Westreich D, Edwards JK, Lesko CR, Cole SR, Stuart EA. Target validity and the hierarchy of study designs. Am J Epidemiol. 2019;188(2):438–43.
doi: 10.1093/aje/kwy228
pubmed: 30299451
Bullement A, Podkonjak T, Robinson MJ, Benson E, Selby R, Hatswell AJ, et al. Real-world evidence use in assessments of cancer drugs by NICE. Int J Technol Assess Health Care. 2020;10:1–7.
Hatswell AJ, Baio G, Berlin JA, Irs A, Freemantle N. Regulatory approval of pharmaceuticals without a randomised controlled study: analysis of EMA and FDA approvals 1999–2014. BMJ Open. 2016;6(6): e011666.
doi: 10.1136/bmjopen-2016-011666
pubmed: 27363818
pmcid: 4932294
Patel D, Grimson F, Mihaylova E, Wagner P, Warren J, van Engen A, et al. Use of external comparators for health technology assessment submissions based on single-arm trials. Value Health. 2021;24(8):1118–25.
doi: 10.1016/j.jval.2021.01.015
pubmed: 34372977
Dahabreh IJ, Hernán MA. Extending inferences from a randomized trial to a target population. Eur J Epidemiol. 2019;34(8):719–22.
doi: 10.1007/s10654-019-00533-2
pubmed: 31218483
Jonsson P, Mpofu P, Kent S, Copeland A, Groves B, Bargo D, et al. PCN170 can early US adoption of cancer drugs inform HTA decision-making? Value Health. 2021;24:S51.
doi: 10.1016/j.jval.2021.04.261
Hogervorst MA, Pontén J, Vreman RA, Mantel-Teeuwisse AK, Goettsch WG. Real world data in health technology assessment of complex health technologies. Front Pharmacol. 2022;13: 837302.
doi: 10.3389/fphar.2022.837302
pubmed: 35222045
pmcid: 8866967
Institute for Quality and Efficiency in Health Care. Concepts for the generation of routine practice data and their analysis for the benefit assessment of drugs according to §35a Social Code Book V (SGB V). Institute for Quality and Efficiency in Health Care; 2020. London.
Degtiar I, Rose S. A review of generalizability and transportability. Ann Rev Stat Appl. 2023;10(1):501–24.
Dahabreh IJ, Robertson SE, Steingrimsson JA, Stuart EA, Hernán MA. Extending inferences from a randomized trial to a new target population. Stat Med. 2020;39(14):1999–2014.
doi: 10.1002/sim.8426
pubmed: 32253789
Josey KP, Berkowitz SA, Ghosh D, Raghavan S. Transporting experimental results with entropy balancing. Stat Med. 2021;40(19):4310–26.
doi: 10.1002/sim.9031
pubmed: 34018204
pmcid: 8487904
Hernán MA, VanderWeele TJ. Compound treatments and transportability of causal inference. Epidemiology. 2011;22(3):368–77.
doi: 10.1097/EDE.0b013e3182109296
pubmed: 21399502
pmcid: 3805254
Dahabreh IJ, Robins JM, Haneuse SJA, Saeed I, Robertson SE, Stuart EA, et al. Sensitivity analysis using bias functions for studies extending inferences from a randomized trial to a target population. Stat Med. 2023;42:2029–43.
doi: 10.1002/sim.9550
pubmed: 36847107
Nguyen TQ, Ackerman B, Schmid I, Cole SR, Stuart EA. Sensitivity analyses for effect modifiers not observed in the target population when generalizing treatment effects from a randomized controlled trial: assumptions, models, effect scales, data scenarios, and implementation details. PLoS One. 2018;13(12): e0208795.
doi: 10.1371/journal.pone.0208795
pubmed: 30533053
pmcid: 6289424
Josey KP, Yang F, Ghosh D, Raghavan S. A calibration approach to transportability and data-fusion with observational data. Stat Med. 2022;41:4511–31.
doi: 10.1002/sim.9523
pubmed: 35848098
pmcid: 10201931
Jaksa A, Arena PJ, Chan KKW, Ben-Joseph RH, Jónsson P, Campbell UB. Transferability of real-world data across borders for regulatory and health technology assessment decision-making. Front Med (Lausanne). 2022;9:1073678.
doi: 10.3389/fmed.2022.1073678
pubmed: 36465931
pmcid: 9709526
Beal B, Altomare I, Ray J, Bargo D, Adamson B. HTA3 passport for travel: proposed framework for transportability of oncology real world evidence. Value Health. 2022;25(7):S504.
doi: 10.1016/j.jval.2022.04.1137
Tennant PWG, Murray EJ, Arnold KF, Berrie L, Fox MP, Gadd SC, et al. Use of directed acyclic graphs (DAGs) to identify confounders in applied health research: review and recommendations. Int J Epidemiol. 2021;50(2):620–32.
doi: 10.1093/ije/dyaa213
pubmed: 33330936
Hernán MA, Robins JM. Using big data to emulate a target trial when a randomized trial is not available. Am J Epidemiol. 2016;183(8):758–64.
doi: 10.1093/aje/kwv254
pubmed: 26994063
pmcid: 4832051
EUnetHTA. Vision paper on the sustainable availability of the proposed Registry Evaluation and Quality Standards Tool (REQueST). 2019. https://www.eunethta.eu/wpcontent/uploads/2019/10/EUnetHTAJA3_Vision_paper-on-REQueST-tool.pdf . Accessed 19 Oct 2023.
National Institute for Health and Care Excellence. NICE real-world evidence framework. Appendix 1: Data Suitability Assessment Tool (DataSAT). National Institute for Health and Care Excellence; 2022.
Tipton E. Improving generalizations from experiments using propensity score subclassification: assumptions, properties, and contexts. J Educ Behav Stat. 2013;38(3):239–66.
doi: 10.3102/1076998612441947
Boulesteix AL, Lauer S, Eugster MJ. A plea for neutral comparison studies in computational sciences. PLoS One. 2013;8(4): e61562.
doi: 10.1371/journal.pone.0061562
pubmed: 23637855
pmcid: 3634809
Heinze G, Boulesteix AL, Kammer M, Morris TP, White IR. Phases of methodological research in biostatistics: building the evidence base for new methods. Biom J. 2023;3: e2200222.
doi: 10.1002/bimj.202200222
Phillippo DM, Ades AE, Dias S, Palmer S, Abrams KR, Welton NJ. Methods for population-adjusted indirect comparisons in health technology appraisal. Med Decis Making. 2018;38(2):200–11.
doi: 10.1177/0272989X17725740
pubmed: 28823204
The Economist Impact. Value of real-world evidence in health technology assessment: lost in translation? 2022. https://impact.economist.com/projects/rwe-in-hta/ . Accessed 19 Oct 2023.
Padula WV, Kreif N, Vanness DJ, Adamson B, Rueda JD, Felizzi F, et al. Machine learning methods in health economics and outcomes research: the PALISADE checklist: a good practices report of an ISPOR Task Force. Value Health. 2022;25(7):1063–80.
doi: 10.1016/j.jval.2022.03.022
pubmed: 35779937
Jackson CH, Thompson SG, Sharples LD. Accounting for uncertainty in health economic decision models by using model averaging. J R Stat Soc Ser A Stat Soc. 2009;172(2):383–404.
doi: 10.1111/j.1467-985X.2008.00573.x
pubmed: 19381329
pmcid: 2667305
Leahy TP, Duffield S, Kent S, Sammon C, Tzelis D, Ray J, et al. Application of quantitative bias analysis for unmeasured confounding in cost-effectiveness modelling. J Comp Eff Res. 2022;11(12):861–70.
doi: 10.2217/cer-2022-0030
pubmed: 35678168
Leahy TP, Kent S, Sammon C, Groenwold RH, Grieve R, Ramagopalan S, et al. Unmeasured confounding in nonrandomized studies: quantitative bias analysis in health technology assessment. J Comp Eff Res. 2022;11(12):851–9.
doi: 10.2217/cer-2022-0029
pubmed: 35678151
Happich M, Brnabic A, Faries D, Abrams K, Winfree KB, Girvan A, et al. Reweighting randomized controlled trial evidence to better reflect real life: a case study of the Innovative Medicines Initiative. Clin Pharmacol Ther. 2020;108(4):817–25.
doi: 10.1002/cpt.1854
pubmed: 32301116
pmcid: 7540324
Ramagopalan SV, Popat S, Gupta A, Boyne DJ, Lockhart A, Hsu G, et al. Transportability of overall survival estimates from US to Canadian patients with advanced non-small cell lung cancer with implications for regulatory and health technology assessment. JAMA Netw Open. 2022;5(11): e2239874.
doi: 10.1001/jamanetworkopen.2022.39874
pubmed: 36326765
pmcid: 9634498
Franklin JM, Patorno E, Desai RJ, Glynn RJ, Martin D, Quinto K, et al. Emulating randomized clinical trials with nonrandomized real-world evidence studies: first results from the RCT DUPLICATE Initiative. Circulation. 2021;143(10):1002–13.
doi: 10.1161/CIRCULATIONAHA.120.051718
pubmed: 33327727