Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024.

Humans Systematic Reviews as Topic Delphi Technique Outcome Assessment, Health Care Guidelines as Topic Checklist Research Design / standards Consensus

COSMIN Measurement properties Outcome measurement instrument PRISMA Reporting guideline Systematic reviews

Journal

Health and quality of life outcomes

ISSN: 1477-7525

Titre abrégé: Health Qual Life Outcomes

Pays: England

ID NLM: 101153626

Informations de publication

Date de publication:
09 Jul 2024

Historique:

accepted: 13 06 2024

medline: 9 7 2024

pubmed: 9 7 2024

entrez: 8 7 2024

Statut: epublish

Résumé

Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) initiative, key information is often missing in published reports. This article describes the development of an extension of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline: PRISMA-COSMIN for OMIs 2024. The development process followed the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) guidelines and included a literature search, expert consultations, a Delphi study, a hybrid workgroup meeting, pilot testing, and an end-of-project meeting, with integrated patient/public involvement. From the literature and expert consultation, 49 potentially relevant reporting items were identified. Round 1 of the Delphi study was completed by 103 panelists, whereas round 2 and 3 were completed by 78 panelists. After 3 rounds, agreement (≥ 67%) on inclusion and wording was reached for 44 items. Eleven items without consensus for inclusion and/or wording were discussed at a workgroup meeting attended by 24 participants. Agreement was reached for the inclusion and wording of 10 items, and the deletion of 1 item. Pilot testing with 65 authors of OMI systematic reviews further improved the guideline through minor changes in wording and structure, finalized during the end-of-project meeting. The final checklist to facilitate the reporting of full systematic review reports contains 54 (sub)items addressing the review's title, abstract, plain language summary, open science, introduction, methods, results, and discussion. Thirteen items pertaining to the title and abstract are also included in a separate abstract checklist, guiding authors in reporting for example conference abstracts. PRISMA-COSMIN for OMIs 2024 consists of two checklists (full reports; abstracts), their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram. PRISMA-COSMIN for OMIs 2024 can improve the reporting of systematic reviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs and select the most appropriate OMI for a specific application. NOTE: In order to encourage its wide dissemination this article is freely accessible on the web sites of the journals: Health and Quality of Life Outcomes; Journal of Clinical Epidemiology; Journal of Patient-Reported Outcomes; Quality of Life Research.

Identifiants

DOI: 10.1186/s12955-024-02256-9 PMID: 38978063

pubmed: 38978063

doi: 10.1186/s12955-024-02256-9

pii: 10.1186/s12955-024-02256-9

doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

Pagination

Subventions

Organisme : CIHR

ID : 452145

Pays : Canada

Informations de copyright

Références

Butcher NJ, Monsour A, Mew EJ, Chan A-W, Moher D, Mayo-Wilson E, Terwee CB, Chee-A-Tow A, Baba A, Gavin F. Guidelines for reporting outcomes in trial reports: The CONSORT-outcomes 2022 extension. JAMA. 2022;328(22):2252–64.

pubmed: 36511921

Prinsen CA, Mokkink LB, Bouter LM, Alonso J, Patrick DL, De Vet HC, Terwee CB. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147–57.

pubmed: 29435801 pmcid: 5891568

Porter ME. What is value in health care. N Engl J Med. 2010;363(26):2477–81.

pubmed: 21142528

Nelson, E. C., Eftimovska, E., Lind, C., Hager, A., Wasson, J. H., & Lindblad, S. (2015). Patient reported outcome measures in practice. BMJ. https://doi.org/10.1136/bmj.g7818

OMERACT. The OMERACT handbook for establishing and implementing core outcomes in clinical trials across the spectrum of rheumatologic conditions. OMERACT; 2021.

Stephenson M, Riitano D, Wilson S, Leonardi-Bee J, Mabire C, Cooper K, Monteiro da Cruz D, Moreno-Casbas M, Lapkin S. Chapter 12: Systematic reviews of measurement properties. In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis. JBI; 2020.

Mokkink LB, Terwee CB, Stratford PW, Alonso J, Patrick DL, Riphagen I, Knol DL, Bouter LM, de Vet HC. Evaluation of the methodological quality of systematic reviews of health status measurement instruments. Qual Life Res. 2009;18(3):313–33.

pubmed: 19238586

Terwee CB, Prinsen C, Garotti MR, Suman A, De Vet H, Mokkink LB. The quality of systematic reviews of health-related outcome measurement instruments. Qual Life Res. 2016;25(4):767–79.

pubmed: 26346986

Lorente S, Viladrich C, Vives J, Losilla J-M. Tools to assess the measurement properties of quality of life instruments: a meta-review. Brit Med J Open. 2020;10(8):e036038.

McKenna SP, Heaney A. Setting and maintaining standards for patient-reported outcome measures: can we rely on the COSMIN checklists? J Med Econ. 2021;24(1):502–11.

pubmed: 33759686

Altman DG, Simera I. Using reporting guidelines effectively to ensure good reporting of health research. Guidelines Report Health Res A User’s Manual. 2014;25:32–40.

Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. Plos Med. 2010;7(2):e1000217.

pubmed: 20169112 pmcid: 2821895

Jin Y, Sanger N, Shams I, Luo C, Shahid H, Li G, Bhatt M, Zielinski L, Bantoto B, Wang M. Does the medical literature remain inadequately described despite having reporting guidelines for 21 years?–A systematic review of reviews: an update. J Multidiscipl Healthc. 2018;27:495–510.

Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group*, t. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9.

pubmed: 19622511

Panic N, Leoncini E, de Belvis G, Ricciardi W, Boccia S. Evaluation of the endorsement of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement on the quality of published systematic review and meta-analyses. Plos One. 2013;8(12):e83138.

pubmed: 24386151 pmcid: 3873291

Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Int J Surg. 2021;88.

COSMIN (2023). Guideline for Systematic Reviews of Outcome Measurement Instruments. Retrieved April 2023; Available from: https://www.cosmin.nl/tools/guideline-conducting-systematic-review-outcome-measures/ .

Butcher, N.J., Monsour, A., Mokkink, L.B., Terwee, C.B., Tricco, A.C., Gagnier, J., & Offringa, M. (2021). Needed: guidance for reporting knowledge synthesis studies on measurement properties of outcome measurement instruments in health research.

Elsman EB, Smith M, Hofstetter C, Gavin F, Jobson E, Markham S, Ricketts J, Baba A, Butcher NJ, Offringa M. A blueprint for patient and public involvement in the development of a reporting guideline for systematic reviews of outcome measurement instruments: PRISMA-COSMIN for OMIs. Res Involv Engagem. 2024;10:33. https://doi.org/10.1186/s40900-024-00563-5 .

doi: 10.1186/s40900-024-00563-5 pubmed: 38515153 pmcid: 10956212

Staniszewska S, Brett J, Simera I, Seers K, Mockford C, Goodlad S, Altman D, Moher D, Barber R, Denegri S. GRIPP2 reporting checklists: Tools to improve reporting of patient and public involvement in research. BMJ. 2017;358:j3453. https://doi.org/10.1136/bmj.j3453

doi: 10.1136/bmj.j3453 pubmed: 28768629 pmcid: 5539518

EQUATOR (2023). PRISMA-COSMIN – Recommendations for Reporting Systematic Reviews of Outcome Measurement Instruments. Retrieved 14 September 2023; Available from: https://www.equator-network.org/library/reporting-guidelines-under-development/reporting-guidelines-under-development-for-systematic-reviews/#PRISMACOSMIN .

Elsman, E.B., Baba, A., Butcher, N.J., Offringa, M., Moher, D., Terwee, C.B., Mokkink, L.B., Smith, M., & Tricco, A., PRISMA-COSMIN. 2023, OSF.

Elsman EB, Butcher NJ, Mokkink LB, Terwee CB, Tricco A, Gagnier JJ, Aiyegbusi OL, Barnett C, Smith M, Moher D. Study protocol for developing, piloting and disseminating the PRISMA-COSMIN guideline: A new reporting guideline for systematic reviews of outcome measurement instruments. Syst Rev. 2022;11(1):121.

pubmed: 35698213 pmcid: 9195229

Terwee CB, Prinsen CA, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, Bouter LM, De Vet HC, Mokkink LB. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A delphi study. Qual Life Res. 2018;27(5):1159–70.

pubmed: 29550964 pmcid: 5891557

Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.

pubmed: 17161752

Prinsen, C. A., Vohra, S., Rose, M. R., Boers, M., Tugwell, P., Clarke, M., Williamson, P. R., & Terwee, C. B. (2016). How to select outcome measurement instruments for outcomes included in a “Core Outcome Set”–a practical guideline. Trials,17(1), 1–10.

Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. Trials. 2010;11(1):1–8.

Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: Guidelines for reporting observational studies. Bullet World Health Org. 2007;85:867–72.

Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, Lijmer JG, Moher D, Rennie D, De Vet HC. STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies. Clin Chem. 2015;61(12):1446–52.

pubmed: 26510957

Kottner J, Audigé L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, Roberts C, Shoukri M, Streiner DL. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Int J Nurs Stud. 2011;48(6):661–71.

pubmed: 21514934

Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, Hróbjartsson A, Mann H, Dickersin K, Berlin JA. SPIRIT 2013 statement: Defining standard protocol items for clinical trials. Ann Int Med. 2013;158(3):200–7.

pubmed: 23295957

FDA (2009). Guidance for Industry - Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. U.S. Department of Health and Human Services Food and Drug Administration

Revicki DA, Erickson PA, Sloan JA, Dueck A, Guess H, Santanello NC, Group M.F.P.-R.O.C.M. Interpreting and reporting results based on patient-reported outcomes. Value Health. 2007;10:S116–24.

pubmed: 17995470

Staquet M, Berzon R, Osoba D, Machin D. Guidelines for reporting results of quality of life assessments in clinical trials. Qual Life Res. 1996;5(5):496–502.

pubmed: 8973129

AHRQ. Methods guide for effectiveness and comparative effectiveness reviews. Agency for Healthcare Research and Quality; 2019.

Aromataris E, Munn Z. JBI Manual for evidence synthesis. JBI; 2020.

Brundage M, Blazeby J, Revicki D, Bass B, De Vet H, Duffy H, Efficace F, King M, Lam CL, Moher D. Patient-reported outcomes in randomized clinical trials: development of ISOQOL reporting standards. Qual Life Res. 2013;22(6):1161–75.

pubmed: 22987144

Calvert M, Blazeby J, Altman DG, Revicki DA, Moher D, Brundage MD, CONSORT PRO Group, f.t. Reporting of patient-reported outcomes in randomized trials: The CONSORT PRO extension. JAMA. 2013;309(8):814–22.

pubmed: 23443445

CRD. CRD’s guidance for undertaking reviews in health care. Centre for Reviews and Dissemination; 2009.

Gagnier JJ, Lai J, Mokkink LB, Terwee CB. COSMIN reporting guideline for studies on measurement properties of patient-reported outcome measures. Qual Life Res. 2021;30:1–22.

Higgins J, Lasserson T, Chandles J, Tovey D, Flemyng E, Churchill R. Methodological Expectations of Cochrane Intervention Reviews. Cochrane; 2021.

Lohr KN. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual life Res. 2002;11(3):193–205.

pubmed: 12074258

McInnes MD, Moher D, Thombs BD, McGrath TA, Bossuyt PM, Clifford T, Cohen JF, Deeks JJ, Gatsonis C, Hooft L. Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: The PRISMA-DTA statement. JAMA. 2018;319(4):388–96.

pubmed: 29362800

Mokkink LB, De Vet HC, Prinsen CA, Patrick DL, Alonso J, Bouter LM, Terwee CB. COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1171–9.

pubmed: 29260445

Morton S, Berg A, Levit L, Eden J. Standards for reporting systematic reviews. In: Finding what works in health care standards for systematic reviews. Institute of Medicine; 2011.

NQF. Guidance for measure testing and evaluating scientific acceptability of measure properties. National Quality Forum; 2011.

PCORI (2021). Draft final research report: instructions for awardee. Patient-centered outcomes research institute

Reeve BB, Wyrwich KW, Wu AW, Velikova G, Terwee CB, Snyder CF, Schwartz C, Revicki DA, Moinpour CM, McLeod LD. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013;22(8):1889–905.

pubmed: 23288613

Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: Elaboration and explanation. BMJ. https://doi.org/10.1136/bmj.g7647

Stewart LA, Clarke M, Rovers M, Riley RD, Simmonds M, Stewart G, Tierney JF. Preferred reporting items for a systematic review and meta-analysis of individual participant data: The PRISMA-IPD statement. JAMA. 2015;313(16):1657–65.

pubmed: 25919529

Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, Moher D, Peters MD, Horsley T, Weeks L. PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Ann Intern Med. 2018;169(7):467–73.

pubmed: 30178033

Elsman EB, Mokkink LB, Langendoen-Gort M, Rutters F, Beulens J, Elders PJ, Terwee CB. Systematic review on the measurement properties of diabetes-specific patient-reported outcome measures (PROMs) for measuring physical functioning in people with type 2 diabetes. BMJ Open Diabetes Res Care. 2022;10(3):e002729.

pubmed: 35675952 pmcid: 9185403

Abma IL, Butje BJ, Peter M, van der Wees PJ. Measurement properties of the dutch-flemish patient-reported outcomes measurement information system (PROMIS) physical function item bank and instruments: a systematic review. Health Qual Life Outc. 2021;19(1):1–22.

Mehdipour A, Wiley E, Richardson J, Beauchamp M, Kuspinar A. The performance of digital monitoring devices for oxygen saturation and respiratory rate in COPD: a systematic review. COPD: J Chronic Obstr Pulmon Dis. 2021;18(4):469–75.

Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.

pubmed: 18929686

Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, De Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international delphi study. Qual Life Res. 2010;19(4):539–49.

pubmed: 20169472 pmcid: 2852520

Mokkink LB, Boers M, van der Vleuten C, Bouter LM, Alonso J, Patrick DL, De Vet HC, Terwee CB. COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a delphi study. BMC Med Res Methodol. 2020;20(1):1–13.

Butcher NJ, Monsour A, Mew EJ, Chan A-W, Moher D, Mayo-Wilson E, Terwee CB, Chee-A-Tow A, Baba A, Gavin F. Guidelines for reporting outcomes in trial protocols: the SPIRIT-outcomes 2022 extension. JAMA. 2022;328(23):2345–56.

pubmed: 36512367

COSMIN COSMIN database of systematic reviews. Retrieved 30 Jan 2022; Available from: www.cosmin.nl/tools/database-systematic-reviews/ .

Cochrane (2023). Cochrane Consumer Network: A network for patients and carers within Cochrane. Retrieved April 6 2023; Available from: https://consumers.cochrane.org/healthcare-users-cochrane .

COMET (2023). COMET POPPIE Working Group. Retrieved April 6 2023; Available from: https://www.comet-initiative.org/Patients/POPPIE .

OMERACT (2023). OMERACT Patient Research Partners. Retrieved April 6 2023; Available from: https://omeractprpnetwork.org/ .

SPOR (2023). Strategy for Patient-Oriented Research. Retrieved April 6 2023; Available from: https://sporevidencealliance.ca/ .

Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45.

pubmed: 20494804

Gates M, Gates A, Pieper D, Fernandes RM, Tricco AC, Moher D, Brennan SE, Li T, Pollock M, Lunny C. Reporting guideline for overviews of reviews of healthcare interventions: Development of the PRIOR statement. BMJ. 2022;378:e070849. https://doi.org/10.1136/bmj-2022-070849

doi: 10.1136/bmj-2022-070849 pubmed: 35944924 pmcid: 9361065

PROSPERO, PROSPERO: International prospective register of systematic reviews. 2023, Centre for Reviews and Dissemination.

Beller EM, Glasziou PP, Altman DG, Hopewell S, Bastian H, Chalmers I, Gøtzsche PC, Lasserson T, Tovey D, Group, P.f.A. PRISMA for abstracts: reporting systematic reviews in journal and conference abstracts. PLoS Medicine. 2013;10(4):e1001419.

pubmed: 23585737 pmcid: 3621753

Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE. Explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. 2021;372:n16. https://doi.org/10.1136/bmj.n160

doi: 10.1136/bmj.n160

Higgins Jpt, T., Chandler, J., Cumpston, M., Li, T., Page, M., & Welch, V., Cochrane Handbook for Systematic Reviews of Interventions version 6.3 (updated February 2022). 2022, Cochrane.

Salameh, J.-P., Bossuyt, P. M., McGrath, T. A., Thombs, B. D., Hyde, C. J., Macaskill, P., Deeks, J. J., Leeflang, M., Korevaar, D. A., & Whiting, P. (2020). Preferred reporting items for systematic review and meta-analysis of diagnostic test accuracy studies (PRISMA-DTA): Explanation, elaboration, and checklist. BMJ. https://doi.org/10.1136/bmj.m2632

doi: 10.1136/bmj.m2632 pubmed: 32816740

Walton, M. K., Powers, J. H., III., Hobart, J., Patrick, D., Marquis, P., Vamvakas, S., Isaac, M., Molsen, E., Cano, S., & Burke, L. B. (2015). Clinical outcome assessments: Conceptual foundation—report of the ISPOR clinical outcomes assessment–emerging good practices for outcomes research task force. Value in Health,18(6), 741–752.

pubmed: 26409600 pmcid: 4610138

Schünemann, H., Brożek, J., Guyatt, G., & Oxman, A. (2013). Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach. Updated October, 2013.

Boutron, I., Page, M., Higgins, J., Altman, D., Lundh, A., & Hróbjartsson, A., et al. (2022). Chapter 7: considering bias and conflicts of interest among the included studies. Cochrane Handbook for Systematic Reviews of Interventions version 6.1 (updated September 2020). Cochrane 2020. In J. Higgins (Ed.), Cochrane Handbook for Systematic Reviews of Interventions version 6.3. Cochrane.

Beaton, D. E., Maxwell, L. J., Shea, B. J., Wells, G. A., Boers, M., Grosskleg, S., Bingham, C. O., Conaghan, P. G., D’Agostino, M. A., & De Wit, M. P. (2019). Instrument selection using the OMERACT filter 21: The OMERACT methodology. The Journal of Rheumatology,46(8),1028–1035.

pubmed: 30709952

Lewis, C. C., Mettert, K. D., Stanick, C. F., Halko, H. M., Nolen, E. A., Powell, B. J., & Weiner, B. J. (2021). The psychometric and pragmatic evidence rating scale (PAPERS) for measure development and evaluation. Implementation Research and Practice 2:26334895211037390.

pubmed: 37089994 pmcid: 9981887

Schlussel, M. M., Sharp, M. K., de Beyer, J. A., Kirtley, S., Logullo, P., Dhiman, P., MacCarthy, A., Koroleva, A., Speich, B., & Bullock, G. S. (2023). Reporting guidelines used varying methodology to develop recommendations. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2023.03.018

doi: 10.1016/j.jclinepi.2023.03.018 pubmed: 37898461

Kane, M. (2013). The argument-based approach to validation. School Psychology Review, 42(4),448–457.

Weinfurt, K. P. (2021). Constructing arguments for the interpretation and use of patient-reported outcome measures in research: An application of modern validity theory. Quality of Life Research,30(6),1715–1722.

pubmed: 33630235

AERA. (2014). The Standards for Educational and Psychological Testing. The American Educational Research Association (AERA).

Zumbo, B., & Chan, E. (2014). Validity and validation in social, behavioral, and health sciences (Social Indicators Research Series (Vol. 54). Springer International Publishing.