Use of Patient-Reported Outcome Measures and Patient-Reported Experience Measures Within Evaluation Studies of Telemedicine Applications: Systematic Review.

evaluation measurement instrument outcome patient-reported experience patient-reported experience measures patient-reported outcome patient-reported outcome measures questionnaire telehealth telemedicine

Journal

Journal of medical Internet research
ISSN: 1438-8871
Titre abrégé: J Med Internet Res
Pays: Canada
ID NLM: 100959882

Informations de publication

Date de publication:
17 11 2021
Historique:
received: 29 04 2021
accepted: 12 09 2021
revised: 06 08 2021
pubmed: 16 9 2021
medline: 25 11 2021
entrez: 15 9 2021
Statut: epublish

Résumé

With the rise of digital health technologies and telemedicine, the need for evidence-based evaluation is growing. Patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are recommended as an essential part of the evaluation of telemedicine. For the first time, a systematic review has been conducted to investigate the use of PROMs and PREMs in the evaluation studies of telemedicine covering all application types and medical purposes. This study investigates the following research questions: in which scenarios are PROMs and PREMs collected for evaluation purposes, which PROM and PREM outcome domains have been covered and how often, which outcome measurement instruments have been used and how often, does the selection and quantity of PROMs and PREMs differ between study types and application types, and has the use of PROMs and PREMs changed over time. We conducted a systematic literature search of the MEDLINE and Embase databases and included studies published from inception until April 2, 2020. We included studies evaluating telemedicine with patients as the main users; these studies reported PROMs and PREMs within randomized controlled trials, controlled trials, noncontrolled trials, and feasibility trials in English and German. Of the identified 2671 studies, 303 (11.34%) were included; of the 303 studies, 67 (22.1%) were feasibility studies, 70 (23.1%) were noncontrolled trials, 20 (6.6%) were controlled trials, and 146 (48.2%) were randomized controlled trials. Health-related quality of life (n=310; mean 1.02, SD 1.05), emotional function (n=244; mean 0.81, SD 1.18), and adherence (n=103; mean 0.34, SD 0.53) were the most frequently assessed outcome domains. Self-developed PROMs were used in 21.4% (65/303) of the studies, and self-developed PREMs were used in 22.3% (68/303). PROMs (n=884) were assessed more frequently than PREMs (n=234). As the evidence level of the studies increased, the number of PROMs also increased (τ=-0.45), and the number of PREMs decreased (τ=0.35). Since 2000, not only has the number of studies using PROMs and PREMs increased, but the level of evidence and the number of outcome measurement instruments used have also increased, with the number of PREMs permanently remaining at a lower level. There have been increasingly more studies, particularly high-evidence studies, which use PROMs and PREMs to evaluate telemedicine. PROMs have been used more frequently than PREMs. With the increasing maturity stage of telemedicine applications and higher evidence level, the use of PROMs increased in line with the recommendations of evaluation guidelines. Health-related quality of life and emotional function were measured in almost all the studies. Simultaneously, health literacy as a precondition for using the application adequately, alongside proper training and guidance, has rarely been reported. Further efforts should be pursued to standardize PROM and PREM collection in evaluation studies of telemedicine.

Sections du résumé

BACKGROUND
With the rise of digital health technologies and telemedicine, the need for evidence-based evaluation is growing. Patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are recommended as an essential part of the evaluation of telemedicine. For the first time, a systematic review has been conducted to investigate the use of PROMs and PREMs in the evaluation studies of telemedicine covering all application types and medical purposes.
OBJECTIVE
This study investigates the following research questions: in which scenarios are PROMs and PREMs collected for evaluation purposes, which PROM and PREM outcome domains have been covered and how often, which outcome measurement instruments have been used and how often, does the selection and quantity of PROMs and PREMs differ between study types and application types, and has the use of PROMs and PREMs changed over time.
METHODS
We conducted a systematic literature search of the MEDLINE and Embase databases and included studies published from inception until April 2, 2020. We included studies evaluating telemedicine with patients as the main users; these studies reported PROMs and PREMs within randomized controlled trials, controlled trials, noncontrolled trials, and feasibility trials in English and German.
RESULTS
Of the identified 2671 studies, 303 (11.34%) were included; of the 303 studies, 67 (22.1%) were feasibility studies, 70 (23.1%) were noncontrolled trials, 20 (6.6%) were controlled trials, and 146 (48.2%) were randomized controlled trials. Health-related quality of life (n=310; mean 1.02, SD 1.05), emotional function (n=244; mean 0.81, SD 1.18), and adherence (n=103; mean 0.34, SD 0.53) were the most frequently assessed outcome domains. Self-developed PROMs were used in 21.4% (65/303) of the studies, and self-developed PREMs were used in 22.3% (68/303). PROMs (n=884) were assessed more frequently than PREMs (n=234). As the evidence level of the studies increased, the number of PROMs also increased (τ=-0.45), and the number of PREMs decreased (τ=0.35). Since 2000, not only has the number of studies using PROMs and PREMs increased, but the level of evidence and the number of outcome measurement instruments used have also increased, with the number of PREMs permanently remaining at a lower level.
CONCLUSIONS
There have been increasingly more studies, particularly high-evidence studies, which use PROMs and PREMs to evaluate telemedicine. PROMs have been used more frequently than PREMs. With the increasing maturity stage of telemedicine applications and higher evidence level, the use of PROMs increased in line with the recommendations of evaluation guidelines. Health-related quality of life and emotional function were measured in almost all the studies. Simultaneously, health literacy as a precondition for using the application adequately, alongside proper training and guidance, has rarely been reported. Further efforts should be pursued to standardize PROM and PREM collection in evaluation studies of telemedicine.

Identifiants

pubmed: 34523604
pii: v23i11e30042
doi: 10.2196/30042
pmc: PMC8663685
doi:

Types de publication

Journal Article Research Support, Non-U.S. Gov't Review Systematic Review

Langues

eng

Sous-ensembles de citation

IM

Pagination

e30042

Informations de copyright

©Andreas Knapp, Lorenz Harst, Stefan Hager, Jochen Schmitt, Madlen Scheibe. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 17.11.2021.

Références

JMIR Hum Factors. 2021 Jul 12;8(3):e27156
pubmed: 34255664
Int J Technol Assess Health Care. 2012 Jan;28(1):44-51
pubmed: 22617736
J Telemed Telecare. 2020 May;26(4):189-199
pubmed: 30541375
Swiss Med Wkly. 2015 Jan 14;145:w14077
pubmed: 25587892
Eur J Health Econ. 2019 Jun;20(Suppl 1):133-140
pubmed: 31098886
J Med Internet Res. 2020 Jun 5;22(6):e17457
pubmed: 32501271
Med Care. 2005 May;43(5):436-44
pubmed: 15838407
Int J Med Inform. 2019 Aug;128:24-31
pubmed: 31160008
Telemed J E Health. 2018 Aug;24(8):562-576
pubmed: 29265954
Int J Cardiol. 2019 Oct 1;292:277-279
pubmed: 31230937
NPJ Digit Med. 2020 Aug 27;3:110
pubmed: 32904379
Int J Integr Care. 2017 Aug 27;17(2):8
pubmed: 28970749
NPJ Digit Med. 2020 Jul 10;3:94
pubmed: 32685700
J Telemed Telecare. 2017 Oct;23(9):803-813
pubmed: 28758525
Telemed J E Health. 2013 Jan;19(1):48-53
pubmed: 22957502
J Ovarian Res. 2019 Jul 15;12(1):63
pubmed: 31307510
Telemed J E Health. 2009 Nov;15(9):830-9
pubmed: 19919189
Telemed J E Health. 2011 Jul-Aug;17(6):484-94
pubmed: 21718114
J Crohns Colitis. 2016 Sep;10(9):1103-21
pubmed: 26928960
J Health Psychol. 2019 Oct;24(12):1668-1675
pubmed: 28810415
Ther Innov Regul Sci. 2015 Nov;49(6):797-804
pubmed: 30222384
Health Serv Res. 2019 Oct;54(5):1023-1035
pubmed: 31218671
Ther Innov Regul Sci. 2019 Jul;53(4):431-440
pubmed: 30221997
BMJ. 2017 Sep 21;358:j4008
pubmed: 28935701
Z Evid Fortbild Qual Gesundhwes. 2016 Nov;117:9-19
pubmed: 27938734
Patient. 2015 Aug;8(4):301-9
pubmed: 25300613
J Med Internet Res. 2015 Feb 24;17(2):e52
pubmed: 25803266
J Telemed Telecare. 2000;6(5):278-84
pubmed: 11070589
J Allergy Clin Immunol Pract. 2021 Jun;9(6):2336-2341
pubmed: 33548519
Br J Pain. 2020 Aug;14(3):161-170
pubmed: 32922777
Patient Educ Couns. 2017 Jun;100(6):1073-1082
pubmed: 28174067
Appl Clin Inform. 2017 Oct;8(4):1068-1081
pubmed: 29241254
Med Care. 1992 Jun;30(6):473-83
pubmed: 1593914
J Med Internet Res. 2019 Jan 24;21(1):e10875
pubmed: 30679145
Med Care. 2007 May;45(5 Suppl 1):S12-21
pubmed: 17443114
J Med Internet Res. 2020 Mar 18;22(3):e16791
pubmed: 32186516
Int J Telerehabil. 2016 Jul 01;8(1):3-10
pubmed: 27563386
Hepatobiliary Surg Nutr. 2019 Jun;8(3):228-245
pubmed: 31245403
Patient Relat Outcome Meas. 2018 Nov 01;9:353-367
pubmed: 30464666
J Arthroplasty. 2018 Nov;33(11):3416-3421
pubmed: 30057269
J Clin Epidemiol. 2018 Apr;96:84-92
pubmed: 29288712
J Telemed Telecare. 2017 May;23(4):460-469
pubmed: 27224997
Health Policy. 1990 Dec;16(3):199-208
pubmed: 10109801
Int J Cardiol. 2019 Oct 1;292:280-282
pubmed: 31171391
Eval Program Plann. 1979;2(3):197-207
pubmed: 10245370
JMIR Mhealth Uhealth. 2015 Mar 11;3(1):e27
pubmed: 25760773
Popul Health Manag. 2013 Jun;16(3):169-77
pubmed: 23216062
PLoS One. 2017 Jun 21;12(6):e0179733
pubmed: 28636678
NeuroRehabilitation. 2010;27(4):287-304
pubmed: 21160118
J Med Internet Res. 2018 Dec 18;20(12):e294
pubmed: 30563822
J Gen Intern Med. 2001 Sep;16(9):606-13
pubmed: 11556941
Semin Arthritis Rheum. 2017 Aug;47(1):121-128
pubmed: 28420491
BMC Med Inform Decis Mak. 2021 Feb 2;21(1):36
pubmed: 33531013
Med 2 0. 2015 Mar 02;4(1):e1
pubmed: 25733033
J Card Fail. 2018 Jan;24(1):19-28
pubmed: 28939459

Auteurs

Andreas Knapp (A)

Center for Evidence-Based Healthcare, University Hospital Carl Gustav Carus, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany.

Lorenz Harst (L)

Center for Evidence-Based Healthcare, University Hospital Carl Gustav Carus, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany.

Stefan Hager (S)

Comprehensive Pain Center, University Hospital Carl Gustav Carus Dresden, Dresden, Germany.

Jochen Schmitt (J)

Center for Evidence-Based Healthcare, University Hospital Carl Gustav Carus, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany.

Madlen Scheibe (M)

Center for Evidence-Based Healthcare, University Hospital Carl Gustav Carus, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH