Physician- and Patient-Elicited Barriers and Facilitators to Implementation of a Machine Learning-Based Screening Tool for Peripheral Arterial Disease: Preimplementation Study With Physician and Patient Stakeholders.
artificial intelligence
cardiovascular disease
machine learning
peripheral arterial disease
preimplementation study
Journal
JMIR cardio
ISSN: 2561-1011
Titre abrégé: JMIR Cardio
Pays: Canada
ID NLM: 101718325
Informations de publication
Date de publication:
06 Nov 2023
06 Nov 2023
Historique:
received:
30
11
2022
accepted:
21
08
2023
revised:
23
07
2023
medline:
6
11
2023
pubmed:
6
11
2023
entrez:
6
11
2023
Statut:
epublish
Résumé
Peripheral arterial disease (PAD) is underdiagnosed, partially due to a high prevalence of atypical symptoms and a lack of physician and patient awareness. Implementing clinical decision support tools powered by machine learning algorithms may help physicians identify high-risk patients for diagnostic workup. This study aims to evaluate barriers and facilitators to the implementation of a novel machine learning-based screening tool for PAD among physician and patient stakeholders using the Consolidated Framework for Implementation Research (CFIR). We performed semistructured interviews with physicians and patients from the Stanford University Department of Primary Care and Population Health, Division of Cardiology, and Division of Vascular Medicine. Participants answered questions regarding their perceptions toward machine learning and clinical decision support for PAD detection. Rapid thematic analysis was performed using templates incorporating codes from CFIR constructs. A total of 12 physicians (6 primary care physicians and 6 cardiovascular specialists) and 14 patients were interviewed. Barriers to implementation arose from 6 CFIR constructs: complexity, evidence strength and quality, relative priority, external policies and incentives, knowledge and beliefs about intervention, and individual identification with the organization. Facilitators arose from 5 CFIR constructs: intervention source, relative advantage, learning climate, patient needs and resources, and knowledge and beliefs about intervention. Physicians felt that a machine learning-powered diagnostic tool for PAD would improve patient care but cited limited time and authority in asking patients to undergo additional screening procedures. Patients were interested in having their physicians use this tool but raised concerns about such technologies replacing human decision-making. Patient- and physician-reported barriers toward the implementation of a machine learning-powered PAD diagnostic tool followed four interdependent themes: (1) low familiarity or urgency in detecting PAD; (2) concerns regarding the reliability of machine learning; (3) differential perceptions of responsibility for PAD care among primary care versus specialty physicians; and (4) patient preference for physicians to remain primary interpreters of health care data. Facilitators followed two interdependent themes: (1) enthusiasm for clinical use of the predictive model and (2) willingness to incorporate machine learning into clinical care. Implementation of machine learning-powered diagnostic tools for PAD should leverage provider support while simultaneously educating stakeholders on the importance of early PAD diagnosis. High predictive validity is necessary for machine learning models but not sufficient for implementation.
Sections du résumé
BACKGROUND
BACKGROUND
Peripheral arterial disease (PAD) is underdiagnosed, partially due to a high prevalence of atypical symptoms and a lack of physician and patient awareness. Implementing clinical decision support tools powered by machine learning algorithms may help physicians identify high-risk patients for diagnostic workup.
OBJECTIVE
OBJECTIVE
This study aims to evaluate barriers and facilitators to the implementation of a novel machine learning-based screening tool for PAD among physician and patient stakeholders using the Consolidated Framework for Implementation Research (CFIR).
METHODS
METHODS
We performed semistructured interviews with physicians and patients from the Stanford University Department of Primary Care and Population Health, Division of Cardiology, and Division of Vascular Medicine. Participants answered questions regarding their perceptions toward machine learning and clinical decision support for PAD detection. Rapid thematic analysis was performed using templates incorporating codes from CFIR constructs.
RESULTS
RESULTS
A total of 12 physicians (6 primary care physicians and 6 cardiovascular specialists) and 14 patients were interviewed. Barriers to implementation arose from 6 CFIR constructs: complexity, evidence strength and quality, relative priority, external policies and incentives, knowledge and beliefs about intervention, and individual identification with the organization. Facilitators arose from 5 CFIR constructs: intervention source, relative advantage, learning climate, patient needs and resources, and knowledge and beliefs about intervention. Physicians felt that a machine learning-powered diagnostic tool for PAD would improve patient care but cited limited time and authority in asking patients to undergo additional screening procedures. Patients were interested in having their physicians use this tool but raised concerns about such technologies replacing human decision-making.
CONCLUSIONS
CONCLUSIONS
Patient- and physician-reported barriers toward the implementation of a machine learning-powered PAD diagnostic tool followed four interdependent themes: (1) low familiarity or urgency in detecting PAD; (2) concerns regarding the reliability of machine learning; (3) differential perceptions of responsibility for PAD care among primary care versus specialty physicians; and (4) patient preference for physicians to remain primary interpreters of health care data. Facilitators followed two interdependent themes: (1) enthusiasm for clinical use of the predictive model and (2) willingness to incorporate machine learning into clinical care. Implementation of machine learning-powered diagnostic tools for PAD should leverage provider support while simultaneously educating stakeholders on the importance of early PAD diagnosis. High predictive validity is necessary for machine learning models but not sufficient for implementation.
Identifiants
pubmed: 37930755
pii: v7i1e44732
doi: 10.2196/44732
pmc: PMC10660241
doi:
Types de publication
Journal Article
Langues
eng
Pagination
e44732Subventions
Organisme : NHLBI NIH HHS
ID : K01 HL148639
Pays : United States
Organisme : NHLBI NIH HHS
ID : R25 HL145817
Pays : United States
Informations de copyright
©Vy Ho, Cati Brown Johnson, Ilies Ghanzouri, Saeed Amal, Steven Asch, Elsie Ross. Originally published in JMIR Cardio (https://cardio.jmir.org), 06.11.2023.
Références
NPJ Digit Med. 2019 Jun 14;2:53
pubmed: 31304399
Nat Biomed Eng. 2018 Oct;2(10):719-731
pubmed: 31015651
Sci Rep. 2022 Aug 3;12(1):13364
pubmed: 35922657
Implement Sci. 2009 Aug 07;4:50
pubmed: 19664226
Vasc Med. 2012 Oct;17(5):342-51
pubmed: 22711750
Arch Intern Med. 2011 Jan 10;171(1):56-65
pubmed: 21220662
Aging Clin Exp Res. 2022 Mar;34(3):679-685
pubmed: 34570316
Implement Sci. 2021 Jul 2;16(1):67
pubmed: 34215286
Health Informatics J. 2021 Apr-Jun;27(2):14604582211011215
pubmed: 33913359
Atherosclerosis. 2009 Jun;204(2):e86-92
pubmed: 19054514
Vasc Med. 1996;1(1):65-71
pubmed: 9546918
J Gen Intern Med. 2012 Jan;27(1):8-15
pubmed: 21751057
Gen Hosp Psychiatry. 2021 May-Jun;70:31-37
pubmed: 33711562
Circulation. 2007 Oct 30;116(18):2086-94
pubmed: 17875966
Am J Prev Med. 2007 Apr;32(4):328-33
pubmed: 17383564
Implement Sci. 2017 Feb 10;12(1):15
pubmed: 28187747
Transl Vis Sci Technol. 2020 Aug 11;9(2):45
pubmed: 32879755
JAMA. 2001 Sep 19;286(11):1317-24
pubmed: 11560536