Physician- and Patient-Elicited Barriers and Facilitators to Implementation of a Machine Learning-Based Screening Tool for Peripheral Arterial Disease: Preimplementation Study With Physician and Patient Stakeholders.

artificial intelligence cardiovascular disease machine learning peripheral arterial disease preimplementation study

Journal

JMIR cardio
ISSN: 2561-1011
Titre abrégé: JMIR Cardio
Pays: Canada
ID NLM: 101718325

Informations de publication

Date de publication:
06 Nov 2023
Historique:
received: 30 11 2022
accepted: 21 08 2023
revised: 23 07 2023
medline: 6 11 2023
pubmed: 6 11 2023
entrez: 6 11 2023
Statut: epublish

Résumé

Peripheral arterial disease (PAD) is underdiagnosed, partially due to a high prevalence of atypical symptoms and a lack of physician and patient awareness. Implementing clinical decision support tools powered by machine learning algorithms may help physicians identify high-risk patients for diagnostic workup. This study aims to evaluate barriers and facilitators to the implementation of a novel machine learning-based screening tool for PAD among physician and patient stakeholders using the Consolidated Framework for Implementation Research (CFIR). We performed semistructured interviews with physicians and patients from the Stanford University Department of Primary Care and Population Health, Division of Cardiology, and Division of Vascular Medicine. Participants answered questions regarding their perceptions toward machine learning and clinical decision support for PAD detection. Rapid thematic analysis was performed using templates incorporating codes from CFIR constructs. A total of 12 physicians (6 primary care physicians and 6 cardiovascular specialists) and 14 patients were interviewed. Barriers to implementation arose from 6 CFIR constructs: complexity, evidence strength and quality, relative priority, external policies and incentives, knowledge and beliefs about intervention, and individual identification with the organization. Facilitators arose from 5 CFIR constructs: intervention source, relative advantage, learning climate, patient needs and resources, and knowledge and beliefs about intervention. Physicians felt that a machine learning-powered diagnostic tool for PAD would improve patient care but cited limited time and authority in asking patients to undergo additional screening procedures. Patients were interested in having their physicians use this tool but raised concerns about such technologies replacing human decision-making. Patient- and physician-reported barriers toward the implementation of a machine learning-powered PAD diagnostic tool followed four interdependent themes: (1) low familiarity or urgency in detecting PAD; (2) concerns regarding the reliability of machine learning; (3) differential perceptions of responsibility for PAD care among primary care versus specialty physicians; and (4) patient preference for physicians to remain primary interpreters of health care data. Facilitators followed two interdependent themes: (1) enthusiasm for clinical use of the predictive model and (2) willingness to incorporate machine learning into clinical care. Implementation of machine learning-powered diagnostic tools for PAD should leverage provider support while simultaneously educating stakeholders on the importance of early PAD diagnosis. High predictive validity is necessary for machine learning models but not sufficient for implementation.

Sections du résumé

BACKGROUND BACKGROUND
Peripheral arterial disease (PAD) is underdiagnosed, partially due to a high prevalence of atypical symptoms and a lack of physician and patient awareness. Implementing clinical decision support tools powered by machine learning algorithms may help physicians identify high-risk patients for diagnostic workup.
OBJECTIVE OBJECTIVE
This study aims to evaluate barriers and facilitators to the implementation of a novel machine learning-based screening tool for PAD among physician and patient stakeholders using the Consolidated Framework for Implementation Research (CFIR).
METHODS METHODS
We performed semistructured interviews with physicians and patients from the Stanford University Department of Primary Care and Population Health, Division of Cardiology, and Division of Vascular Medicine. Participants answered questions regarding their perceptions toward machine learning and clinical decision support for PAD detection. Rapid thematic analysis was performed using templates incorporating codes from CFIR constructs.
RESULTS RESULTS
A total of 12 physicians (6 primary care physicians and 6 cardiovascular specialists) and 14 patients were interviewed. Barriers to implementation arose from 6 CFIR constructs: complexity, evidence strength and quality, relative priority, external policies and incentives, knowledge and beliefs about intervention, and individual identification with the organization. Facilitators arose from 5 CFIR constructs: intervention source, relative advantage, learning climate, patient needs and resources, and knowledge and beliefs about intervention. Physicians felt that a machine learning-powered diagnostic tool for PAD would improve patient care but cited limited time and authority in asking patients to undergo additional screening procedures. Patients were interested in having their physicians use this tool but raised concerns about such technologies replacing human decision-making.
CONCLUSIONS CONCLUSIONS
Patient- and physician-reported barriers toward the implementation of a machine learning-powered PAD diagnostic tool followed four interdependent themes: (1) low familiarity or urgency in detecting PAD; (2) concerns regarding the reliability of machine learning; (3) differential perceptions of responsibility for PAD care among primary care versus specialty physicians; and (4) patient preference for physicians to remain primary interpreters of health care data. Facilitators followed two interdependent themes: (1) enthusiasm for clinical use of the predictive model and (2) willingness to incorporate machine learning into clinical care. Implementation of machine learning-powered diagnostic tools for PAD should leverage provider support while simultaneously educating stakeholders on the importance of early PAD diagnosis. High predictive validity is necessary for machine learning models but not sufficient for implementation.

Identifiants

pubmed: 37930755
pii: v7i1e44732
doi: 10.2196/44732
pmc: PMC10660241
doi:

Types de publication

Journal Article

Langues

eng

Pagination

e44732

Subventions

Organisme : NHLBI NIH HHS
ID : K01 HL148639
Pays : United States
Organisme : NHLBI NIH HHS
ID : R25 HL145817
Pays : United States

Informations de copyright

©Vy Ho, Cati Brown Johnson, Ilies Ghanzouri, Saeed Amal, Steven Asch, Elsie Ross. Originally published in JMIR Cardio (https://cardio.jmir.org), 06.11.2023.

Références

NPJ Digit Med. 2019 Jun 14;2:53
pubmed: 31304399
Nat Biomed Eng. 2018 Oct;2(10):719-731
pubmed: 31015651
Sci Rep. 2022 Aug 3;12(1):13364
pubmed: 35922657
Implement Sci. 2009 Aug 07;4:50
pubmed: 19664226
Vasc Med. 2012 Oct;17(5):342-51
pubmed: 22711750
Arch Intern Med. 2011 Jan 10;171(1):56-65
pubmed: 21220662
Aging Clin Exp Res. 2022 Mar;34(3):679-685
pubmed: 34570316
Implement Sci. 2021 Jul 2;16(1):67
pubmed: 34215286
Health Informatics J. 2021 Apr-Jun;27(2):14604582211011215
pubmed: 33913359
Atherosclerosis. 2009 Jun;204(2):e86-92
pubmed: 19054514
Vasc Med. 1996;1(1):65-71
pubmed: 9546918
J Gen Intern Med. 2012 Jan;27(1):8-15
pubmed: 21751057
Gen Hosp Psychiatry. 2021 May-Jun;70:31-37
pubmed: 33711562
Circulation. 2007 Oct 30;116(18):2086-94
pubmed: 17875966
Am J Prev Med. 2007 Apr;32(4):328-33
pubmed: 17383564
Implement Sci. 2017 Feb 10;12(1):15
pubmed: 28187747
Transl Vis Sci Technol. 2020 Aug 11;9(2):45
pubmed: 32879755
JAMA. 2001 Sep 19;286(11):1317-24
pubmed: 11560536

Auteurs

Vy Ho (V)

Division of Vascular Surgery, Department of Surgery, Stanford University School of Medicine, Stanford, CA, United States.

Cati Brown Johnson (C)

Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, CA, United States.

Ilies Ghanzouri (I)

Division of Vascular Surgery, Department of Surgery, Stanford University School of Medicine, Stanford, CA, United States.

Saeed Amal (S)

College of Engineering, Northeastern University, Boston, MA, United States.

Steven Asch (S)

Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, CA, United States.
Center for Innovation to Implementation, Veterans Affairs Palo Alto Healthcare System, Palo Alto, CA, United States.

Elsie Ross (E)

Division of Vascular Surgery, Department of Surgery, Stanford University School of Medicine, Stanford, CA, United States.

Classifications MeSH