An experimental machine learning study investigating the decision-making process of students and qualified radiographers when interpreting radiographic images.
Journal
PLOS digital health
ISSN: 2767-3170
Titre abrégé: PLOS Digit Health
Pays: United States
ID NLM: 9918335064206676
Informations de publication
Date de publication:
Oct 2023
Oct 2023
Historique:
received:
15
03
2023
accepted:
29
07
2023
medline:
25
10
2023
pubmed:
25
10
2023
entrez:
25
10
2023
Statut:
epublish
Résumé
AI is becoming more prevalent in healthcare and is predicted to be further integrated into workflows to ease the pressure on an already stretched service. The National Health Service in the UK has prioritised AI and Digital health as part of its Long-Term Plan. Few studies have examined the human interaction with such systems in healthcare, despite reports of biases being present with the use of AI in other technologically advanced fields, such as finance and aviation. Understanding is needed of how certain user characteristics may impact how radiographers engage with AI systems in use in the clinical setting to mitigate against problems before they arise. The aim of this study is to determine correlations of skills, confidence in AI and perceived knowledge amongst student and qualified radiographers in the UK healthcare system. A machine learning based AI model was built to predict if the interpreter was either a student (n = 67) or a qualified radiographer (n = 39) in advance, using important variables from a feature selection technique named Boruta. A survey, which required the participant to interpret a series of plain radiographic examinations with and without AI assistance, was created on the Qualtrics survey platform and promoted via social media (Twitter/LinkedIn), therefore adopting convenience, snowball sampling This survey was open to all UK radiographers, including students and retired radiographers. Pearson's correlation analysis revealed that males who were proficient in their profession were more likely than females to trust AI. Trust in AI was negatively correlated with age and with level of experience. A machine learning model was built, the best model predicted the image interpreter to be qualified radiographers with 0.93 area under curve and a prediction accuracy of 93%. Further testing in prospective validation cohorts using a larger sample size is required to determine the clinical utility of the proposed machine learning model.
Identifiants
pubmed: 37878569
doi: 10.1371/journal.pdig.0000229
pii: PDIG-D-23-00083
pmc: PMC10599497
doi:
Types de publication
Journal Article
Langues
eng
Pagination
e0000229Informations de copyright
Copyright: © 2023 Rainey et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Déclaration de conflit d'intérêts
The authors have declared that no competing interests exist.
Références
Sci Rep. 2017 Jul 31;7(1):6862
pubmed: 28761071
J Med Imaging Radiat Sci. 2022 Sep;53(3):347-361
pubmed: 35715359
BMJ. 2003 Sep 27;327(7417):716-9
pubmed: 14512479
Eur Radiol. 2021 Apr;31(4):1805-1811
pubmed: 32945967
Biochem Med (Zagreb). 2013;23(2):143-9
pubmed: 23894860
Am J Ind Med. 2018 Jan;61(1):63-76
pubmed: 29148090
Prog Neuropsychopharmacol Biol Psychiatry. 2018 Jan 3;80(Pt B):71-80
pubmed: 28648568
J Med Radiat Sci. 2021 Sep;68(3):260-268
pubmed: 33586361
PLoS One. 2017 Jun 2;12(6):e0177678
pubmed: 28574989
NPJ Digit Med. 2020 May 14;3:70
pubmed: 32435698
Int J Med Inform. 2014 May;83(5):368-75
pubmed: 24581700
Radiography (Lond). 2022 Nov;28(4):881-888
pubmed: 35780627
Eur Radiol. 2023 Mar;33(3):1844-1851
pubmed: 36282311
BMC Health Serv Res. 2022 Mar 26;22(1):398
pubmed: 35346183
Radiography (Lond). 2021 Nov;27(4):1192-1202
pubmed: 34420888
Biomed Eng Online. 2018 Aug 22;17(1):113
pubmed: 30134902
PLoS One. 2017 Jan 06;12(1):e0169772
pubmed: 28060903
Eur Radiol. 2020 Oct;30(10):5525-5532
pubmed: 32458173
Insights Imaging. 2021 Jun 16;12(1):80
pubmed: 34132910
Radiography (Lond). 2021 Aug;27(3):861-866
pubmed: 33622574
J Multidiscip Healthc. 2021 Nov 23;14:3225-3231
pubmed: 34848967
J Electrocardiol. 2018 Nov - Dec;51(6S):S6-S11
pubmed: 30122457
AJR Am J Roentgenol. 2022 Sep;219(3):369-380
pubmed: 35018795
Hum Factors. 2010 Jun;52(3):381-410
pubmed: 21077562
Anesth Analg. 2018 May;126(5):1763-1768
pubmed: 29481436
J Med Imaging Radiat Sci. 2023 Mar;54(1):104-116
pubmed: 36535859
Radiography (Lond). 2021 Oct;27 Suppl 1:S58-S62
pubmed: 34380589
Philos Trans A Math Phys Eng Sci. 2007 Feb 15;365(1851):515-37
pubmed: 17255050
Front Digit Health. 2021 Nov 11;3:739327
pubmed: 34859245
Bioinformatics. 2007 Oct 1;23(19):2507-17
pubmed: 17720704
R Soc Open Sci. 2017 Jul 26;4(7):170175
pubmed: 28791144
BMC Med Educ. 2023 Jan 10;23(1):16
pubmed: 36627640