A Deep Learning Model Enhances Clinicians' Diagnostic Accuracy to More Than 96% for Anterior Cruciate Ligament Ruptures on Magnetic Resonance Imaging.


Journal

Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association
ISSN: 1526-3231
Titre abrégé: Arthroscopy
Pays: United States
ID NLM: 8506498

Informations de publication

Date de publication:
Apr 2024
Historique:
received: 08 03 2023
revised: 02 08 2023
accepted: 03 08 2023
pubmed: 20 8 2023
medline: 20 8 2023
entrez: 19 8 2023
Statut: ppublish

Résumé

To develop a deep learning model to accurately detect anterior cruciate ligament (ACL) ruptures on magnetic resonance imaging (MRI) and to evaluate its effect on the diagnostic accuracy and efficiency of clinicians. A training dataset was built from MRIs acquired from January 2017 to June 2021, including patients with knee symptoms, irrespective of ACL ruptures. An external validation dataset was built from MRIs acquired from January 2021 to June 2022, including patients who underwent knee arthroscopy or arthroplasty. Patients with fractures or prior knee surgeries were excluded in both datasets. Subsequently, a deep learning model was developed and validated using these datasets. Clinicians of varying expertise levels in sports medicine and radiology were recruited, and their capacities in diagnosing ACL injuries in terms of accuracy and diagnosing time were evaluated both with and without artificial intelligence (AI) assistance. A deep learning model was developed based on the training dataset of 22,767 MRIs from 5 centers and verified with external validation dataset of 4,086 MRIs from 6 centers. The model achieved an area under the receiver operating characteristic curve of 0.987 and a sensitivity and specificity of 95.1%. Thirty-eight clinicians from 25 centers were recruited to diagnose 3,800 MRIs. The AI assistance significantly improved the accuracy of all clinicians, exceeding 96%. Additionally, a notable reduction in diagnostic time was observed. The most significant improvements in accuracy and time efficiency were observed in the trainee groups, suggesting that AI support is particularly beneficial for clinicians with moderately limited diagnostic expertise. This deep learning model demonstrated expert-level diagnostic performance for ACL ruptures, serving as a valuable tool to assist clinicians of various specialties and experience levels in making accurate and efficient diagnoses. Level III, retrospective comparative case series.

Identifiants

pubmed: 37597705
pii: S0749-8063(23)00663-1
doi: 10.1016/j.arthro.2023.08.010
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

1197-1205

Informations de copyright

Copyright © 2023 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Auteurs

Ding-Yu Wang (DY)

Department of Sports Medicine, Peking University Third Hospital, Institute of Sports Medicine of Peking University, Beijing, China; Beijing Key Laboratory of Sports Injuries, Beijing, China; Engineering Research Center of Sports Trauma Treatment Technology and Devices, Ministry of Education, Beijing, China.

Shang-Gui Liu (SG)

Department of Sports Medicine, Peking University Third Hospital, Institute of Sports Medicine of Peking University, Beijing, China; Beijing Key Laboratory of Sports Injuries, Beijing, China; Engineering Research Center of Sports Trauma Treatment Technology and Devices, Ministry of Education, Beijing, China.

Jia Ding (J)

Beijing Yizhun Medical AI Co., Ltd, Beijing, China.

An-Lan Sun (AL)

Beijing Yizhun Medical AI Co., Ltd, Beijing, China.

Dong Jiang (D)

Department of Sports Medicine, Peking University Third Hospital, Institute of Sports Medicine of Peking University, Beijing, China; Beijing Key Laboratory of Sports Injuries, Beijing, China; Engineering Research Center of Sports Trauma Treatment Technology and Devices, Ministry of Education, Beijing, China.

Jia Jiang (J)

Department of Sports Medicine, Shanghai Jiaotong University Affiliated Sixth People's Hospital, Shanghai, China.

Jin-Zhong Zhao (JZ)

Department of Sports Medicine, Shanghai Jiaotong University Affiliated Sixth People's Hospital, Shanghai, China.

De-Sheng Chen (DS)

Department of Sports Medicine and Arthroscopy, Tianjin Hospital of Tianjin University, Tianjin, China.

Gang Ji (G)

Department of Orthopaedic Surgery, Third Hospital of Hebei Medical University, Hebei, China.

Nan Li (N)

Research Center of Clinical Epidemiology, Peking University Third Hospital, Beijing, China.

Hui-Shu Yuan (HS)

Department of Radiology, Peking University Third Hospital, Beijing, China.

Jia-Kuo Yu (JK)

Department of Sports Medicine, Peking University Third Hospital, Institute of Sports Medicine of Peking University, Beijing, China; Beijing Key Laboratory of Sports Injuries, Beijing, China; Engineering Research Center of Sports Trauma Treatment Technology and Devices, Ministry of Education, Beijing, China. Electronic address: yujiakuo@126.com.

Classifications MeSH