Neural network algorithm for detection of erosions and ankylosis on CT of the sacroiliac joints: multicentre development and validation of diagnostic accuracy.
Artificial intelligence
Deep learning
Sacroiliac joint
Sacroiliitis
Spondyloarthropathies
Journal
European radiology
ISSN: 1432-1084
Titre abrégé: Eur Radiol
Pays: Germany
ID NLM: 9114774
Informations de publication
Date de publication:
Nov 2023
Nov 2023
Historique:
received:
30
11
2022
accepted:
25
03
2023
revised:
03
03
2023
medline:
27
10
2023
pubmed:
23
5
2023
entrez:
23
5
2023
Statut:
ppublish
Résumé
To evaluate the feasibility and diagnostic accuracy of a deep learning network for detection of structural lesions of sacroiliitis on multicentre pelvic CT scans. Pelvic CT scans of 145 patients (81 female, 121 Ghent University/24 Alberta University, 18-87 years old, mean 40 ± 13 years, 2005-2021) with a clinical suspicion of sacroiliitis were retrospectively included. After manual sacroiliac joint (SIJ) segmentation and structural lesion annotation, a U-Net for SIJ segmentation and two separate convolutional neural networks (CNN) for erosion and ankylosis detection were trained. In-training validation and tenfold validation testing (U-Net-n = 10 × 58; CNN-n = 10 × 29) on a test dataset were performed to assess performance on a slice-by-slice and patient level (dice coefficient/accuracy/sensitivity/specificity/positive and negative predictive value/ROC AUC). Patient-level optimisation was applied to increase the performance regarding predefined statistical metrics. Gradient-weighted class activation mapping (Grad-CAM++) heatmap explainability analysis highlighted image parts with statistically important regions for algorithmic decisions. Regarding SIJ segmentation, a dice coefficient of 0.75 was obtained in the test dataset. For slice-by-slice structural lesion detection, a sensitivity/specificity/ROC AUC of 95%/89%/0.92 and 93%/91%/0.91 were obtained in the test dataset for erosion and ankylosis detection, respectively. For patient-level lesion detection after pipeline optimisation for predefined statistical metrics, a sensitivity/specificity of 95%/85% and 82%/97% were obtained for erosion and ankylosis detection, respectively. Grad-CAM++ explainability analysis highlighted cortical edges as focus for pipeline decisions. An optimised deep learning pipeline, including an explainability analysis, detects structural lesions of sacroiliitis on pelvic CT scans with excellent statistical performance on a slice-by-slice and patient level. An optimised deep learning pipeline, including a robust explainability analysis, detects structural lesions of sacroiliitis on pelvic CT scans with excellent statistical metrics on a slice-by-slice and patient level. • Structural lesions of sacroiliitis can be detected automatically in pelvic CT scans. • Both automatic segmentation and disease detection yield excellent statistical outcome metrics. • The algorithm takes decisions based on cortical edges, rendering an explainable solution.
Identifiants
pubmed: 37219619
doi: 10.1007/s00330-023-09704-y
pii: 10.1007/s00330-023-09704-y
doi:
Types de publication
Multicenter Study
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
8310-8323Subventions
Organisme : European Society of Musculoskeletal Radiology
ID : Young Researchers Grant 2022
Organisme : Koning Boudewijnstichting
ID : Scientific Research on Rheumatology Fund 2022
Organisme : Fonds Wetenschappelijk Onderzoek
ID : Fundamenteel Klinisch Mandaat 2022-2027
Informations de copyright
© 2023. The Author(s), under exclusive licence to European Society of Radiology.
Références
Dougados M, Baeten D (2011) Spondyloarthritis. Lancet 377:2127–2137. https://doi.org/10.1016/S0140-6736(11)60071-8
Sieper J, Poddubnyy D (2017) Axial spondyloarthritis. Lancet 390:73–84. https://doi.org/10.1016/S0140-6736(16)31591-4
doi: 10.1016/S0140-6736(16)31591-4
pubmed: 28110981
Shenkman Y, Qutteineh B, Joskowicz L et al (2019) Automatic detection and diagnosis of sacroiliitis in CT scans as incidental findings. Med Image Anal 57:165–175. https://doi.org/10.1016/j.media.2019.07.007
doi: 10.1016/j.media.2019.07.007
pubmed: 31323597
Song I-H, Sieper J, Rudwaleit M (2007) Diagnosing early ankylosing spondylitis. Curr Rheumatol Rep 9:367–374
Khan S, Shridharmurthy D, Lapane KL et al (2022) The disease burden of axial spondyloarthritis: through a gendered lens. Clin Rheumatol 41:1115–1124
doi: 10.1007/s10067-021-06008-8
pubmed: 34988682
Wendling D, Claudepierre P, Prati C (2013) Early diagnosis and management are crucial in spondyloarthritis. Joint Bone Spine 80:582–585. https://doi.org/10.1016/j.jbspin.2013.03.003
doi: 10.1016/j.jbspin.2013.03.003
pubmed: 23578940
Danve A, Deodhar A (2019) Axial spondyloarthritis in the USA: diagnostic challenges and missed opportunities. Clin Rheumatol 38:625–634
doi: 10.1007/s10067-018-4397-3
pubmed: 30588555
Poddubnyy D, Rudwaleit M (2012) Early Spondyloarthritis. Rheum Dis Clin North Am 38:387–403. https://doi.org/10.1016/j.rdc.2012.04.007
doi: 10.1016/j.rdc.2012.04.007
pubmed: 22819091
Strand V, Singh JA (2017) Patient burden of axial spondyloarthritis. J Clin Rheumatol 23:383–391. https://doi.org/10.1097/RHU.0000000000000589
doi: 10.1097/RHU.0000000000000589
pubmed: 28937474
pmcid: 5617559
Kotsis K, Voulgari PV, Drosos AA et al (2014) Health-related quality of life in patients with ankylosing spondylitis: a comprehensive review. Expert Rev Pharmacoecon Outcomes Res 14:857–872. https://doi.org/10.1586/14737167.2014.957679
doi: 10.1586/14737167.2014.957679
pubmed: 25193010
Boonen A, Sieper J, van der Heijde D et al (2015) The burden of non-radiographic axial spondyloarthritis. Semin Arthritis Rheum 44:556–562. https://doi.org/10.1016/j.semarthrit.2014.10.009
doi: 10.1016/j.semarthrit.2014.10.009
pubmed: 25532945
Kobelt G, Andlin-Sobocki P, Brophy S et al (2004) The burden of ankylosing spondylitis and the cost-effectiveness of treatment with infliximab (Remicade ®). Rheumatology 43:1158–1166. https://doi.org/10.1093/rheumatology/keh271
doi: 10.1093/rheumatology/keh271
pubmed: 15226514
Lee JS, Oh B-L, Lee HY, Song YW, Lee EY (2018) Comorbidity, disability, and healthcare expenditure of ankylosing spondylitis in Korea: A population-based study. PLoS One 13(2):e0192524
Tu L, Rai JC, Cao S et al (2014) Costs and work limitation of patients with ankylosing spondylitis in China. Clin Exp Rheumatol 32:661–666
pubmed: 25234798
Sieper J, Holbrook T, Black CM et al (2016) Burden of illness associated with non-radiographic axial spondyloarthritis: a multiperspective European cross-sectional observational study. Clin Exp Rheumatol 34:975–983
pubmed: 27749215
Maksymowych WP, Lambert RG, Baraliakos X et al (2021) Data-driven definitions for active and structural MRI lesions in the sacroiliac joint in spondyloarthritis and their predictive utility. Rheumatology (Oxford)) 60:4778–4789. https://doi.org/10.1093/rheumatology/keab099
doi: 10.1093/rheumatology/keab099
pubmed: 33523107
Sieper J, Rudwaleit M, Baraliakos X et al (2009) The Assessment of SpondyloArthritis international Society (ASAS) handbook: A guide to assess spondyloarthritis. Ann Rheum Dis 68(Suppl II):ii1–ii44. https://doi.org/10.1136/ard.2008.104018
Jans L, Egund N, Eshed I et al (2018) Sacroiliitis in Axial Spondyloarthritis: Assessing Morphology and Activity. Semin Musculoskelet Radiol 22:180–188. https://doi.org/10.1055/s-0038-1639470
doi: 10.1055/s-0038-1639470
pubmed: 29672806
Pialat JB, Di Marco L, Feydy A et al (2016) Sacroiliac joints imaging in axial spondyloarthritis. Diagn Interv Imaging 97:697–708. https://doi.org/10.1016/j.diii.2016.02.013
doi: 10.1016/j.diii.2016.02.013
pubmed: 27050638
Weber U, Lambert RGW, Østergaard M et al (2010) The diagnostic utility of magnetic resonance imaging in spondylarthritis: An international multicenter evaluation of one hundred eighty-seven subjects. Arthritis Rheum 62:3048–3058. https://doi.org/10.1002/art.27571
doi: 10.1002/art.27571
pubmed: 20496416
Melchior J, Azraq Y, Chary-Valckenaere I et al (2017) Radiography and abdominal CT compared with sacroiliac joint CT in the diagnosis of sacroiliitis. Acta Radiol 58:1252–1259. https://doi.org/10.1177/0284185116688377
doi: 10.1177/0284185116688377
pubmed: 28103710
Lambert RGW, Hermann KGA, Diekhoff T (2021) Low-dose computed tomography for axial spondyloarthritis: update on use and limitations. Curr Opin Rheumatol 33:326–332. https://doi.org/10.1097/BOR.0000000000000803
doi: 10.1097/BOR.0000000000000803
pubmed: 33927123
Diekhoff T, Hermann KGA, Greese J et al (2017) Comparison of MRI with radiography for detecting structural lesions of the sacroiliac joint using CT as standard of reference: results from the SIMACT study. Ann Rheum Dis 76:1502–1508. https://doi.org/10.1136/annrheumdis-2016-210640
doi: 10.1136/annrheumdis-2016-210640
pubmed: 28283515
Althoff CE, Sieper J, Song IH et al (2013) Active inflammation and structural change in early active axial spondyloarthritis as detected by whole-body MRI. Ann Rheum Dis 72:967–973. https://doi.org/10.1136/annrheumdis-2012-201545
doi: 10.1136/annrheumdis-2012-201545
pubmed: 22736088
Leibushor N, Slonimsky E, Aharoni D et al (2017) CT abnormalities in the sacroiliac joints of patients with diffuse idiopathic skeletal hyperostosis. AJR Am J Roentgenol 208:834–837. https://doi.org/10.2214/AJR.16.16994
doi: 10.2214/AJR.16.16994
pubmed: 28125786
Hermann KGA, Ziegeler K, Kreutzinger V et al (2022) What amount of structural damage defines sacroiliitis: a CT study. RMD Open 8:e001939. https://doi.org/10.1136/rmdopen-2021-001939
Chen M, Herregods N, Jaremko JL et al (2020) Bone marrow oedema in sacroiliitis: detection with dual-energy CT. Eur Radiol 30:3393–3400. https://doi.org/10.1007/s00330-020-06670-7
doi: 10.1007/s00330-020-06670-7
pubmed: 32055947
Slobodin G, Croitoru S, Starikov N et al (2012) Incidental computed tomography sacroiliitis: Clinical significance and inappropriateness of the New York radiological grading criteria for the diagnosis. Clin Rheumatol 31:425–428. https://doi.org/10.1007/s10067-011-1871-6
doi: 10.1007/s10067-011-1871-6
pubmed: 21975576
Yushkevich PA, Piven J, Hazlett HC et al (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31:1116–1128. https://doi.org/10.1016/j.neuroimage.2006.01.015
doi: 10.1016/j.neuroimage.2006.01.015
pubmed: 16545965
Zou KH, Warfield SK, Bharatha A et al (2004) Statistical validation of image segmentation quality based on a spatial overlap index. Acad Radiol 11:178–189. https://doi.org/10.1016/S1076-6332(03)00671-8
doi: 10.1016/S1076-6332(03)00671-8
pubmed: 14974593
pmcid: 1415224
Yu AC, Eng J (2020) One algorithm may not fit all: How selection bias affects machine learning performance. Radiographics 40:1932–1937. https://doi.org/10.1148/rg.2020200040
doi: 10.1148/rg.2020200040
pubmed: 32976062
Bluemke DA, Moy L, Bredella MA et al (2020) Assessing radiology research on artificial intelligence: a brief guide for authors, reviewers, and readers-from the Radiology Editorial Board. Radiology 294:487–489. https://doi.org/10.1148/radiol.2019192515
doi: 10.1148/radiol.2019192515
pubmed: 31891322
Selvaraju RR, Cogswell M, Das A et al (2020) Grad-CAM: visual explanations from deep networks via gradient-based localization. Int J Comput Vis 128:336–359. https://doi.org/10.1007/s11263-019-01228-7
doi: 10.1007/s11263-019-01228-7
Geijer M, Gadeholt Gothlin G, Gothlin JH (2009) The validity of the new york radiological grading criteria in diagnosing sacroiliitis by computed tomography. Acta Radiol 50:664–673. https://doi.org/10.1080/02841850902914099
doi: 10.1080/02841850902914099
pubmed: 19488891
Bressem KK, Vahldiek JL, Adams L et al (2021) Deep learning for detection of radiographic sacroiliitis: achieving expert-level performance. Arthritis Res Ther 23:1–10. https://doi.org/10.1186/s13075-021-02484-0
doi: 10.1186/s13075-021-02484-0
Castro-Zunti R, Park EH, Choi Y et al (2020) Early detection of ankylosing spondylitis using texture features and statistical machine learning, and deep learning, with some patient age analysis. Comput Med Imaging Graph 82:101718. https://doi.org/10.1016/j.compmedimag.2020.101718
Chan J, Sari I, Salonen D et al (2016) Development of a screening tool for the identification of sacroiliitis in computed tomography scans of the abdomen. J Rheumatol 43:1687–1694. https://doi.org/10.3899/jrheum.150939
doi: 10.3899/jrheum.150939
pubmed: 27422894