Scanner agnostic large-scale evaluation of MS lesion delineation tool for clinical MRI.

automatic segmentation algorithm clinical applicability clinical dataset heterogeneous dataset multi-scanner multiple sclerosis white matter lesions (WML)

Journal

Frontiers in neuroscience
ISSN: 1662-4548
Titre abrégé: Front Neurosci
Pays: Switzerland
ID NLM: 101478481

Informations de publication

Date de publication:
2023
Historique:
received: 01 03 2023
accepted: 05 05 2023
medline: 5 6 2023
pubmed: 5 6 2023
entrez: 5 6 2023
Statut: epublish

Résumé

Patients with MS are MRI scanned continuously throughout their disease course resulting in a large manual workload for radiologists which includes lesion detection and size estimation. Though many models for automatic lesion segmentation have been published, few are used broadly in clinic today, as there is a lack of testing on clinical datasets. By collecting a large, heterogeneous training dataset directly from our MS clinic we aim to present a model which is robust to different scanner protocols and artefacts and which only uses MRI modalities present in routine clinical examinations. We retrospectively included 746 patients from routine examinations at our MS clinic. The inclusion criteria included acquisition at one of seven different scanners and an MRI protocol including 2D or 3D T2-w FLAIR, T2-w and T1-w images. Reference lesion masks on the training ( We found that our model was able to segment MS white matter lesions with a performance comparable to literature: DSC = 0.68, precision = 0.90, recall = 0.70, f1 = 0.78. Furthermore, the model outperformed HD-MS-Lesions in all metrics except precision = 0.96. In the leave-one-scanner-out experiment there was no significant change in performance ( In conclusion we have seen, that by including a large, heterogeneous dataset emulating clinical reality, we have trained a segmentation model which maintains a high segmentation performance while being robust to data from unseen scanners. This broadens the applicability of the model in clinic and paves the way for clinical implementation.

Identifiants

pubmed: 37274207
doi: 10.3389/fnins.2023.1177540
pmc: PMC10235534
doi:

Types de publication

Journal Article

Langues

eng

Pagination

1177540

Informations de copyright

Copyright © 2023 Hindsholm, Andersen, Cramer, Simonsen, Askløf, Magyari, Madsen, Hansen, Sellebjerg, Larsson, Langkilde, Frederiksen, Højgaard, Ladefoged and Lindberg.

Déclaration de conflit d'intérêts

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Références

Lancet Neurol. 2018 Feb;17(2):162-173
pubmed: 29275977
Neuroimage. 2021 Jan 15;225:117471
pubmed: 33099007
Clin Neuroradiol. 2015 Oct;25 Suppl 2:157-65
pubmed: 26198879
Neuroimage Clin. 2021;31:102769
pubmed: 34333270
Nat Rev Neurol. 2020 Mar;16(3):171-182
pubmed: 32094485
Neuroimage Clin. 2019;23:101918
pubmed: 31491827
Mult Scler Relat Disord. 2022 Nov;67:104187
pubmed: 36150263
Sci Rep. 2020 Dec 3;10(1):21038
pubmed: 33273676
Comput Med Imaging Graph. 2018 Dec;70:83-100
pubmed: 30326367
Sci Rep. 2018 Sep 12;8(1):13650
pubmed: 30209345
Neuroimage. 2019 Aug 1;196:1-15
pubmed: 30953833
Eur Radiol. 2020 Apr;30(4):2356-2364
pubmed: 31900702
Med Image Comput Comput Assist Interv. 2009;12(Pt 2):584-91
pubmed: 20426159
Neuroimage Clin. 2016 Nov 20;13:264-270
pubmed: 28018853
Mult Scler. 2021 Sep;27(10):1533-1542
pubmed: 33215557
Neurotherapeutics. 2017 Oct;14(4):952-960
pubmed: 28653282
Neuroimage. 2012 Feb 15;59(4):3774-83
pubmed: 22119648
Med Phys. 2023 Sep 30;:
pubmed: 37776263
Med Image Anal. 2020 Dec;66:101714
pubmed: 33007638
Neuroimage Clin. 2019;21:101638
pubmed: 30555005
Med Image Anal. 2001 Jun;5(2):143-56
pubmed: 11516708
PLoS One. 2017 Apr 5;12(4):e0174866
pubmed: 28379999
Mult Scler. 2020 Sep;26(10):1217-1226
pubmed: 31190607
Hum Brain Mapp. 2019 Dec 1;40(17):4952-4964
pubmed: 31403237
Med Image Anal. 2023 Apr;85:102762
pubmed: 36738650
Brain Behav. 2021 Jan;11(1):e01921
pubmed: 33128351
Neuroimage. 2002 Oct;17(2):825-41
pubmed: 12377157
Clin Neuroradiol. 2022 Sep;32(3):643-653
pubmed: 34542644
Neuroimage. 2017 Mar 1;148:77-102
pubmed: 28087490
Sci Rep. 2021 Jan 13;11(1):1087
pubmed: 33441684
Data Brief. 2017 Apr 08;12:346-350
pubmed: 28491937
Med Image Anal. 2022 Feb;76:102312
pubmed: 34894571
N Engl J Med. 2018 Jan 11;378(2):169-180
pubmed: 29320652
Comput Biol Med. 2021 Sep;136:104697
pubmed: 34358994
JAMA Neurol. 2013 Mar 1;70(3):338-44
pubmed: 23599930
Front Neuroinform. 2020 Nov 20;14:610967
pubmed: 33328949
Neuroimage Clin. 2020;28:102445
pubmed: 33038667
J Neurol Neurosurg Psychiatry. 2013 Oct;84(10):1082-91
pubmed: 23524331
Neuroimage Clin. 2020;27:102335
pubmed: 32663798
Neuroimage Clin. 2021;31:102707
pubmed: 34111718
Neuroimage. 2006 Jul 1;31(3):1116-28
pubmed: 16545965

Auteurs

Amalie Monberg Hindsholm (AM)

Department of Clinical Physiology and Nuclear Medicine, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Flemming Littrup Andersen (FL)

Department of Clinical Physiology and Nuclear Medicine, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Stig Præstekjær Cramer (SP)

Department of Clinical Physiology and Nuclear Medicine, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Helle Juhl Simonsen (HJ)

Department of Clinical Physiology and Nuclear Medicine, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Mathias Gæde Askløf (MG)

Department of Clinical Physiology and Nuclear Medicine, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Melinda Magyari (M)

Department of Neurology, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Poul Nørgaard Madsen (PN)

Center for IT and Medical Technology, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Adam Espe Hansen (AE)

Department of Radiology, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.
Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark.

Finn Sellebjerg (F)

Department of Neurology, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.
Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark.

Henrik Bo Wiberg Larsson (HBW)

Department of Clinical Physiology and Nuclear Medicine, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.
Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark.

Annika Reynberg Langkilde (AR)

Department of Radiology, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Jette Lautrup Frederiksen (JL)

Department of Neurology, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.
Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark.

Liselotte Højgaard (L)

Department of Clinical Physiology and Nuclear Medicine, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.
Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark.

Claes Nøhr Ladefoged (CN)

Department of Clinical Physiology and Nuclear Medicine, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Ulrich Lindberg (U)

Department of Clinical Physiology and Nuclear Medicine, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark.

Classifications MeSH