Automated ASPECTS calculation may equal the performance of experienced clinicians: a machine learning study based on a large cohort.
Ischemic stroke
Machine learning
Sensitivity and specificity
Tomography
Journal
European radiology
ISSN: 1432-1084
Titre abrégé: Eur Radiol
Pays: Germany
ID NLM: 9114774
Informations de publication
Date de publication:
01 Sep 2023
01 Sep 2023
Historique:
received:
11
11
2022
accepted:
22
06
2023
revised:
15
05
2023
medline:
2
9
2023
pubmed:
2
9
2023
entrez:
1
9
2023
Statut:
aheadofprint
Résumé
The Alberta Stroke Program Early CT Score (ASPECTS) is a semi-quantitative method to evaluate the severity of early ischemic change on non-contrast computed tomography (NCCT) in patients with acute ischemic stroke (AIS). In this work, we propose an automated ASPECTS method based on large cohort of data and machine learning. For this study, we collected 3626 NCCT cases from multiple centers and annotated directly on this dataset by neurologists. Based on image analysis and machine learning methods, we constructed a two-stage machine learning model. The validity and reliability of this automated ASPECTS method were tested on an independent external validation set of 300 cases. Statistical analyses on the total ASPECTS, dichotomized ASPECTS, and region-level ASPECTS were presented. On an independent external validation set of 300 cases, for the total ASPECTS results, the intraclass correlation coefficient between automated ASPECTS and expert-rated was 0.842. The agreement between ASPECTS threshold of ≥ 6 versus < 6 using a dichotomized method was moderate (κ = 0.438, 0.391-0.477), and the detection rate (sensitivity) was 86.5% for patients with ASPECTS threshold of ≥ 6. Compared with the results of previous studies, our method achieved a slight lead in sensitivity (67.8%) and AUC (0.845), with comparable accuracy (78.9%) and specificity (81.2%). The proposed automated ASPECTS method driven by a large cohort of NCCT images performed equally well compared with expert-rated ASPECTS. This work further demonstrates the validity and reliability of automated ASPECTS evaluation method. The automated ASPECTS method proposed by this study may help AIS patients to receive rapid intervention, but should not be used as a stand-alone diagnostic basis. NCCT-based manual ASPECTS scores were poorly consistent. Machine learning can automate the ASPECTS scoring process. Machine learning model design based on large cohort data can effectively improve the consistency of ASPECTS scores.
Identifiants
pubmed: 37658137
doi: 10.1007/s00330-023-10053-z
pii: 10.1007/s00330-023-10053-z
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Informations de copyright
© 2023. The Author(s), under exclusive licence to European Society of Radiology.
Références
Van der Worp HB, Van Gijn J (2007) Acute ischemic stroke. N Engl J Med 357(6):572–579
doi: 10.1056/NEJMcp072057
pubmed: 17687132
Xing L, Jing L, Tian Y et al (2020) High prevalence of stroke and uncontrolled associated risk factors are major public health challenges in rural northeast China: a population-based study. Int J Stroke 15(4):399–411
doi: 10.1177/1747493019851280
pubmed: 31092151
Demeestere J, Scheldeman L, Cornelissen SA et al (2018) Alberta stroke program early CT score versus computed tomographic perfusion to predict functional outcome after successful reperfusion in acute ischemic stroke. Stroke 49(10):2361–2367
doi: 10.1161/STROKEAHA.118.021961
pubmed: 30355098
pmcid: 6207080
Barber PA, Demchuk AM, Zhang J, Buchan AM (2000) Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. Lancet 355(9216):1670–1674
doi: 10.1016/S0140-6736(00)02237-6
pubmed: 10905241
Kim JG, Lee D, Choi JC, Song Y, Lee DH, Suh DC (2019) DWI-pc-ASPECT score in basilar artery occlusion: is 6 points or less always indicative of a bad outcome? Interv Neuroradiol 25(4):371–379
doi: 10.1177/1591019919827505
pubmed: 30803336
pmcid: 6607617
Finlayson O, John V, Yeung R et al (2013) Interobserver agreement of ASPECT score distribution for noncontrast CT, CT angiography, and CT perfusion in acute stroke. Stroke 44(1):234–236
doi: 10.1161/STROKEAHA.112.665208
pubmed: 23103490
Kuang H, Najm M, Chakraborty D et al (2019) Automated ASPECTS on noncontrast CT scans in patients with acute ischemic stroke using machine learning. AJNR Am J Neuroradiol 40(1):33–38
doi: 10.3174/ajnr.A5889
pubmed: 30498017
pmcid: 7048586
Maegerlein C, Fischer J, Mönch S et al (2019) Automated calculation of the Alberta Stroke Program Early CT Score: feasibility and reliability. Radiology 291(1):141–148
doi: 10.1148/radiol.2019181228
pubmed: 30720400
Sundaram VK, Goldstein J, Wheelwright D et al (2019) Automated ASPECTS in acute ischemic stroke: a comparative analysis with CT perfusion. AJNR Am J Neuroradiol 40(12):2033–2038
pubmed: 31727750
pmcid: 6975365
Cao Z, Xu J, Song B et al (2022) Deep learning derived automated ASPECTS on non-contrast CT scans of acute ischemic stroke patients. Hum Brain Mapp 43(10):3023–3036
doi: 10.1002/hbm.25845
pubmed: 35357053
pmcid: 9189036
Guberina N, Dietrich U, Radbruch A et al (2018) Detection of early infarction signs with machine learning-based diagnosis by means of the Alberta Stroke Program Early CT Score (ASPECTS) in the clinical routine. Neuroradiology 60:889–901
doi: 10.1007/s00234-018-2066-5
pubmed: 30066278
Nagel S, Sinha D, Day D et al (2017) e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 12(6):615–622
doi: 10.1177/1747493016681020
pubmed: 27899743
Li L, Chen Y, Bao Y et al (2020) Comparison of the performance between Frontier ASPECTS software and different levels of radiologists on assessing CT examinations of acute ischemic stroke patients. Clin Radiol 75(5):358–365
doi: 10.1016/j.crad.2019.12.010
pubmed: 31973944
Qiu W, Kuang H, Teleg E et al (2020) Machine learning for detecting early infarction in acute stroke with non–contrast-enhanced CT. Radiology 294(3):638–644
doi: 10.1148/radiol.2020191193
pubmed: 31990267
Herweh C, Ringleb PA, Rauch G et al (2016) Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 11(4):438–445
doi: 10.1177/1747493016632244
pubmed: 26880058
Brinjikji W, Abbasi M, Arnold C et al (2021) e-ASPECTS software improves interobserver agreement and accuracy of interpretation of aspects score. Interv Neuroradiol 27(6):781–787
doi: 10.1177/15910199211011861
pubmed: 33853441
pmcid: 8673896
Adamou A, Beltsios ET, Bania A et al (2022) Artificial intelligence-driven ASPECTS for the detection of early stroke changes in non-contrast CT: a systematic review and meta-analysis. J Neurointerv Surg 0:1–7
Hoopes A, Mora JS, Dalca AV, Fischl B, Hoffmann M (2022) SynthStrip: skull-stripping for any brain image. Neuroimage 260:119474
doi: 10.1016/j.neuroimage.2022.119474
pubmed: 35842095
Dong X, Yu Z, Cao W, Shi Y, Ma Q (2020) A survey on ensemble learning. Front Comput Sci 14:241–258
doi: 10.1007/s11704-019-8208-z
Chen T, Guestrin C (2016) XGBoost: a scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining 2016: 785-794
Wolff L, Berkhemer OA, Van Es AC et al (2021) Validation of automated Alberta Stroke Program Early CT Score (ASPECTS) software for detection of early ischemic changes on non-contrast brain CT scans. Neuroradiology 63:491–498
doi: 10.1007/s00234-020-02533-6
pubmed: 32857212
Chen W, Wu J, Wei R et al (2022) Improving the diagnosis of acute ischemic stroke on non-contrast CT using deep learning: a multicenter study. Insights Imaging 13(1):1–12
doi: 10.1186/s13244-022-01331-3
Hoelter P, Muehlen I, Goelitz P, Beuscher V, Schwab S, Doerfler A (2020) Automated ASPECT scoring in acute ischemic stroke: comparison of three software tools. Neuroradiology 62:1231–1238
doi: 10.1007/s00234-020-02439-3
pubmed: 32382795
Delio PR, Wong ML, Tsai JP et al (2021) Assistance from automated ASPECTS software improves reader performance. J Stroke Cerebrovasc Dis 30(7):105829
doi: 10.1016/j.jstrokecerebrovasdis.2021.105829
pubmed: 33989968
Albers GW, Wald MJ, Mlynash M et al (2019) Automated calculation of Alberta Stroke Program Early CT Score: validation in patients with large hemispheric infarct. Stroke 50(11):3277–3279
doi: 10.1161/STROKEAHA.119.026430
pubmed: 31500555
Kuang H, Menon BK, Sohn SI, Qiu W (2021) EIS-Net: segmenting early infarct and scoring ASPECTS simultaneously on non-contrast CT of patients with acute ischemic stroke. Med Image Anal 70:101984
doi: 10.1016/j.media.2021.101984
pubmed: 33676101
Aljabar P, Heckemann RA, Hammers A, Hajnal JV, Rueckert D (2009) Multi-atlas based segmentation of brain images: atlas selection and its effect on accuracy. Neuroimage 46(3):726–738
doi: 10.1016/j.neuroimage.2009.02.018
pubmed: 19245840