Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis.

ARTIFICIAL INTELLIGENCE COST-EFFECTIVENESS ANALYSIS ISCHEMIC STROKE DIAGNOSIS LARGE VESSEL OCCLUSION DETECTION MACHINE LEARNING SYSTEMATIC REVIEW

Journal

Health technology assessment (Winchester, England)

ISSN: 2046-4924

Titre abrégé: Health Technol Assess

Pays: England

ID NLM: 9706284

Informations de publication

Date de publication:
Mar 2024

Historique:

medline: 21 3 2024

pubmed: 21 3 2024

entrez: 21 3 2024

Statut: ppublish

Résumé

Artificial intelligence-derived software technologies have been developed that are intended to facilitate the review of computed tomography brain scans in patients with suspected stroke. To evaluate the clinical and cost-effectiveness of using artificial intelligence-derived software to support review of computed tomography brain scans in acute stroke in the National Health Service setting. Twenty-five databases were searched to July 2021. The review process included measures to minimise error and bias. Results were summarised by research question, artificial intelligence-derived software technology and study type. The health economic analysis focused on the addition of artificial intelligence-derived software-assisted review of computed tomography angiography brain scans for guiding mechanical thrombectomy treatment decisions for people with an ischaemic stroke. The de novo model (developed in R Shiny, R Foundation for Statistical Computing, Vienna, Austria) consisted of a decision tree (short-term) and a state transition model (long-term) to calculate the mean expected costs and quality-adjusted life-years for people with ischaemic stroke and suspected large-vessel occlusion comparing artificial intelligence-derived software-assisted review to usual care. A total of 22 studies (30 publications) were included in the review; 18/22 studies concerned artificial intelligence-derived software for the interpretation of computed tomography angiography to detect large-vessel occlusion. No study evaluated an artificial intelligence-derived software technology used as specified in the inclusion criteria for this assessment. For artificial intelligence-derived software technology alone, sensitivity and specificity estimates for proximal anterior circulation large-vessel occlusion were 95.4% (95% confidence interval 92.7% to 97.1%) and 79.4% (95% confidence interval 75.8% to 82.6%) for Rapid (iSchemaView, Menlo Park, CA, USA) computed tomography angiography, 91.2% (95% confidence interval 77.0% to 97.0%) and 85.0 (95% confidence interval 64.0% to 94.8%) for Viz LVO (Viz.ai, Inc., San Fransisco, VA, USA) large-vessel occlusion, 83.8% (95% confidence interval 77.3% to 88.7%) and 95.7% (95% confidence interval 91.0% to 98.0%) for Brainomix (Brainomix Ltd, Oxford, UK) e-computed tomography angiography and 98.1% (95% confidence interval 94.5% to 99.3%) and 98.2% (95% confidence interval 95.5% to 99.3%) for Avicenna CINA (Avicenna AI, La Ciotat, France) large-vessel occlusion, based on one study each. These studies were not considered appropriate to inform cost-effectiveness modelling but formed the basis by which the accuracy of artificial intelligence plus human reader could be elicited by expert opinion. Probabilistic analyses based on the expert elicitation to inform the sensitivity of the diagnostic pathway indicated that the addition of artificial intelligence to detect large-vessel occlusion is potentially more effective (quality-adjusted life-year gain of 0.003), more costly (increased costs of £8.61) and cost-effective for willingness-to-pay thresholds of £3380 per quality-adjusted life-year and higher. The available evidence is not suitable to determine the clinical effectiveness of using artificial intelligence-derived software to support the review of computed tomography brain scans in acute stroke. The economic analyses did not provide evidence to prefer the artificial intelligence-derived software strategy over current clinical practice. However, results indicated that if the addition of artificial intelligence-derived software-assisted review for guiding mechanical thrombectomy treatment decisions increased the sensitivity of the diagnostic pathway (i.e. reduced the proportion of undetected large-vessel occlusions), this may be considered cost-effective. Large, preferably multicentre, studies are needed (for all artificial intelligence-derived software technologies) that evaluate these technologies as they would be implemented in clinical practice. This study is registered as PROSPERO CRD42021269609. This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR133836) and is published in full in Stroke is a serious life-threatening medical condition caused by a blood clot or haemorrhage in the brain. Quick and effective management, including a brain scan, of the patients with suspected stroke can make a big difference in their outcome. Artificial intelligence-derived computer programmes exist that are intended to help with the interpretation of computed tomography scans of the brain in stroke. We undertook a thorough review of the existing research into the effectiveness and value for money of using these programmes to help doctors and other specialists to interpret computed tomography brain scans. We found very little evidence to tell us how well artificial intelligence-derived computer programmes work in practice. Some studies have looked at artificial intelligence-derived computer programmes on their own (i.e. not taken together with a doctor’s judgement, as they were designed to be used). Other studies have looked at what happens to patients who are treated for stroke when artificial intelligence-derived computer programmes are used; these studies provide no information about whether using artificial intelligence-derived computer programmes may have led to patients who could have benefitted from treatment being missed. It is unclear how well artificial intelligence-derived software-assisted review works when added to current clinical practice.

Sections du résumé

Background UNASSIGNED

Artificial intelligence-derived software technologies have been developed that are intended to facilitate the review of computed tomography brain scans in patients with suspected stroke.

Objectives UNASSIGNED

To evaluate the clinical and cost-effectiveness of using artificial intelligence-derived software to support review of computed tomography brain scans in acute stroke in the National Health Service setting.

Methods UNASSIGNED

Twenty-five databases were searched to July 2021. The review process included measures to minimise error and bias. Results were summarised by research question, artificial intelligence-derived software technology and study type. The health economic analysis focused on the addition of artificial intelligence-derived software-assisted review of computed tomography angiography brain scans for guiding mechanical thrombectomy treatment decisions for people with an ischaemic stroke. The de novo model (developed in R Shiny, R Foundation for Statistical Computing, Vienna, Austria) consisted of a decision tree (short-term) and a state transition model (long-term) to calculate the mean expected costs and quality-adjusted life-years for people with ischaemic stroke and suspected large-vessel occlusion comparing artificial intelligence-derived software-assisted review to usual care.

Results UNASSIGNED

A total of 22 studies (30 publications) were included in the review; 18/22 studies concerned artificial intelligence-derived software for the interpretation of computed tomography angiography to detect large-vessel occlusion. No study evaluated an artificial intelligence-derived software technology used as specified in the inclusion criteria for this assessment. For artificial intelligence-derived software technology alone, sensitivity and specificity estimates for proximal anterior circulation large-vessel occlusion were 95.4% (95% confidence interval 92.7% to 97.1%) and 79.4% (95% confidence interval 75.8% to 82.6%) for Rapid (iSchemaView, Menlo Park, CA, USA) computed tomography angiography, 91.2% (95% confidence interval 77.0% to 97.0%) and 85.0 (95% confidence interval 64.0% to 94.8%) for Viz LVO (Viz.ai, Inc., San Fransisco, VA, USA) large-vessel occlusion, 83.8% (95% confidence interval 77.3% to 88.7%) and 95.7% (95% confidence interval 91.0% to 98.0%) for Brainomix (Brainomix Ltd, Oxford, UK) e-computed tomography angiography and 98.1% (95% confidence interval 94.5% to 99.3%) and 98.2% (95% confidence interval 95.5% to 99.3%) for Avicenna CINA (Avicenna AI, La Ciotat, France) large-vessel occlusion, based on one study each. These studies were not considered appropriate to inform cost-effectiveness modelling but formed the basis by which the accuracy of artificial intelligence plus human reader could be elicited by expert opinion. Probabilistic analyses based on the expert elicitation to inform the sensitivity of the diagnostic pathway indicated that the addition of artificial intelligence to detect large-vessel occlusion is potentially more effective (quality-adjusted life-year gain of 0.003), more costly (increased costs of £8.61) and cost-effective for willingness-to-pay thresholds of £3380 per quality-adjusted life-year and higher.

Limitations and conclusions UNASSIGNED

The available evidence is not suitable to determine the clinical effectiveness of using artificial intelligence-derived software to support the review of computed tomography brain scans in acute stroke. The economic analyses did not provide evidence to prefer the artificial intelligence-derived software strategy over current clinical practice. However, results indicated that if the addition of artificial intelligence-derived software-assisted review for guiding mechanical thrombectomy treatment decisions increased the sensitivity of the diagnostic pathway (i.e. reduced the proportion of undetected large-vessel occlusions), this may be considered cost-effective.

Future work UNASSIGNED

Large, preferably multicentre, studies are needed (for all artificial intelligence-derived software technologies) that evaluate these technologies as they would be implemented in clinical practice.

Study registration UNASSIGNED

This study is registered as PROSPERO CRD42021269609.

Funding UNASSIGNED

This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR133836) and is published in full in

Stroke is a serious life-threatening medical condition caused by a blood clot or haemorrhage in the brain. Quick and effective management, including a brain scan, of the patients with suspected stroke can make a big difference in their outcome. Artificial intelligence-derived computer programmes exist that are intended to help with the interpretation of computed tomography scans of the brain in stroke. We undertook a thorough review of the existing research into the effectiveness and value for money of using these programmes to help doctors and other specialists to interpret computed tomography brain scans. We found very little evidence to tell us how well artificial intelligence-derived computer programmes work in practice. Some studies have looked at artificial intelligence-derived computer programmes on their own (i.e. not taken together with a doctor’s judgement, as they were designed to be used). Other studies have looked at what happens to patients who are treated for stroke when artificial intelligence-derived computer programmes are used; these studies provide no information about whether using artificial intelligence-derived computer programmes may have led to patients who could have benefitted from treatment being missed. It is unclear how well artificial intelligence-derived software-assisted review works when added to current clinical practice.

Autres résumés

Type: plain-language-summary (eng)

Identifiants

DOI: 10.3310/RDPA1487 PMID: 38512017

pubmed: 38512017

doi: 10.3310/RDPA1487

doi:

Types de publication

Systematic Review

Langues

eng

Sous-ensembles de citation

Pagination

1-204

Références

National Institute for Health and Care Excellence. Stroke in Adults. NICE Quality Standard QS2. London: National Institute for Health and Care Excellence; 2016. URL: www.nice.org.uk/guidance/qs2 (accessed 25 May 2021).

Campbell BCV, Khatri PS. Stroke. Lancet 2020;396:129–42.

Sentinel Stroke National Audit Programme. SSNAP Annual Portfolio for April 2019–March 2020 Admissions and Discharges: National Results. London: King’s College London; 2020. URL: www.strokeaudit.org/Results2/Clinical-audit/National-Results.aspx (accessed 25 May 2021).

Sentinel Stroke National Audit Programme. Springboard for Progress: The Seventh SSNAP Annual Report. Stroke Care Received for Patients Admitted to Hospital Between April 2019 to March 2020. London: King’s College London; 2020. URL: www.strokeaudit.org/Results2/Clinical-audit/National-Results.aspx> (accessed 25 May 2021).

Stroke Association. Stroke Statistics. Northampton: Stroke Association; n.d. URL: www.stroke.org.uk/what-is-stroke/stroke-statistics#Stroke%20prevalence%20in%20England (accessed 25 May 2021).

Hurford R, Sekhar A, Hughes TAT, Muir KW. Diagnosis and management of acute ischaemic stroke. Pract Neurol 2020;20(4):304–16.

National Institute for Health and Care Excellence. Stroke and Transient Ischaemic Attack in Over 16s: Diagnosis and Initial Management. NICE Guideline NG128. London: National Institute for Health and Care Excellence; 2019. URL: www.nice.org.uk/guidance/ng128 (accessed 25 May 2021).

Nor AM, Davis J, Sen B, Shipsey D, Louw SJ, Dyker AG, et al. The Recognition of Stroke in the Emergency Room (ROSIER) scale: development and validation of a stroke recognition instrument. Lancet Neurol 2005;4(11):727–34.

Wang C, Wang W, Ji J, Wang J, Zhang R, Wang Y. Safety of intravenous thrombolysis in stroke of unknown time of onset: a systematic review and meta-analysis. J Thromb Thrombolysis 2021;52:1173–81.

National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. Tissue plasminogen activator for acute ischaemic stroke. N Engl J Med 1995;333(24):1581–7.

Tawil SE, Muir KW. Thrombolysis and thrombectomy for acute ischaemic stroke. Clin Med (Lond) 2017;17(2):161–5.

Goyal M, Menon BK, van Zwam WH, Dippel DW, Mitchell PJ, Demchuk AM, et al., HERMES collaborators. Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet 2016;387(10029):1723–31.

Vidale S, Romoli M, Clemente Agostoni E. Mechanical thrombectomy with or without thrombolysis: a meta-analysis of RCTs. Acta Neurol Scand 2021;143(5):554–7.

Royal College of Radiologists. RCR Position Statement on Artificial Intelligence. London: Royal College of Radiologists; 2018. URL: www.rcr.ac.uk/posts/rcr-position-statement-artificial-intelligence#:~:text=The%20RCR%20believes%20that%20AI,technologies%20to%20enhance%20clinical%20practice (accessed 25 May 2021).

Royal College of Radiologists. Integrating Artificial Intelligence with the Radiology Reporting Workflows (RIS and PACS). London: Royal College of Radiologists; 2021. URL: www.rcr.ac.uk/publication/integrating-artificial-intelligence-radiology-reporting-workflows-ris-and-pacs (accessed 21 May 2021).

National Institute for Health and Care Excellence. Artificial Intelligence for Analysing CT Brain Scans. NICE Medtech Innovation Briefing MIB207. London: National Institute for Health and Care Excellence; 2020. URL: www.nice.org.uk/guidance/mib207 (accessed 25 May 2021).

NHS England. The NHS Long Term Plan. London: NHS England; 2019. URL: www.longtermplan.nhs.uk (accessed 22 June 2021).

NHS England. National Stroke Service Model: Integrated Stroke Delivery Networks. London: NHS England; 2021. 42pp. URL: www.england.nhs.uk/publication/national-stroke-service-model-integrated-stroke-delivery-networks (accessed 22 June 2021).

National Institute for Health and Care Excellence. Alteplase for Treating Acute Ischaemic Stroke. Technology Appraisal Guidance TA264. London: National Institute for Health and Care Excellence; 2012. URL: www.nice.org.uk/guidance/ta264 (accessed 24 May 2021).

National Institute for Health and Care Excellence. Mechanical Clot Retrieval for Treating Acute Ischaemic Stroke. Interventional Procedures Guidance IPG548. London: National Institute for Health and Care Excellence; 2016. URL: www.nice.org.uk/guidance/ipg548 (accessed 25 May 2021).

Ford G, James M, White P, editors. Mechanical Thrombectomy for Acute Ischaemic Stroke: An Implementation Guide for the UK. Oxford: Oxford Academic Health Science Network; 2019. URL: www.oxfordahsn.org/our-work/our-programmes/adopting-innovation/cardiovascular-disease/mt-guide/#:~:text=In%20February%202022%20the%20editors,cardiology%20and%20stroke%20service%20reorganisations (accessed 7 December 2021).

Centre for Reviews and Dissemination. Systematic Reviews: CRD’s Guidance for Undertaking Reviews in Health Care. York: Centre for Reviews and Dissemination, University of York; 2009. URL: www.york.ac.uk/inst/crd/SysRev/!SSL!/WebHelp/SysRev3.htm (accessed 23 March 2021).

National Institute for Health and Care Excellence. Diagnostics Assessment Programme Manual. London: National Institute for Health and Care Excellence; 2011. URL: www.nice.org.uk/about/what-we-do/our-programmes/nice-guidance/nice-diagnostics-guidance (accessed 25 May 2021).

Cochrane Diagnostic Test Accuracy Working Group. Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy. London: Cochrane Collaboration; 2009. URL: https://methods.cochrane.org/sdt/handbook-dta-reviews (accessed 25 March 2021).

McGowan J, Sampson M, Lefebvre C. An evidence based checklist for the peer review of electronic search strategies (PRESS EBC). Evid Based Libr Inf Pract 2010;5(1):1–6.

Cold Spring Harbor Laboratory, BMJ, Yale University. medRxiv. URL: www.medrxiv.org (accessed 29 September 2021).

Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al., QUADAS-2 Group. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011;155(8):529–36.

Reitsma JB, Glas AS, Rutjes AWS, Scholten RJPM, Bossuyt PMM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol 2005;58(10):982–90.

Harbord RM, Whiting P, Sterne JA, Egger M, Deeks JJ, Shang A, Bachmann LM. An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary. J Clin Epidemiol 2008;61(11):1095–103.

Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA. A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics 2007;8(2):239–51.

Acharya UR, Sree SV, Mookiah MR, Saba L, Gao H, Mallarini G, Suri JS. Computed tomography carotid wall plaque characterization using a combination of discrete wavelet transform and texture features: a pilot study. Proc Inst Mech Eng H 2013;227(6):643–54.

Cirio JJ, Ciardi C, Buezas M, Diluca P, Caballero ML, Lopez M, et al. Implementation of artificial intelligence in hyperacute arterial reperfusion treatment in a comprehensive stroke center. Neurol Argent 2021;13(4):212–20. https://doi.org/10.1016/j.neuarg.2021.07.003

Adhya J, Li C, Eisenmenger L, Cerejo R, Tayal A, Goldberg M, et al. Positive predictive value and stroke workflow outcomes using automated vessel density (RAPID-CTA) in stroke patients: one year experience. Neuroradiol J 2021;34:476–81. https://dx.doi.org/10.1177/19714009211012353

Al-Kawaz M, Primiani C, Urrutia V, Hui F. Impact of RapidAI mobile application on treatment times in patients with large-vessel occlusion. J Neurointerv Surg 2022;14:233–6.

Amukotuwa SA, Straka M, Dehkharghani S, Bammer R. Fast automatic detection of large-vessel occlusions on CT angiography. Stroke 2019;50(12):3431–8.

Amukotuwa SA, Straka M, Smith H, Chandra RV, Dehkharghani S, Fischbein NJ, Bammer R. Automated detection of intracranial large-vessel occlusions on computed tomography angiography: a single center experience. Stroke 2019;50(10):2790–8.

Barreira CM, Bouslama M, Haussen DC, Grossberg JA, Baxter B, Devlin T, et al. Automated large artery occlusion detection in stroke imaging-aladin study. Presented at American Heart Association/American Stroke Association 2018 International Stroke Conference and State-of-the-Science Stroke Nursing Symposium; 24–26 Jan 2018; Los Angeles. Stroke 2018;49(Suppl. 1):WP61.

Rodrigues GM, Barreira C, Froehler M, Baxter B, Devlin T, Lim J, et al. Multicenter ALADIN: automated large artery occlusion detection in stroke imaging using artificial intelligence. Presented at the International Stroke Conference; 6–8 February 2019; Honolulu (HI). Stroke 2019;50(Suppl. 1):WP71.

Barreira CM, Rahman HA, Bouslama M, Al-Bayati AR, Haussen DC, Grossberg JA, et al. Advance study: automated detection and volumetric assessment of intracerebral hemorrhage. Presented at 4th European Stroke Organisation Conference, ESOC 2018; Goteborg, Sweden. Eur Stroke J 2018;3(1 Suppl. 1):449.

Chatterjee A, Johnson C, Harvin A, Mullin P. Artificial intelligence detection of cerebrovascular large-vessel occlusion - VIZ algorithm diagnostic accuracy and clinical notification times in a retrospective evaluation, American Society of Neuroradiology Annual Meeting, Vancouver (BC), 2–7 June 2018.

Dehkharghani S, Lansberg M, Venkatsubramanian C, Cereda C, Lima F, Coelho H, et al. High-performance automated anterior circulation CT angiographic clot detection in acute stroke: a multireader comparison. Radiology 2021;298(3):665–70.

Dehkharghani S, Lansberg MG, Venkatsubramanian C, Cereda CW, Lima FO, Coelho H, et al. Rapid-LVO for automated detection of intracranial large-vessel occlusion in CT angiography of the brain. Presented at International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1):P337.

Dornbos D, Hoit D, Inoa-Acosta V, Nickele C, Arthur A, Elijovich L. Automated large-vessel occlusion by artificial intelligence improves stroke workflow metrics: 1st 100 patient experience in a hub and spoke stroke system. Presented at the 17th Annual Meeting of the Society of NeuroInterventional Surgery Congress; 4–7 August 2020; San Diego (CA). J Neurointerv Surg 2020;12(Suppl. 1):A50.

Gunda B, Sipos I, Stang R, Bojti P, Kis B, Harston G. Improved stroke care in a primary stroke centre using aidecision support. Presented at 12th World Stroke Congress; 12–15 May 2020; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):107.

Hassan AE, Ringheanu VM, Preston L, Tekle W. CSC implementation of artificial intelligence software significantly improves door-in to groin puncture time interval and recanalization rates. Poster presented at International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1):AP248.

Hassan AE, Ringheanu VM, Rabah RR, Preston L, Tekle WG, Qureshi AI. Early experience utilizing artificial intelligence shows significant reduction in transfer times and length of stay in a hub and spoke model. Interv Neuroradiol 2020;26(5):615–22.

Hassan AE, Ringheanu VM, Preston L, Tekle W. The implementation of artificial intelligence significantly reduces door-in door-out times in primary care center prior to transfer. Presented at the International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1):P266.

Herweh C, Mokli Y, Bellot P, Schmitt N, Joly O, Weyland C, et al. AI-based automated detection of intracranial hemorrhage on nonenhanced CT scans. Presented at 12th World Stroke Congress; 12–15 May 2020; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):295.

Kamal H, Abdelhamid N, Zhu L, Sarraj A. Does RAPID reduce groin puncture times in acute ischaemic stroke? Presented at International Stroke Conference; 21–24 February 2017; Houston (TX). Stroke 2017;48(Suppl. 1):TP296.

Kauw F, Heit JJ, Martin BW, van Ommen F, Kappelle LJ, Velthuis BK, et al. Computed tomography perfusion data for acute ischaemic stroke evaluation using rapid software: pitfalls of automated postprocessing. J Comput Assist Tomogr 2020;44(1):75–7.

McLouth J, Elstrott S, Chaibi Y, Quenet S, Chang PD, Chow DS, Soun JE. Validation of a deep learning tool in the detection of intracranial hemorrhage and large-vessel occlusion. Front Neurol 2021;12:656112.

Morey JR, Zhang X, Yaeger KA, Fiano E, Marayati NF, Kellner CP, et al. Real-world experience with artificial intelligence-based triage in transferred large-vessel occlusion stroke patients. Cerebrovasc Dis 2021;50:450–5. https://doi.org/10.1159/000515320

Morey JR, Fiano E, Yaeger KA, Zhang X, Fifi JT. Impact of Viz LVO on time-to-treatment and clinical outcomes in large-vessel occlusion stroke patients presenting to primary stroke centers. medRxiv 2020;2020.07.02.20143834. https://doi.org/10.1101/2020.07.02.20143834

Morey J, Zhang X, Yaeger K, Fiano E, Marayati NF, Kellner CP, et al. Initial real-world experience with VIZ LVO in transferred large-vessel occlusion stroke patients. Poster presented at International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1):AP129.

Paz D, Yagoda D, Wein T. Single site performance of AI software for stroke detection and triage. medRxiv 2021;2021.04.02.21253083. https://doi.org/10.1101/2021.04.02.21253083

Seker F, Pfaff JAR, Mokli Y, Berberich A, Namias R, Gerry S, et al. Diagnostic accuracy of automated occlusion detection in CT angiography using e-CTA [published online ahead of print]. Int J Stroke 2021. https://doi.org/10.1177%2F1747493021992592 (accessed 30 July 2021).

Seker F, Pfaff J, Herweh C, Berberich A, Mokli Y, Mohlenbruch M, et al. Automatic detection of large-vessel occlusion on CTA in acute ischaemic stroke using AI. Presented at the 54th Annual Meeting of the German Society for Neuroradiology and 27th Annual Meeting of the Austrian Society for Neuroradiology; 9–12 October 2019; Frankfurt am. Clin Neuroradiol 2019;29(Suppl. 1):S6.

Seker F, Pfaff J, Moehlenbruch M, Gerry S, Ringleb P, Nagel S, et al. Automatic detection of large-vessel occlusion on CTA in acute ischaemic stroke. Presented at the 5th European Stroke Organisation Conference (ESOC); 22–24 May 2019; Milan (Italy). Eur Stroke J 2019;4(Suppl. 1):413–4.

Yahav-Dovrat A, Saban M, Merhav G, Lankri I, Abergel E, Eran A, et al. Evaluation of artificial intelligence-powered identification of large-vessel occlusions in a comprehensive stroke center. AJNR Am J Neuroradiol 2021;42(2):247–54.

Barreira C, Bouslama M, Lim J, Al-Bayati A, Saleem Y, Devlin T, et al. E-108 Aladin study: automated large artery occlusion detection in stroke imaging study – a multicenter analysis. J Neurointerv Surg 2018;10(Suppl. 2):A101.

Shalitin O, Sudry N, Mates J, Golan D. AI-powered stroke triage system performance in the wild. J Exp Stroke Transl Med 2020;12(3);1–4.

Mair G, White P, Bath PM, Muir KW, Al-Shahi Salman R, Martin C, et al. External validation of Artificial Intelligence software to interpret brain CT in patients with acute stroke. The Real-world Independent Testing of e-ASPECTS Software Study (RITeS). 2021 [PrePrint provided by the author].

Lijmer JG, Mol BW, Heisterkamp S, Bonsel GJ, Prins MH, van der Meulen JH, Bossuyt PM. Empirical evidence of design-related bias in studies of diagnostic tests. JAMA 1999;282(11):1061–6.

Whiting PF, Smidt N, Sterne JA, Harbord R, Burton A, Burke M, et al. Systematic review: accuracy of anti-citrullinated peptide antibodies for diagnosing rheumatoid arthritis. Ann Intern Med 2010;152(7):456–64; W155–66.

Román LS, Menon BK, Blasco J, Hernández-Pérez M, Dávalos A, Majoie CBLM, et al., HERMES Collaborators. Imaging features and safety and efficacy of endovascular stroke treatment: a meta-analysis of individual patient-level data. Lancet Neurol 2018;17:895–904.

Kaltenthaler E, Tappenden P, Paisley S, Squires H. Identifying and Reviewing Evidence to Inform the Conceptualisation and Population of Cost-effectiveness Models. DSU Technical Support Document 13. Sheffield: NICE Decision Support Unit; 2011. URL: www.sheffield.ac.uk/nice-dsu/tsds/full-list (accessed 22 February 2012).

van Leeuwen KG, Meijer FJA, Schalekamp S, Rutten MJCM, van Dijk EJ, van Ginneken B, et al. Cost-effectiveness of artificial intelligence aided vessel occlusion detection in acute stroke: an early health technology assessment. Insights Imaging 2021;12:133.

Drummond MF, Jefferson TO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. The BMJ economic evaluation working party. BMJ 1996;313(7052):275–83.

Hart R, Burns D, Ramaekers B, Ren S, Gladwell D, Sullivan W, et al. R and Shiny for cost-effectiveness analyses: why and when? A hypothetical case study. PharmacoEconomics 2020;38(7):765–76.

Incerti D, Thom H, Baio G, Jansen JP. R you still using excel? The advantages of modern software tools for health technology assessment. Value Health 2019;22(5):575–9.

Alarid-Escudero F, Krijkamp EM, Pechlivanoglou P, Jalal H, Kao SZ, Yang A, Enns EA. A need for change! A coding framework for improving transparency in decision modeling. PharmacoEconomics 2019;37(11):1329–39.

Alarid-Escudero F, Krijkamp E, Enns EA, Yang A, Hunink MGM, Pechlivanoglou P, et al. An Introductory Tutorial on Cohort State-transition Models in R Using a Cost-effectiveness Analysis Example. Med Decision-making 2022;43(1):3–20.

Smith R, Schneider P. Making health economic models Shiny: a tutorial. Wellcome Open Res 2020;5:69.

McMeekin P, White P, James MA, Price CI, Flynn D, Ford GA. Estimating the number of UK stroke patients eligible for endovascular thrombectomy. Eur Stroke J 2017;2(4):319–26.

Grigore B, Peters J, Hyde C, Stein K. EXPLICIT: a feasibility study of remote expert elicitation in health technology assessment. BMC Med Inform Decis Mak 2017;17(1):131.

Bojke L, Claxton K, Bravo-Vergel Y, Sculpher M, Palmer S, Abrams K. Eliciting distributions to populate decision analytic models. Value Health 2010;13(5):557–64.

O’Hagan A, Buck CE, Daneshkhah A, Eiser JR, Garthwaite PH, Jenkinson DJ, et al. Uncertain Judgements: Eliciting Experts’ Probabilities. Hoboken, NJ: Wiley; 2016.

Bojke L, Grigore B, Jankovic D, Peters J, Soares M, Stein K. Informing reimbursement decisions using cost-effectiveness modelling: a guide to the process of generating elicited priors to capture model uncertainties. PharmacoEconomics 2017;35(9):867–77.

Berkhemer OA, Fransen PS, Beumer D, van den Berg LA, Lingsma HF, Yoo AJ, et al., MR CLEAN Investigators. A randomized trial of intraarterial treatment for acute ischaemic stroke. N Engl J Med 2015;372(1):11–20.

Goyal M, Demchuk AM, Menon BK, Eesa M, Rempel JL, Thornton J, et al., ESCAPE Trial Investigators. Randomized assessment of rapid endovascular treatment of ischaemic stroke. N Engl J Med 2015;372(11):1019–30.

Campbell BC, Mitchell PJ, Kleinig TJ, Dewey HM, Churilov L, Yassi N, et al., EXTEND-IA Investigators. Endovascular therapy for ischaemic stroke with perfusion-imaging selection. N Engl J Med 2015;372(11):1009–18.

Saver JL, Goyal M, Bonafe A, Diener HC, Levy EI, Pereira VM, et al., SWIFT PRIME Investigators. Stent-retriever thrombectomy after intravenous t-PA vs. t-PA alone in stroke. N Engl J Med 2015;372(24):2285–95.

Jovin TG, Chamorro A, Cobo E, de Miquel MA, Molina CA, Rovira A, et al., REVASCAT Trial Investigators. Thrombectomy within 8 hours after symptom onset in ischaemic stroke. N Engl J Med 2015;372(24):2296–306.

Bracard S, Ducrocq X, Mas JL, Soudant M, Oppenheim C, Moulin T, Guillemin F, THRACE Investigators. Mechanical thrombectomy after intravenous alteplase versus alteplase alone after stroke (THRACE): a randomised controlled trial. Lancet Neurol 2016;15(11):1138–47.

Muir KW, Ford GA, Messow CM, Ford I, Murray A, Clifton A, et al., PISTE Investigators. Endovascular therapy for acute ischaemic stroke: the Pragmatic Ischaemic Stroke Thrombectomy Evaluation (PISTE) randomised, controlled trial. J Neurol Neurosurg Psychiatry 2017;88(1):38–44.

Mac Grory B, Saldanha IJ, Mistry EA, Stretz C, Poli S, Sykora M, et al. Thrombolytic therapy for ‘wake-up stroke’: a systematic review and meta-analysis. Eur J Neurol 2021;28(6):2006–16.

Karaszewski B, Wyszomirski A, Jablonski B, Werring DJ, Tomaka D. Efficacy and safety of intravenous rtPA in ischaemic strokes due to small-vessel occlusion: systematic review and meta-analysis. Transl Stroke Res 2021;12(3):406–15.

Lan L, Rong X, Li X, Zhang X, Pan J, Wang H, et al. Reperfusion therapy for minor stroke: a systematic review and meta-analysis. Brain Behav 2019;9(10):e01398.

Chen X, Shen Y, Huang C, Geng Y, Yu Y. Intravenous thrombolysis with 0.9 mg/kg alteplase for acute ischaemic stroke: a network meta-analysis of treatment delay. Postgrad Med J 2020;96(1141):680–5.

Choi JC, Jang MU, Kang K, Park JM, Ko Y, Lee SJ, et al. Comparative effectiveness of standard care with IV thrombolysis versus without IV thrombolysis for mild ischaemic stroke. J Am Heart Assoc 2015;4(1):e001306.

Paek YM, Lee JS, Park HK, Cho YJ, Bae HJ, Kim BJ, et al. Intravenous thrombolysis with tissue-plasminogen activator in small vessel occlusion. J Clin Neurosci 2019;64:134–40.

Lobotesis K, Veltkamp R, Carpenter IH, Claxton LM, Saver JL, Hodgson R. Cost-effectiveness of stent-retriever thrombectomy in combination with IV t-PA compared with IV t-PA alone for acute ischaemic stroke in the UK. J Med Econ 2016;19(8):785–94.

Pennlert J, Eriksson M, Carlberg B, Wiklund PG. Long-term risk and predictors of recurrent stroke beyond the acute phase. Stroke 2014;45(6):1839–41.

Mohan KM, Wolfe CD, Rudd AG, Heuschmann PU, Kolominsky-Rabas PL, Grieve AP. Risk and cumulative risk of stroke recurrence: a systematic review and meta-analysis. Stroke 2011;42(5):1489–94.

Slot KB, Berge E, Sandercock P, Lewis SC, Dorman P, Dennis M, Oxfordshire Community Stroke Project. Causes of death by level of dependency at 6 months after ischaemic stroke in 3 large cohorts. Stroke 2009;40(5):1585–9.

Office for National Statistics. National Life Tables: UK 2018–2020. London: Office for National Statistics; 2021. URL: www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/lifeexpectancies/datasets/nationallifetablesunitedkingdomreferencetables (accessed 9 December 2021).

Rethnam V, Bernhardt J, Dewey H, Moodie M, Johns H, Gao L, et al., AVERT Trial Collaboration Group. Utility-weighted modified Rankin Scale: still too crude to be a truly patient-centric primary outcome measure? Int J Stroke 2020;15(3):268–77.

Rivero-Arias O, Ouellet M, Gray A, Wolstenholme J, Rothwell PM, Luengo-Fernandez R. Mapping the modified Rankin scale (mRS) measurement into the generic EuroQol (EQ-5D) health outcome. Med Decis Making 2010;30(3):341–54.

Dijkland SA, Voormolen DC, Venema E, Roozenbeek B, Polinder S, Haagsma JA, et al., MR CLEAN Investigators. Utility-weighted modified Rankin Scale as primary outcome in stroke trials: a simulation study. Stroke 2018;49(4):965–71.

Chaisinanunkul N, Adeoye O, Lewis RJ, Grotta JC, Broderick J, Jovin TG, et al., DAWN Trial and MOST Trial Steering Committees. Adopting a patient-centered approach to primary outcome analysis of acute stroke trials using a utility-weighted modified Rankin scale. Stroke 2015;46(8):2238–43.

Ali M, MacIsaac R, Quinn TJ, Bath PM, Veenstra DL, Xu Y, et al. Dependency and health utilities in stroke: data to inform cost-effectiveness analyses. Eur Stroke J 2017;2(1):70–6.

Hong KS, Saver JL. Quantifying the value of stroke disability outcomes: WHO global burden of disease project disability weights for each level of the modified Rankin Scale. Stroke 2009;40(12):3828–33.

Rebchuk AD, O’Neill ZR, Szefer EK, Hill MD, Field TS. Health utility weighting of the modified rankin scale: a systematic review and meta-analysis. JAMA Netw Open 2020;3(4):e203767.

Wang X, Moullaali TJ, Li Q, Berge E, Robinson TG, Lindley R, et al. Utility-weighted modified rankin scale scores for the assessment of stroke outcome: pooled analysis of 20 000+ patients. Stroke 2020;51(8):2411–7.

Janssen MF, Szende A, Cabases J, Ramos-Goñi JM, Vilagut G, König HH. Population norms for the EQ-5D-3L: a cross-country analysis of population surveys for 20 countries. Eur J Health Econ 2019;20(2):205–16.

Bragg S, Paley L, Kavanagh M, McCurran V, Hoffman A, Rudd A. Sentinel Stroke National Audit Programme (SSNAP) Clinical Audit August 2017–November 2017 Public Report. London: Royal College of Physicians, Clinical Effectiveness and Evaluation Unit on behalf of the Intercollegiate Stroke Working Party; 2018. URL: www.strokeaudit.org/Documents/National/Clinical/AugNov2017/AugNov2017-PublicReport.aspx (accessed 7 December 2021).

Personal Social Services Research Unit. Unit Costs of Health and Social Care 2014. Canterbury: University of Kent; 2014. URL: www.pssru.ac.uk/project-pages/unitcosts/2014 (accessed 22 June 2023).

Patel A, Berdunov V, Quayyum Z, King D, Knapp M, Wittenberg R. Estimated societal costs of stroke in the UK based on a discrete event simulation. Age Ageing 2020;49(2):270–6.

Luengo-Fernandez R, Yiin GS, Gray AM, Rothwell PM. Population-based study of acute- and long-term care costs after stroke in patients with AF. Int J Stroke 2013;8(5):308–14.

Whiting P, Westwood M, Beynon R, Burke M, Sterne JA, Glanville J. Inclusion of methodological filters in searches for diagnostic test accuracy studies misses relevant studies. J Clin Epidemiol 2011;64(6):602–7.

Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 2005;58(9):882–93.

Bouslama M, Ravindran K, Harston G, Rodrigues GM, Pisani L, Haussen DC, et al. Noncontrast computed tomography e-Stroke infarct volume is similar to RAPID computed tomography perfusion in estimating postreperfusion infarct volumes. Stroke 2021;52(2):634–41.

Demeestere J, Scheldeman L, Cornelissen SA, Heye S, Wouters A, Dupont P, et al. Alberta stroke program early CT score versus computed tomographic perfusion to predict functional outcome after successful reperfusion in acute ischaemic stroke. Stroke 2018;49(10):2361–7.

Pfaff J, Herweh C, Schieber S, Schonenberger S, Bosel J, Ringleb PA, et al. e-ASPECTS correlates with and is predictive of outcome after mechanical thrombectomy. AJNR Am J Neuroradiol 2017;38(8):1594–9.

Olive-Gadea M, Martins N, Boned S, Carvajal J, Moreno MJ, Muchada M, et al. Baseline ASPECTS and e-ASPECTS correlation with infarct volume and functional outcome in patients undergoing mechanical thrombectomy. J Neuroimaging 2019;29(2):198–202.

Albers GW, Marks MP, Kemp S, Christensen S, Tsai JP, Ortega-Gutierrez S, et al., DEFUSE 3 Investigators. Thrombectomy for stroke at 6 to 16 hours with selection by perfusion imaging. N Engl J Med 2018;378(8):708–18.

Nogueira RG, Jadhav AP, Haussen DC, Bonafe A, Budzik RF, Bhuva P, et al., DAWN Trial Investigators. Thrombectomy 6 to 24 hours after stroke with a mismatch between deficit and infarct. N Engl J Med 2018;378(1):11–21.

Saver JL, Goyal M, van der Lugt A, Menon BK, Majoie CB, Dippel DW, et al., HERMES Collaborators. Time to treatment with endovascular thrombectomy and outcomes from ischaemic stroke: a meta-analysis. JAMA 2016;316(12):1279–88.

Fransen PS, Berkhemer OA, Lingsma HF, Beumer D, van den Berg LA, Yoo AJ, et al., Multicenter Randomized Clinical Trial of Endovascular Treatment of Acute Ischaemic Stroke in the Netherlands Investigators. Time to reperfusion and treatment effect for acute ischaemic stroke: a randomized clinical trial. JAMA Neurol 2016;73(2):190–6.

National Institute for Health and Care Excellence. Software with Artificial Intelligence Derived Algorithms for Analysing CT Brain Scans in People with a Suspected Acute Stroke: Final Scope. London: National Institute for Health and Care Excellence; 2021. URL: www.nice.org.uk/guidance/gid-dg10044/documents/final-scope (accessed 12 August 2021).

Abdelkhaleq R, Lopez-Rivera V, Salazar-Marioni S, Lee S, Kim Y, Giancardo L, et al. Optimizing predictions of infarct core using machine learning. Presented at International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1):P330.

Aboutaleb P, Barman A, Lopez-Rivera V, Lee S, Vahidy F, Fan J, et al. Automated detection of hemorrhagic stroke from non-contrast computed tomography: a machine learning approach. Presented at International Stroke Conference; 19–21 February 2020; Los Angeles (CA). Stroke 2020;51(Suppl. 1):WP405.

Aghaebrahim A, Desai S, Monteiro A, Granja M, Agnoletto G, Cortez G, et al. Outcomes of large-vessel occlusion thrombectomy in patients with CT perfusion defined large core stroke. Presented at the 17th Annual Meeting of the Society of NeuroInterventional Surgery Congress; 4–7 August 2020; San Diego (CA). J Neurointerv Surg 2020;12(Suppl. 1):A70.

Aktar M, Tampieri D, Rivaz H, Kersten-Oertel M, Xiao Y. Automatic collateral circulation scoring in ischaemic stroke using 4D CT angiography with low-rank and sparse matrix decomposition. Int J Comput Assist Radiol Surg 2020;15(9):1501–11.

Albers GW, Wald MJ, Mlynash M, Endres J, Bammer R, Straka M, et al. Automated calculation of Alberta Stroke Program Early CT Score: validation in patients with large hemispheric infarct. Stroke 2019;50(11):3277–9.

Alderson J, O’Cearbhaill R, Harston G, Greveson E, Joly O, Griffin E, et al. Large-vessel occlusion identification using non-contrast CT and CTA. Presented at 12th World Stroke Congress; 12–15 May 2020; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):293.

Alderson J, O’Cearbhaill R, Joly O, Harston G, Greveson E, Griffin E, et al. Prediction of clinical outcome in a cohort of patients with LVO using automated artificial intelligence image analysis of multiphase CT angiography. Int J Stroke 2020;15(1 Suppl.):293.

Apterbach W, Garra G, Gupta S. The impact of new advanced imaging requirements on tissue plasminogen activator administration. Presented at Society for Academic Emergency Medicine (SAEM) Annual Meeting Virtual; 11–14 May 2021. Acad Emerg Med 2021;28(Suppl. 1):S178.

Austein F, Fischer AC, Jurgensen N, Jansen O. Evaluation of conventional automated and volume weighted ASPECTS vs CT perfusion core volume to predict the final infarct volume after successful thrombectomy. Clin Neuroradiol 2018;28(Suppl. 1):S91.

Austein F, Langguth P, Jansen O. Evaluation of conventional automated and volume weighted automated aspects vs. CT perfusion core volume to predict the final infarct volume after successful endovascular therapy. Fortschr Rontgenstr 2019;191:S54.

Austein F, Wodarg F, Jurgensen N, Huhndorf M, Meyne J, Lindner T, et al. Automated versus manual imaging assessment of early ischaemic changes in acute stroke: comparison of two software packages and expert consensus. Eur Radiol 2019;29(11):6285–92.

Austein F, Joly O, Harston G, Watkinson JI, Langguth P, Jansen O. Stability and equivalence of a newly developed fully-automated CT-perfusion post processing software for analysis in patients with acute anterior large-vessel occlusion. Presented at 12th World Stroke Congress 2020; 12–15 May 2020; Vienna Austria. Int J Stroke 2020;15(1 Suppl.):107–8.

Bacchi S, Zerner T, Oakden-Rayner L, Kleinig T, Patel S, Jannes J. Deep learning in the prediction of ischaemic stroke thrombolysis functional outcomes: a pilot study. Acad Radiol 2020;27(2):e19–23.

Bar M, Kral J, Cabal M, Havelka J, Kasickova L. The correlation of the final infarct volume measurement between NCCT and MRI DWI in acute stroke patients after mechanical thrombectomy. Presented at 5th Congress of the European Academy of Neurology (EAN 2019); 26 June–2 July 2019; Oslo Norway. Eur J Neurol 2019;26(Suppl. 1):365.

Barman A, Inam ME, Lee S, Savitz S, Sheth S, Giancardo L. Determining ischaemic stroke from CT-angiography imaging using symmetry-sensitive convolutional networks. In IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019) Proceedings. Danvers, MA: IEEE; 2019. pp. 1873–7. https://dx.doi.org/10.1109/ISBI.2019.8759475

Barros RS, Van Der Steen WE, Ponomareva E, Boers AM, Zijlstra IJ, Van Der Berg R, et al. Detection and segmentation of subarachnoid hemorrhages with deep learning. Presented at American Heart Association/American Stroke Association 2019 International Stroke Conference and State-of-the-Science Stroke Nursing Symposium; 6–8 Feb 2019; Honolulu, HI. Stroke 2019;50(Suppl. 1):WMP29. https://doi.org/10.1161/str.50.suppl_1.WMP29

Beijing Tiantan Hospital. An AI-based CDSS for integrated management of patients with acute ischaemic stroke (GOLDEN BRIDGE II). NCT04524624. 2020. URL: https://ClinicalTrials.gov/show/NCT04524624 (accessed 15 December 2021).

Bentley P, Ganesalingam J, Dias A, Mehta A, Sharma P, Halse O, et al. Hyperacute fingerprinting: CT brain machine-learning predicts response to thrombolysis. Cerebrovasc Dis 2013;35(Suppl. 3):414.

Bentley P, Ganesalingam J, Carlton Jones AL, Mahady K, Epton S, Rinne P, et al. Prediction of stroke thrombolysis outcome using CT brain machine learning. Neuroimage Clin 2014;4:635–40.

Bhagat R, Madireddy K, Naik S, Kutty G, Liu W. A volumetric comparison of computed tomography perfusion rapid core volume in different time frames with diffusion-weighted imaging infarct volume in the post-thrombectomy patients after large-vessel occlusion. Presented at American Stroke Association International Stroke Conference (ISC 2021); 17–19 March 2021; Virtual. Stroke 2021;52(Suppl. 1):P362.

Biswas V, McVerry F, Macdougall N, Huang X, Muir K. Interaction of hypoperfusion intensity ratio and hyperglycaemia predicts functional outcome in ischaemic stroke. Presented at 12th World Stroke Congress 2020; 12–15 May 2020; Vienna, Austria. Int J Stroke 2020;15(1 Suppl.):281.

Bouslama M, Rodrigues G, Ravindran K, Haussen D, Frankel M, Nogueira R. CT perfusion and e-aspects automated noncontract CT ischaemic core volumes: correlations and clinical outcome prediction. Presented at 5th European Stroke Organisation Conference (ESOC 2019); 22–24 May 2019; Milan Italy. Eur Stroke J 2019;4(Suppl. 1):405.

Bouvy C, Maldonado Slootjes S, Ackermans N, Gille M, Paindeville P, Rutgers M. Full-automated A.I. CT perfusion seems highly reliable to exclude large-vessel occlusion. Presented at 12th World Stroke Congress 2020; 12–15 May 2020; Vienna Austria. Int J Stroke 2020;15(1 Suppl.):282.

Brinjikji W, Benson J, Campeau N, Carr C, Cogswell P, Klaas J, et al. Brainomix easpects software improves interobserver agreement and accuracy of neurologist and neuroradiologists in interpretation of aspects score and outperforms human readers in prediction of final infarct. Presented at 17th Annual Meeting of the Society of NeuroInterventional Surgery Organizing (SNIS 2020); 4–7 Aug 2020; San Diego, CA. J Neurointerv Surg 2020;12(Suppl. 1):A112–13.

Brinjikji W, Abbasi M, Arnold C, Benson JC, Braksick SA, Campeau N, et al. e-ASPECTS software improves interobserver agreement and accuracy of interpretation of aspects score. Interv Neuroradiol 2021;27:781–7. https://doi.org/10.15910199211011861

Brinjikji W, Rabinstein AA, Harston G, Joly O, Abbasi M, Kallmes D. Eloquence mapping in acute ischaemic stroke. Presented at American Stroke Association International Stroke Conference (ISC 2021); 17–19 March 2021. Stroke 2021;52(Suppl. 1):P380.

Bruggeman AA, Koopman M, Soomro J, Yoo AJ, Marquering HA, Emmer BJ, et al. Automated artificial intelligence based detection and location specification of large-vessel occlusion on CT angiography in stroke. Presented at Presented at American Stroke Association International Stroke Conference (ISC 2021); 17–9 March 2021; Virtual. Stroke 2021;52(Suppl. 1):P544.

Brugnara G, Neuberger U, Mahmutoglu MA, Foltyn M, Herweh C, Nagel S, et al. Multimodal predictive modeling of endovascular treatment outcome for acute ischaemic stroke using machine-learning. Stroke 2020;51(12):3541–51.

Buls N, Watte N, Nieboer K, Ilsen B, de Mey J. Performance of an artificial intelligence tool with real-time clinical workflow integration - detection of intracranial hemorrhage and pulmonary embolism. Phys Med 2021;83:154–60.

Bulwa Z, Dasenbrock H, Osteraas N, Cherian L, Crowley RW, Chen M. Incidence of unreliable automated computed tomography perfusion maps. J Stroke Cerebrovasc Dis 2019;28(12):104471.

Campbell BCV, Yassi N, Ma H, Sharma G, Salinas S, Churilov L, et al. Imaging selection in ischaemic stroke: feasibility of automated CT-perfusion analysis. Int J Stroke 2015;10(1):51–4.

Capasso R, Vallone S, Serra N, Zelent G, Verganti L, Sacchetti F, et al. Qualitative versus automatic evaluation of CT perfusion parameters in acute posterior circulation ischaemic stroke. Neuroradiology 2021;63(3):317–30.

Chatterjee A, Somayaji NR, Kabakis IM. Artificial intelligence detection of cerebrovascular large-vessel occlusion: nine month, 650 patient evaluation of the diagnostic accuracy and performance of the Viz.ai LVO algorithm. Presented at International Stroke Conference 2019; 6–8 Feb 2019; Honolulu, Hawaii. Stroke 2019;50(Suppl. 1):WPM16.

Chilamkurthy S, Ghosh R, Tanamala S, Biviji M, Campeau NG, Venugopal VK, et al. Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study. Lancet 2018;392(10162):2388–96.

Chriashkova J, Goncalves C, Aslam M, Perera S, Walter S, Fisher J, et al. Can artificial intelligence improve physician sensitivity in detecting early ischaemic damage on computed tomography? Abstract B-0979, European Congress of Radiology 2019; 27 Feb–3 March 2019, Vienna, Austria. Insights Imaging 2019;10(Suppl. 1):S393.

Chriashkova J, Menon N, Chakrabarti A, Guyler P, Kelavkar S, Kuhn A, et al. E-ASPECTS improves sensitivity to early ischaemic injury on acute computed tomography scans. Presented at International Stroke Conference 2019; 6–8 Feb 2019; Honolulu, HI. Stroke 2019;50(Suppl. 1):WMP14.

Chung CY, Rodrigues GM, Haussen DC, Barreira CM, Grossberg J, Frankel MR, Nogueira RG. Automated detection of hyperdense mca sign and automated notification of large-vessel occlusion using artificial intelligence. Presented at International Stroke Conference 2019; 6–8 Feb 2019; Honolulu, HI. Stroke 2019;50(Suppl. 1):WP76.

Chung C, Pisani L, Peterson R, Mohammaden M, Harston G, Joly O, et al. Automated detection of hyperdense vessel sign on acute ischaemic stroke patients with large-vessel occlusion. Presented at 12th World Stroke Congress; 12–15 May 2020; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):292.

Cimflova P, Volny O, Mikulik PR, Tyshchenko B, Belaskova S, Vinklarek J, et al. Detection of ischaemic changes on baseline multimodal computed tomography: expert reading vs. Brainomix and RAPID software. J Stroke Cerebrovasc Dis 2020;29(9):104978.

Cimflova P, Volny O, Mikulik R, Tyshchenko B, Belaskova S, Vinklarek J, et al. Detection of ischaemic changes on baseline multimodal computed tomography: expert reading vs. brainomix and rapid software. Presented at 12th World Stroke Congress; 12–15 May 2021; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):135.

Copelan AZ, Smith ER, Drocton GT, Narsinh KH, Murph D, Khangura RS, et al. Recent administration of iodinated contrast renders core infarct estimation inaccurate using RAPID software. AJNR Am J Neuroradiol 2020;41(12):2235–42.

D’Esterre CD, Qazi E, Patil S, Lee TY, Almekhlafi M, Demchuk AM, et al. CT Perfusion thresholds to separate acute infarct core from penumbra using optimized imaging and advanced post-processing. Presented at the 23rd European Stroke Conference; 6–9 May 2014; Nice (France). Cerebrovasc Dis 2014;37(Suppl. 1):500.

Davidovic K, Stankovic A, Kostic J, Crnovrsanin F, Masulovic D, Maksimovic R. Diagnostic importance of brain CT perfusion 4D in the detection of acute suptratentorial infarctions. Presented at European Congress of Radiology 2017, Vienna, Austria, 1–5 March 2017. Abstract B-0097. Insights Imaging 2017;8(Suppl. 1):S203.

Davis MA, Rao B, Cedeno PA, Saha A, Zohrabian VM. Machine learning and improved quality metrics in acute intracranial hemorrhage by noncontrast computed tomography published online ahead of print. Curr Probl Diagn Radiol 2022;51:556–61.

Dehkharghani S, Bammer R, Straka M, Albin LS, Kass-Hout O, Allen JW, et al. Performance and predictive value of a user-independent platform for CT perfusion analysis: threshold-derived automated systems outperform examiner-driven approaches in outcome prediction of acute ischaemic stroke. AJNR Am J Neuroradiol 2015;36(8):1419–25.

Delio PR, Wong ML, Tsai JP, Hinson HE, McMenamy J, Le T, et al. Assistance from automated aspects software improves reader performance. Presented at International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1):P336.

Delio PR, Wong ML, Tsai JP, Hinson HE, McMenamy J, Le TQ, et al. Assistance from automated ASPECTS software improves reader performance. J Stroke Cerebrovasc Dis 2021;30(7):105829.

Demeestere J, Scheldeman L, Cornelissen S, Heye S, Christensen S, Mlynash M, et al. Conventional and automated aspects vs. CT perfusion core volume to predict functional outcome in reperfused acute ischaemic stroke patients undergoing endovascular therapy. Presented at the the American Heart Association/American Stroke Association 2018 International Stroke Conference and State-of-the-Science Stroke Nursing Symposium; 23–26 January 2018; Los Angeles (CA). Stroke 2018;49(Suppl. 1):116.

Desai S, Jadhav A, Rocha M, Jovin T, Molyneaux B. Association of automated aspects and ischaemic core volume of anterior circulation large-vessel occlusion stroke within 24-hours of onset. Presented at the 5th European Stroke Organisation Conference (ESOC); 22–24 May 2019; Milan (Italy). Eur Stroke J 2019;4(Suppl. 1):409.

Devlin T, Shah R, Patterson J, Fleming J, Nichols J, Knowles B, et al. DISTINCTION: Automated Detection, Identification, Selection, And Triage Using Artificial Intelligence In Large-vessel Occlusions Requiring Critical And Timely InterventION. Presented at International Stroke Conference 2019; 6–8 Feb 2019; Honolulu, HI. Stroke 2019;50(Suppl. 1):TP273.

Docema R, Cardoso EFR, Eduardo, Chenedezi RF. Diagnostic accuracy of artificial intelligence algorithms to detect intracranial haemorrhage in head computed scans. PROSPERO 2021 CRD42021233801. URL: www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021233801

Elijovich L, Dornbos III D, Nickele C, Alexandrov A, Inoa-Acosta V, Arthur AS, et al. Automated emergent large-vessel occlusion detection by artificial intelligence improves stroke workflow in a hub and spoke stroke system of care. J Neurointerv Surg 2021;14(7):704–8.

Ferreti LA, Leitao CA, Teixeira BCA, Lopes Neto FDN, VF ZE, Lange MC. The use of e-ASPECTS in acute stroke care: validation of method performance compared to the performance of specialists. Arq Neuropsiquiatr 2020;78(12):757–61.

Ferreti L, Leitao C, Teixeira B, Zetola V, Lange M. The E-ASPECTS improves the performance of emergencists in the evaluation of early signs of ischemia. Presented at 72nd Annual Meeting of the American Academy of Neurology, AAN 2020; 25 April–1 May 2020; Toronto, ON. Neurology 2020;94(15 Suppl.):5174.

Fischer J, Friedrich B, Monch S, Berndt M, Wunderlich S, Seifert C, et al. Software-based automatic ASPECTS calculation is superior in comparison to human readers. Presented at the 53rd Annual Meeting of the German Society for Neuroradiology; 3–6 October 2018; Frankfurt am (Germany). Clin Neuroradiol 2018;28(Suppl. 1):S6.

Ford LM, Commet ME, Ahluwalia JS, Cenzer CW, Aftab M. 110 Reliability of automated interpretation of computed tomography images in the management of acute stroke: a single-center analysis. Presented at American College of Emergency Physicians (ACEP) 2020 Research Forum Virtual; 26–29 October 2020. Ann Emerg Med 2020;76(4 Suppl.):S43.

Ginat DT. Analysis of head CT scans flagged by deep learning software for acute intracranial hemorrhage. Neuroradiology 2020;62(3):335–40.

Ginat D. Implementation of machine learning software on the radiology worklist decreases scan view delay for the detection of intracranial hemorrhage on CT. Brain Sci 2021;11(7):832.

Goebel J, Stenzel E, Guberina N, Wanke I, Koehrmann M, Kleinschnitz C, et al. Automated ASPECT rating: comparison between the Frontier ASPECT Score software and the Brainomix software. Neuroradiology 2018;60(12):1267–72.

Goebel J, Stenzel E, Wanke I, Kohrmann M, Kleinschnitz C, Forsting M, et al. Computer aided diagnosis for ASPECT rating: Initial experiences with the Frontier ASPECT Score software. Presented at the 53rd Annual Meeting of the German Society for Neuroradiology; 3–6 October 2018; Frankfurt am (Germany). Clin Neuroradiol 2018;28(Suppl. 1):S5.

Goebel J, Stenzel E, Zulow S, Wanke I, Kohrmann M, Kleinschnitz C, et al. Automated ASPECT rating: comparison between the Frontier ASPECT Score software and the Brainomix software. Presented at the 53rd Annual Meeting of the German Society for Neuroradiology; 3–6 October 2018; Frankfurt am (Germany). Clin Neuroradiol 2018;28(Suppl. 1):S5–6.

Goncalves C, Bowman S, Liyanage S, OrathPrabakaran R, Shah S, Gerry S, et al. Automated assessment of early ischaemic damage on CT scans: as good as an expert? Presented at European Congress of Radiology, Vienna (Austria), 1–5 March 2017.

Grunwald I, Sinha D, Day D, Reith W, Chapot R, Papanagiotou P, et al. Evaluation of the novel medical imaging software e-ASPECTS for patient selection in stroke. Presented at the UK Stroke Forum 2015 Conference; 1–3 December 2015; Liverpool (UK). Int J Stroke 2015;10(Suppl. 5):11.

Grunwald I, Ragoschke-Schummbb A, Kettnerc M, Walterb S, Shah S, Fassbenderb K. e-ASPECTS in pre-hospital stroke treatment on a mobile stroke unit. Presented at UK Stroke Forum 2016 Conference; 28–30 November 2016; Liverpool (UK). Int J Stroke 2016;11(4 Suppl. 1):46.

Grunwald IQ, Ragoschke-Schumm A, Kettner M, Schwindling L, Roumia S, Helwig S, et al. First automated stroke imaging evaluation via electronic Alberta stroke program early CT score in a mobile stroke unit. Cerebrovasc Dis 2016;42(5–6):332–8.

Grunwald IQ, Sinha D, Roffe C, Walter S. Evaluation of the e-ASPECTS automated software for detection of acute ischaemic stroke. Presented at the International Stroke Conference; 17–19 February 2016; Los Angeles (CA). Stroke 2016;47(Suppl. 1):WP54.

Grunwald IQ, Kulikovski J, Reith W, Gerry S, Namias R, Politi M, et al. Collateral automation for triage in stroke: evaluating automated scoring of collaterals in acute stroke on computed tomography scans. Cerebrovasc Dis 2019;47(5–6):217–22.

Guberina N, Dietrich U, Radbruch A, Goebel J, Deuschl C, Ringelstein A, et al. Detection of early infarction signs with machine learning-based diagnosis by means of the Alberta Stroke Program Early CT score (ASPECTS) in the clinical routine. Neuroradiology 2018;60(9):889–901.

Heit JJ, Coelho H, Lima FO, Granja M, Aghaebrahim A, Hanel R, et al. Automated cerebral hemorrhage detection using RAPID. AJNR Am J Neuroradiol 2021;42(2):273–8.

Herweh C, Ringleb PA, Rauch G, Behrens L, Moehlenbruch M, Gottorf R, et al. Similar performance on aspect scoring between stroke experts and an automated algorithm (e-ASPECTS) on CT scans of acute ischaemic stroke patients. Int J Stroke 2014;9:52–3.

Herweh C, Ringleb PA, Rauch G, Gerry S, Behrens L, Mohlenbruch M, et al. Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischaemic stroke patients. Int J Stroke 2016;11(4):438–45.

Herweh C, Bellot P, Seker F, Joly O, Mokli Y, Bendszus M, et al. AI-based automated detection of large-vessel occlusion on nonenhanced CT scans in acute ischaemic stroke. Presented at 12th World Stroke Congress; 12–15 May 2020; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):292–3.

Hoelter P, Muehlen I, Goelitz P, Beuscher V, Schwab S, Doerfler A. Automated ASPECT scoring in acute ischaemic stroke: comparison of three software tools. Neuroradiology 2020;62(10):1231–8.

Hoffmann RS, Saban M, Abergel E, Eran A. Evaluation of AI-powered identification of LVOs in a comprehensive stroke center. Presented at American Society of Neuroradiology Annual Meeting 2019; Boston, MA, 18–23 May 2019. Abstract 3231.

Hokkinen L, Makela T, Savolainen S, Kangasniemi M. Evaluation of a CTA-based convolutional neural network for infarct volume prediction in anterior cerebral circulation ischaemic stroke. Eur Radiol Exp 2021;5(1):25.

Hoving JW, Marquering HA, Majoie C, Yassi N, Sharma G, Liebeskind DS, et al. Volumetric and spatial accuracy of computed tomography perfusion estimated ischaemic core volume in patients with acute ischaemic stroke. Stroke 2018;49(10):2368–75.

Hoyte LC, Al Sultan AS, Finkelstein S, Boyko M, Fok D, Pordeli P, et al. Reliability of automated software to assign e-ASPECTS to CT scans for acute ischaemic changes. Neurology 2017;88(16 Suppl.):S8.006.

Jankowitz BT, Stinson T, Begun D, Davies J. Large scale, CT evaluation can improve screening for multi-center stroke trials. Presented at International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1):P432.

John S, Hussain SI, Piechowski B, Dogar MA. Discrepancy in core infarct between CT aspects and CT perfusion when selecting for mechanical thrombectomy. Presented at XXIV World Congress of Neurology; 27–31 October 2019; Dubai (UAE). J Neurol Sci 2019;405(Suppl.):45.

John S, Hussain SI, Piechowski-Jozwiak B, Dogar MA. Discrepancy in core infarct between non-contrast CT and CT perfusion when selecting for mechanical thrombectomy. J Cerebrovasc Endovasc Neurosurg 2020;22(1):8–14.

Katramados AM, Kole M, Marin H, Alsrouji O, Varun P, Miller D, et al. Real-word performance of two automated software platforms for large-vessel occlusion identification in acute ischaemic stroke patients: a single center experience. Presented at International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1): P377.

Kelavkar S, Grunwald Q, Shah S. In how far can the CE-marked e-ASPECTS software (Brainomix, Oxford) assist clinicians? Cerebrovasc Dis 2017;43:66.

Kettenberger P, Jansen O, Riedel C. Automatic clot detection in NECT images of acute ischaemic stroke patients using a convolutional neural network. Presented at the 53rd Annual Meeting of the German Society for Neuroradiology; 3–6 October 2018; Frankfurt am (Germany). Clin Neuroradiol 2018;28(Suppl. 1):S94.

Kettenberger P, Jansen O, Larsen N, Riedel C. Automatic clot detection in NECT images of acute ischaemic stroke patients using a convolutional neural network. Presented at the 5th European Stroke Organisation Conference (ESOC); 22–24 May 2019; Milan (Italy). Eur Stroke J 2019;4(Suppl. 1):416–7.

Kim CH, Hahm MH, Lee DE, Choe JY, Ahn JY, Park SY, et al. Clinical usefulness of deep learning-based automated segmentation in intracranial hemorrhage published online ahead of print. Technol Health Care 2021;29:881–95. https://dx.doi.org/10.3233/THC-202533

Kniep HC, Sporns PB, Broocks G, Kemmling A, Nawabi J, Rusche T, et al. Posterior circulation stroke: machine learning-based detection of early ischaemic changes in acute non-contrast CT scans. J Neurol 2020;267(9):2632–41.

Knight-Greenfield A, Beecy A, Chang Q, Anchouche K, Baskaran L, Elmore K, et al. A novel deep learning approach for automated diagnosis of cerebral infarction on computed tomography. Presented at the American Heart Association/American Stroke Association 2018 International Stroke Conference and State-of-the-Science Stroke Nursing Symposium; 23–26 January 2018; Los Angeles (CA). Stroke 2018;49(Suppl. 1):TP58.

Kral J, Cabal M, Kasickova L, Havelka J, Jonszta T, Volny O, Bar M. Machine learning volumetry of ischaemic brain lesions on CT after thrombectomy-prospective diagnostic accuracy study in ischaemic stroke patients. Neuroradiology 2020;62(10):1239–45.

Kuang HL, Teleg E, Najm M, Wilson AT, Sohn SI, Goyal M, et al. Automated ASPECTS scoring of CT scans for acute ischaemic stroke patients using machine learning. Presented at the International Stroke Conference; 23–26 January 2018; Los Angeles (CA). Stroke 2018;49(Suppl. 1):WMP23.

Kuang H, Najm M, Chakraborty D, Maraj N, Sohn SI, Goyal M, et al. Automated ASPECTS on noncontrast CT scans in patients with acute ischaemic stroke using machine learning. AJNR Am J Neuroradiol 2019;40(1):33–8.

Kuang HL, Qiu W, Najm M, Dowlatshahi D, Mikulik R, Poppe AY, et al. Validation of an automated ASPECTS method on non-contrast computed tomography scans of acute ischaemic stroke patients. Int J Stroke 2020;15(5):528–34.

Kuo W, Hane C, Mukherjee P, Malik J, Yuh EL. Expert-level detection of acute intracranial hemorrhage on head computed tomography using deep learning. Proc Natl Acad Sci U S A 2019;116(45):22737–45.

Lasocha B, Pulyk R, Brzegowy P, Latacz P, Slowik A, Popiela TJ. Real-world comparison of human and software image assessment in acute ischaemic stroke patients’ qualification for reperfusion treatment. J Clin Med 2020;9(11):3383.

Lee JY, Kim JS, Kim TY, Kim YS. Detection and classification of intracranial haemorrhage on CT images using a novel deep-learning algorithm. Sci Rep 2020;10(1):20546.

Liu QC, Jia ZY, Zhao LB, Cao YZ, Ma G, Shi HB, Liu S. Agreement and accuracy of ischaemic core volume evaluated by three CT perfusion software packages in acute ischaemic stroke. J Stroke Cerebrovasc Dis 2021;30(8):105872.

Lo CM, Hung PH, Lin DT. Rapid assessment of acute ischaemic stroke by computed tomography using deep convolutional neural networks. J Digit Imaging 2021;34:637–46. https://dx.doi.org/10.1007/s10278-021-00457-y

Loffler MT, Sollmann N, Monch S, Friedrich B, Zimmer C, Baum T, et al. Improved reliability of automated ASPECTS evaluation using iterative model reconstruction from head CT scans. J Neuroimaging 2021;31(2):341–7.

Maegerlein C, Fischer J, Monch S, Berndt M, Wunderlich S, Seifert CL, et al. Automated calculation of the Alberta Stroke Program Early CT Score: feasibility and reliability. Radiology 2019;291(1):141–8.

Mair G, Bath P, Muir K, Von Kummer R, Al-Shahi Salman R, Sandercock P, et al. Real-world independent testing of easpects software (RITES). Presented at 12th World Stroke Congress; 12–15 May 2020; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):33.

Mansour OY, Ramadan I, Abdo A, Hamdi M, Eldeeb H, Marouf H, et al. Deciding thrombolysis in AIS based on automated versus on WhatsApp interpreted ASPECTS, a reliability and cost-effectiveness analysis in developing system of care. Front Neurol 2020;11:333.

Meijs M, Patel A, van de Leemput SC, Prokop M, van Dijk EJ, de Leeuw FE, et al. Robust segmentation of the full cerebral vasculature in 4D CT of suspected stroke patients. Sci Rep 2017;7(1):15622.

Meijs M, Meijer FJA, Prokop M, Ginneken BV, Manniesing R. Image-level detection of arterial occlusions in 4D-CTA of acute stroke patients using deep learning. Med Image Anal 2020;66:101810.

Modak JM, Lee JW, Reeves C, Staff I, Ollenschleger MD. CT perfusion and radiation exposure in acute ischaemic stroke: a quality improvement study. Presented at International Stroke Conference; 6–8 February 2019; Honolulu (HI). Stroke 2019;50(Suppl. 1):WP368.

Morey J, Zhang X, Yaeger K, Fiano E, Marayati NF, Kellner CP, et al. Initial real-world experience with Viz LVO in transferred large-vessel occlusion stroke patients. Presented at International Stroke Conference 2021; Virtual, 17–19 March 2021. Stroke 2021;52(Suppl. 1):P129.

Murray N. Artificial intelligence in acute stroke diagnostics: application in large-vessel occlusions. Presented at American Academy of Neurology Annual Meeting 2019; 4–10 May 2019; Philadelphia, PA. Neurology 2019;92(15 Suppl.):P2.70-006.

Nagel S, Sinha D, Day D, Reith W, Chapot R, Papanagiotou P, et al. e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischaemic stroke patients. Int J Stroke 2017;12(6):615–22.

Nagel S, Wang X, Carcel C, Robinson T, Lindley RI, Chalmers J, Anderson CS, ENCHANTED Investigators. Clinical utility of electronic Alberta Stroke Program Early Computed Tomography Score software in the ENCHANTED trial database. Stroke 2018;49(6):1407–11.

Nagel S, Joly O, Pfaff J, Papanagiotou P, Fassbender K, Reith W, et al. E-aspects derived acute ischaemic volumes on non-contrast enhanced computed tomography images correlate with diffusion weighted imaging lesion volumes and predict clinical outcome in acute ischaemic stroke patients. Presented at the International Stroke Conference; 6–8 February 2019; Honolulu (HI). Stroke 2019;50(Suppl. 1):WMP20.

Nagel S, Joly O, Pfaff J, Papanagiotou P, Fassbender K, Reith W, et al. e-ASPECTS derived acute ischaemic volumes on non-contrast-enhanced computed tomography images. Int J Stroke 2020;15(9):995–1001.

Neuberger U, Pfaff J, Nagel S, Ringleb PA, Herweh C, Bendszus M, et al. Impact of slice thickness on robustness of electronic Alberta stroke program early computed tomography scores (e-ASPECTS). Presented at the 54th Annual Meeting of the German Society for Neuroradiology and 27th Annual Meeting of the Austrian Society for Neuroradiology; 9–12 October 2019; Frankfurt am (Germany). Clin Neuroradiol 2019;29(Suppl. 1):S3.

Neuberger U, Nagel S, Pfaff J, Ringleb PA, Herweh C, Bendszus M, et al. Impact of slice thickness on clinical utility of automated Alberta Stroke Program Early Computed Tomography Scores. Eur Radiol 2020;30(6):3137–45.

Neuhaus A, Seyedsaadat SM, Mihal D, Benson J, Mark I, Kallmes DF, et al. Region-specific agreement in ASPECTS estimation between neuroradiologists and e-ASPECTS software. J Neurointerv Surg 2020;12(7):720–3.

Nishio M, Koyasu S, Noguchi S, Kiguchi T, Nakatsu K, Akasaka T, et al. Automatic detection of acute ischaemic stroke using non-contrast computed tomography and two-stage deep learning model. Comput Methods Programs Biomed 2020;196:105711.

Ojeda P, Zawaideh M, Mossa-Basha M, Haynor D. The utility of deep learning: evaluation of a convolutional neural network for detection of intracranial bleeds on non-contrast head computed tomography studies. In: Angelini ED, Landman BA, editors. Medical Imaging 2019: Image Processing. Proceedings of SPIE. Bellingham: Spie-Int Soc Optical Engineering; 2019. p. 10949.

Olive-Gadea M, Martins N, Boned S, Carvajal J, Rios MA, Muchada M, et al. Aspects and easpects correlation with baseline and final infarct volume in acute ischaemic stroke thrombectomy patients. Presented at the American Heart Association/American Stroke Association 2018 International Stroke Conference and State-of-the-Science Stroke Nursing Symposium; 23–26 January 2018; Los Angeles (CA). Stroke 2018;49(Suppl. 1):WP52.

Olive-Gadea M, Martins N, Boned S, Carvajal J, Rios MA, Muchada M, et al. Time dependency of aspects and e-ASPECTS correlation with infarct volume. Presented at the 4th European Stroke Organisation Conference (ESOC); 16–18 May 2018; Gothenburg (Sweden). Eur Stroke J 2018;3(1 Suppl. 1):249.

Olive-Gadea M, Crespo C, Granes C, Hernandez-Perez M, Perez de la Ossa N, Laredo C, et al. Deep learning based software to identify large-vessel occlusion on noncontrast computed tomography. Stroke 2020;51(10):3133–7.

Olive-Gadea M, Crespo C, Granes C, Hernandez-Perez M, Perez De La Ossa N, Laredo C, et al. Identification of large-vessel occlusion on non-contrast CT using a deep learning software. Presented at 12th World Stroke Congress; 12–15 May 2020; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):134–5.

Pfaff J, Herweh C, Schieber S, Schonenberger S, Bosel J, Ringleb P, et al. The e-aspects correlates with and is predictive of outcome after mechanical thrombectomy. Presented at the 3rd European Stroke Organisation Conference (ESOC); 16–18 May 2017; Prague (Czech). Eur Stroke J 2017;2(1 Suppl. 1):255–6.

Pisani L, Haussen D, Mohammaden M, Camara C, Rodrigues G, Liberato B, et al. Comparison of two automated CT perfusion packages on acute stroke assessment. Presented at 12th World Stroke Congress; 12–15 May 2020; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):292.

Pisani L, Mohammaden M, Bouslama M, Al-bayati AR, Haussen DC, Frankel MR, Nogueira RG. Comparison of three automated CT perfusion software packages for thrombectomy eligibility and final infarct volume prediction. Presented at the International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1):P466.

Prokhorikhin A, Baystrukov V, Boykov A, Malaev D, Tarkova A, Shayakhmetova S, et al. Neural network-based system of acute stroke non-contrast computed tomography diagnostics: a comparative study. Russ Electron J Radiol 2020;10(3):36–45.

Providence Little Company of Mary-Torrance. Automated detection and triage of large-vessel occlusions using artificial intelligence for early and rapid treatment (ALERT). NCT04142879. 2019. URL: https://ClinicalTrials.gov/show/NCT04142879 (accessed 30 July 2021).

Psychogios MN, Sporns PB, Ospel J, Katsanos AH, Kabiri R, Flottmann FA, et al. Automated perfusion calculations vs. visual scoring of collaterals and CBV-ASPECTS has the machine surpassed the eye? Clin Neuroradiol 2021;31(2):499–506.

Purrucker J, Mattern N, Herweh C, Nagel S, Gumbinger C. Realworld hospital transfer times and loss of braintissue measured with e-ASPECTS underlines importance of improvement of stroke care delivery. Presented at the 4th European Stroke Organisation Conference; 16–18 May 2018; Gothenburg (Sweden). Eur Stroke J 2018;3(1 Suppl. 1):13.

Purrucker JC, Mattern N, Herweh C, Mohlenbruch M, Ringleb PA, Nagel S, Gumbinger C. Electronic Alberta Stroke Program Early CT score change and functional outcome in a drip-and-ship stroke service. J Neurointerv Surg 2020;12(3):252–5.

Qiu W, Kuang H, Ospel JM, Hill MD, Demchuk AM, Goyal M, Menon BK. Automated prediction of ischaemic brain tissue fate from multiphase computed tomographic angiography in patients with acute ischaemic stroke using machine learning. J Stroke 2021;23(2):234–43.

Rao B, Zohrabian V, Cedeno P, Saha A, Pahade J, Davis MA. Utility of artificial intelligence tool as a prospective radiology peer reviewer: detection of unreported intracranial hemorrhage. Acad Radiol 2021;28(1):85–93.

Rava RA, Podgorsak AR, Waqas M, Snyder KV, Mokin M, Levy EI, et al. Investigation of convolutional neural networks using multiple computed tomography perfusion maps to identify infarct core in acute ischaemic stroke patients. J Med Imaging (Bellingham) 2021;8(1):014505.

Reidler P, Stueckelschweiger L, Puhr-Westerheide D, Feil K, Kellert L, Dimitriadis K, et al. Performance of automated attenuation measurements at identifying large-vessel occlusion stroke on CT angiography. Clin Neuroradiol 2020;31:763–72.

Sachdev H, Ong K, Paulson A, Emami M, Tolley U, Wang W, et al. Utilization of ‘RAPID’ CT perfusion in treatment of acute ischaemic stroke (AIS): a community hospital experience in California, United States. Presented at the 13th Congress of the World Federation of Interventional and Therapeutic Neuroradiology (WFITN) and 12th Interdisciplinary Cerebrovascular Symposium, Intracranial Stent Meeting (ICS); 9–13 November; Gold Coast (Australia). Interv Neuroradiol 2015;21(Suppl. 1):193.

Seo K, Kim GS, Yun PH, Suh SH. An introduction of the rapid software increased the number of mechanical thrombectomy with favorable outcome in stroke patients. Presented at the 42nd Annual Meeting of the European Society of Neuroradiology (ESNR) – Diagnostic and Interventional; 18–22 September 2019; Oslo (Norway). Neuroradiology 2019;61(1):S106.

Shah S, Kelavkar S, Johnson M, Vlahovic I, Guyler P, Kiihn AL, et al. What is the optimal way to integrate the e-ASPECTS software into a stroke pathway? Presented at 26th European Stroke Conference; 24–26 May 2017; Berlin, Germany. Cerebrovasc Dis 2017;43(Suppl. 1):150.

Sheth SA, Inam ME, Barman A, Lee S, Savitz SI, Giancardo L. Automated accurate determinations of acute infarct core volumes from CT angiography using machine learning. Presented at the International Stroke Conference; 6–8 February 2019; Honolulu (HI). Stroke 2019;50(Suppl. 1):WP77.

Sheth SA, Lopez-Rivera V, Barman A, Grotta JC, Yoo AJ, Lee S, et al. Machine learning-enabled automated determination of acute ischaemic core from computed tomography angiography. Stroke 2019;50(11):3093–100.

Shinohara Y, Takahashi N, Lee Y, Ohmura T, Kinoshita T. Development of a deep learning model to identify hyperdense MCA sign in patients with acute ischaemic stroke. Jpn J Radiol 2020;38(2):112–7.

Shinohara Y, Takahashi N, Lee Y, Ohmura T, Umetsu A, Kinoshita F, et al. Usefulness of deep learning-assisted identification of hyperdense MCA sign in acute ischaemic stroke: comparison with readers’ performance. Jpn J Radiol 2020;38(9):870–7.

Siegler JE, Rosenberg J, Cristancho D, Olsen A, Pulst-Korenberg J, Raab L, et al. Computed tomography perfusion in stroke mimics. Int J Stroke 2020;15(3):299–307.

Sundaram VK, Goldstein J, Wheelwright D, Aggarwal A, Pawha PS, Doshi A, et al. Automated aspects in acute ischaemic stroke: a comparative analysis with CT perfusion. AJNR Am J Neuroradiol 2019;40(12):2033–8.

Suomalainen O, Curtze S, Abou Elseoud A. E-ASPECTS and rapid in the evaluation of ischaemic core in acute stroke patients (Helskinki Stroke Registry). Presented at the 5th European Stroke Organisation Conference (ESOC); 22–24 May 2019; Milan (Italy). Eur Stroke J 2019;4(Suppl. 1):425.

Suomalainen O, Abou A, Martinez-Majander N, Forss N, Tiainen M, Curtze S. Evaluation of infarct core volume; comparison of e-aspects volume feature (NCCTCORE) with rapid perfusion imaging. Presented at 12th World Stroke Congress; 12–15 May 2020; Vienna (Austria). Int J Stroke 2020;15(1 Suppl.):294–5.

Timaran D, Mateo-Camacho Y, Morales L, Fuentes D, Torres C, Punzo R, et al. Diagnostic performance of a semiautomated (syngo.via-Vb20) and automated (rapid-AI) workstations estimating favorability of patients with acute ischaemic stroke to undergo extended thrombolysis and/or endovascular treatment. Presented at European Stroke Organisation Conference (ESOC 2021); 1–3 Sept 2021; Virtual. Eur Stroke J 2021;6(1 Suppl.):354–5.

Tolhuisen ML, Ponomareva E, Koopman MS, Jansen IG, Boers AM, Majoie CB, Marquering HA. Artificial intelligence based detection of large-vessel occlusion on non-contrast computed tomography in stroke. Presented at the International Stroke Conference; 6–8 February 2019; Honolulu (HI). Stroke 2019;50(Suppl. 1):WP70.

Tsang ACO, Lenck S, Hilditch C, Nicholson P, Brinjikji W, Krings T, et al. Automated CT perfusion imaging versus non-contrast CT for ischaemic core assessment in large-vessel occlusion. Clin Neuroradiol 2020;30(1):109–14.

Tyan YS, Wu MC, Chin CL, Kuo YL, Lee MS, Chang HY. Ischaemic stroke detection system with a computer-aided diagnostic ability using an unsupervised feature perception enhancement method. Int J Biomed Imaging 2014;2014:947539.

University of Guadalajara. Automated diagnosis of stroke in computed tomography with the use of artificial intelligence. NCT03874702. 2019. URL: https://ClinicalTrials.gov/show/NCT03874702 (accessed 30 July 2021).

Vargas J, Moorhead S, Chaudry M, Turner R, Turk A. A comparison of two automated CTP algorithms for estimation of core infarct. Presented at 18th Annual Meeting of the Society of NeuroInterventional Surgery (SNIS 2021); 26–29 July 2021; Virtual. J Neurointerv Surg 2021;13(Suppl. 1):A72.

Voter AF, Meram E, Garrett JW, Yu JJ. Diagnostic accuracy and failure mode analysis of a deep learning algorithm for the detection of intracranial hemorrhage. J Am Coll Radiol 2021;18:1143–52. https://dx.doi.org/10.1016/j.jacr.2021.03.005

Voter AF, Meram E, Garrett JW, Yu JJ. Diagnostic accuracy and failure mode analysis of a deep learning algorithm for the detection of intracranial hemorrhage. J Am Coll Radiol 2021;18(8):1143–52.

Vyas D, Bohra V, Karan V, Huded V. Rapid processing of perfusion and diffusion for ischaemic strokes in the extended time window: an Indian experience. Ann Indian Acad Neurol 2019;22(1):96–9.

Wang C, Shi Z, Yang M, Huang L, Fang W, Jiang L, et al. Deep learning-based identification of acute ischaemic core and deficit from non-contrast CT and CTA. J Cereb Blood Flow Metab 2021;41:3028–38. https://dx.doi.org/10.1177/0271678X211023660

Wang TG, Chen LG, Jin XL, Yuan Y, Zhang QW, Shao CW, Lu J. CT perfusion based ASPECTS improves the diagnostic performance of early ischaemic changes in large-vessel occlusion. BMC Med Imaging 2021;21(1):67.

Weiss D, Chuang D, Fadhil A, Duncan K, Smith M, Weiss A, et al. E-Aspects predicts decompressive hemicraniectomy. Neurology 2020;94(15 Suppl.):317.

Weiss DL, Chuang DY, Fadhil A, Duncan KR, Weiss A, Smith ML, Sundararajan S. Use of the electronic Alberta stroke program early CT score software to guide treatment of patients with acute ischaemic stroke. Presented at the International Stroke Conference Virtual; 17–19 March 2021. Stroke 2021;52(Suppl. 1):P364.

Yang L, Liu Q, Zhao Q, Zhu X, Wang L. Machine learning is a valid method for predicting prehospital delay after acute ischaemic stroke. Brain Behav 2020;10(10):e01794.

Yang W, Hong JY, Kim JY, Paik SH, Lee SH, Park JS, et al. A novel singular value decomposition-based denoising method in 4-dimensional computed tomography of the brain in stroke patients with statistical evaluation. Sensors 2020;20(11):3063.

Zamarro Parra J, Parrilla G, Espinosa de Rueda Ruiz M, Blanca GVN, Jose DP, Diego PG. Automated acute infarct volume and collateral assessment strongly predicts clinical outcome in patients undergoing mechanical thrombectomy. Presented at the 5th European Stroke Organisation Conference (ESOC); 22–24 May 2019; Milan (Italy). Eur Stroke J 2019;4(Suppl. 1):423.

Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis.

Journal

Informations de publication

Résumé

Sections du résumé

Autres résumés

Identifiants

Types de publication

Langues

Sous-ensembles de citation

Pagination

Références

Auteurs

Marie Westwood (M)

Bram Ramaekers (B)

Sabine Grimm (S)

Nigel Armstrong (N)

Ben Wijnen (B)

Charlotte Ahmadu (C)

Shelley de Kock (S)

Caro Noake (C)

Manuela Joore (M)

Classifications MeSH