Generalizable biomarker prediction from cancer pathology slides with self-supervised deep learning: A retrospective multi-centric study.

artificial intelligence attention heatmaps attention-based multiple-instance learning biomarker colorectal cancer computational pathology multi-input models oncogenic mutation self-supervised learning

Journal

Cell reports. Medicine
ISSN: 2666-3791
Titre abrégé: Cell Rep Med
Pays: United States
ID NLM: 101766894

Informations de publication

Date de publication:
18 04 2023
Historique:
received: 25 09 2022
revised: 28 12 2022
accepted: 24 02 2023
medline: 21 4 2023
pubmed: 24 3 2023
entrez: 23 3 2023
Statut: ppublish

Résumé

Deep learning (DL) can predict microsatellite instability (MSI) from routine histopathology slides of colorectal cancer (CRC). However, it is unclear whether DL can also predict other biomarkers with high performance and whether DL predictions generalize to external patient populations. Here, we acquire CRC tissue samples from two large multi-centric studies. We systematically compare six different state-of-the-art DL architectures to predict biomarkers from pathology slides, including MSI and mutations in BRAF, KRAS, NRAS, and PIK3CA. Using a large external validation cohort to provide a realistic evaluation setting, we show that models using self-supervised, attention-based multiple-instance learning consistently outperform previous approaches while offering explainable visualizations of the indicative regions and morphologies. While the prediction of MSI and BRAF mutations reaches a clinical-grade performance, mutation prediction of PIK3CA, KRAS, and NRAS was clinically insufficient.

Identifiants

pubmed: 36958327
pii: S2666-3791(23)00086-1
doi: 10.1016/j.xcrm.2023.100980
pmc: PMC10140458
pii:
doi:

Substances chimiques

Proto-Oncogene Proteins B-raf EC 2.7.11.1
Proto-Oncogene Proteins p21(ras) EC 3.6.5.2
Biomarkers 0
Class I Phosphatidylinositol 3-Kinases EC 2.7.1.137

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

100980

Informations de copyright

Copyright © 2023 The Author(s). Published by Elsevier Inc. All rights reserved.

Déclaration de conflit d'intérêts

Declaration of interests For transparency, we provide the following information: J.N.K. declares consulting services for Owkin, France; Panakeia, UK; and DoMore Diagnostics, Norway. P.Q. and N.P.W. declare research funding from Roche and PQ consulting and speaker services for Roche. P.Q. is a National Institute of Health Research senior investigator.

Références

Nat Cancer. 2020 Aug;1(8):789-799
pubmed: 33763651
Nat Med. 2019 Jul;25(7):1054-1056
pubmed: 31160815
Int J Cancer. 2021 Aug 1;149(3):728-740
pubmed: 33851412
Nat Rev Clin Oncol. 2019 Nov;16(11):703-715
pubmed: 31399699
Am J Surg Pathol. 2009 Jan;33(1):126-33
pubmed: 18830122
J Hepatol. 2022 Jul;77(1):116-127
pubmed: 35143898
Nat Cancer. 2022 Sep;3(9):1026-1038
pubmed: 36138135
Lancet Oncol. 2021 Jan;22(1):132-141
pubmed: 33387492
Nat Med. 2018 Oct;24(10):1559-1567
pubmed: 30224757
Cancer Res. 1998 Nov 15;58(22):5248-57
pubmed: 9823339
J Thorac Oncol. 2010 Sep;5(9):1315-6
pubmed: 20736804
ESMO Open. 2022 Apr;7(2):100400
pubmed: 35247870
Gastric Cancer. 2019 Nov;22(6):1193-1203
pubmed: 31111275
JAMA Oncol. 2022 Oct 1;8(10):1456-1465
pubmed: 36006624
Med Image Anal. 2022 Jul;79:102474
pubmed: 35588568
Cancer Cell. 2022 Aug 8;40(8):865-878.e6
pubmed: 35944502
Cancer Cell. 2023 Jan 9;41(1):5-6
pubmed: 36368319
Theranostics. 2020 Sep 2;10(24):11080-11091
pubmed: 33042271
ESMO Open. 2022 Apr;7(2):100429
pubmed: 35397433
Am J Pathol. 2002 Sep;161(3):1087-97
pubmed: 12213737
Histopathology. 2022 Jun;80(7):1121-1127
pubmed: 35373378
Nature. 2017 Feb 2;542(7639):115-118
pubmed: 28117445
J Pathol. 2022 Jul;257(4):430-444
pubmed: 35342954
Nat Med. 2019 Aug;25(8):1301-1309
pubmed: 31308507
J Natl Cancer Inst. 2015 Mar 13;107(6):djv045
pubmed: 25770147
Gastroenterology. 2020 Oct;159(4):1406-1416.e11
pubmed: 32562722
Cancer Res. 2005 Sep 15;65(18):8072-8
pubmed: 16166278
J Pathol. 2022 Jan;256(1):50-60
pubmed: 34561876
Br J Cancer. 2021 Feb;124(4):686-696
pubmed: 33204028
Am J Surg Pathol. 2012 May;36(5):744-52
pubmed: 22314188
Nature. 2021 Jun;594(7861):106-110
pubmed: 33953404
Nat Med. 2022 Mar;28(3):575-582
pubmed: 35314822
NPJ Precis Oncol. 2023 Mar 28;7(1):35
pubmed: 36977919
Lancet. 2007 Dec 15;370(9604):2020-9
pubmed: 18083404
Immunity. 2016 Mar 15;44(3):698-711
pubmed: 26982367
J Pathol. 2022 Mar;256(3):269-281
pubmed: 34738636
Nat Rev Cancer. 2021 Mar;21(3):199-211
pubmed: 33514930
Br J Cancer. 2016 Nov 22;115(11):1359-1366
pubmed: 27811854
Nat Rev Gastroenterol Hepatol. 2020 Oct;17(10):591-592
pubmed: 32620817
World J Gastroenterol. 2020 Oct 28;26(40):6207-6223
pubmed: 33177794
Med Image Anal. 2022 Jul;79:102464
pubmed: 35596966
BMJ. 2011 Nov 09;343:d6751
pubmed: 22074710
Nat Commun. 2021 Jul 20;12(1):4423
pubmed: 34285218
Lancet Digit Health. 2021 Dec;3(12):e763-e772
pubmed: 34686474
Gut. 2006 Aug;55(8):1145-50
pubmed: 16469791
J Clin Oncol. 2011 Oct 1;29(28):3761-7
pubmed: 21876077
Histopathology. 2007 Jan;50(1):103-12
pubmed: 17204025
Nat Cancer. 2020 Aug;1(8):800-810
pubmed: 35122049
Med Image Anal. 2023 Jan;83:102645
pubmed: 36270093
J Clin Oncol. 2011 Apr 1;29(10):1261-70
pubmed: 21383284
Scand J Gastroenterol. 2004 Aug;39(8):748-53
pubmed: 15513360

Auteurs

Jan Moritz Niehues (JM)

Else Kroener Fresenius Center for Digital Health, Technical University Dresden, 01307 Dresden, Germany; Department of Medicine III, University Hospital RWTH Aachen, 52074 Aachen, Germany.

Philip Quirke (P)

Pathology & Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds LS9 7TF, UK.

Nicholas P West (NP)

Pathology & Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds LS9 7TF, UK.

Heike I Grabsch (HI)

Pathology & Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds LS9 7TF, UK; Department of Pathology, GROW School for Oncology and Reproduction, Maastricht University Medical Center+, 6229 HX Maastricht, the Netherlands.

Marko van Treeck (M)

Else Kroener Fresenius Center for Digital Health, Technical University Dresden, 01307 Dresden, Germany; Department of Medicine III, University Hospital RWTH Aachen, 52074 Aachen, Germany.

Yoni Schirris (Y)

Else Kroener Fresenius Center for Digital Health, Technical University Dresden, 01307 Dresden, Germany; Netherlands Cancer Institute, 1066 CX Amsterdam, the Netherlands; University of Amsterdam, 1012 WP Amsterdam, the Netherlands.

Gregory P Veldhuizen (GP)

Else Kroener Fresenius Center for Digital Health, Technical University Dresden, 01307 Dresden, Germany; Department of Medicine III, University Hospital RWTH Aachen, 52074 Aachen, Germany.

Gordon G A Hutchins (GGA)

Pathology & Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds LS9 7TF, UK.

Susan D Richman (SD)

Pathology & Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds LS9 7TF, UK.

Sebastian Foersch (S)

Institute of Pathology, University Medical Center Mainz, 55131 Mainz, Germany.

Titus J Brinker (TJ)

Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), 69120 Heidelberg, Germany.

Junya Fukuoka (J)

Department of Pathology Informatics, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki 852-8523, Japan; Department of Pathology, Kameda Medical Center, Kamogawa 296-8602, Chiba, Japan.

Andrey Bychkov (A)

Department of Pathology, Kameda Medical Center, Kamogawa 296-8602, Chiba, Japan.

Wataru Uegami (W)

Department of Pathology, Kameda Medical Center, Kamogawa 296-8602, Chiba, Japan.

Daniel Truhn (D)

Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, 52074 Aachen, Germany.

Hermann Brenner (H)

Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), 69120 Heidelberg, Germany; Division of Preventive Oncology, German Cancer Research Center (DKFZ) and National Center for Tumor Diseases (NCT), 69120 Heidelberg, Germany; German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), 69120 Heidelberg, Germany.

Alexander Brobeil (A)

Institute of Pathology, University Hospital Heidelberg, 69120 Heidelberg, Germany; Tissue Bank, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, 69120 Heidelberg, Germany.

Michael Hoffmeister (M)

Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), 69120 Heidelberg, Germany.

Jakob Nikolas Kather (JN)

Else Kroener Fresenius Center for Digital Health, Technical University Dresden, 01307 Dresden, Germany; Department of Medicine III, University Hospital RWTH Aachen, 52074 Aachen, Germany; Pathology & Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds LS9 7TF, UK; Department of Medicine I, University Hospital Dresden, 01307 Dresden, Germany; Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, 69120 Heidelberg, Germany. Electronic address: jakob-nikolas.kather@alumni.dkfz.de.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH