Unleashing the potential of digital pathology data by training computer-aided diagnosis models without human annotations.


Journal

NPJ digital medicine
ISSN: 2398-6352
Titre abrégé: NPJ Digit Med
Pays: England
ID NLM: 101731738

Informations de publication

Date de publication:
22 Jul 2022
Historique:
received: 11 08 2021
accepted: 24 06 2022
entrez: 22 7 2022
pubmed: 23 7 2022
medline: 23 7 2022
Statut: epublish

Résumé

The digitalization of clinical workflows and the increasing performance of deep learning algorithms are paving the way towards new methods for tackling cancer diagnosis. However, the availability of medical specialists to annotate digitized images and free-text diagnostic reports does not scale with the need for large datasets required to train robust computer-aided diagnosis methods that can target the high variability of clinical cases and data produced. This work proposes and evaluates an approach to eliminate the need for manual annotations to train computer-aided diagnosis tools in digital pathology. The approach includes two components, to automatically extract semantically meaningful concepts from diagnostic reports and use them as weak labels to train convolutional neural networks (CNNs) for histopathology diagnosis. The approach is trained (through 10-fold cross-validation) on 3'769 clinical images and reports, provided by two hospitals and tested on over 11'000 images from private and publicly available datasets. The CNN, trained with automatically generated labels, is compared with the same architecture trained with manual labels. Results show that combining text analysis and end-to-end deep neural networks allows building computer-aided diagnosis tools that reach solid performance (micro-accuracy = 0.908 at image-level) based only on existing clinical data without the need for manual annotations.

Identifiants

pubmed: 35869179
doi: 10.1038/s41746-022-00635-4
pii: 10.1038/s41746-022-00635-4
pmc: PMC9307641
doi:

Types de publication

Journal Article

Langues

eng

Pagination

102

Subventions

Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 825292

Informations de copyright

© 2022. The Author(s).

Références

Nat Biomed Eng. 2021 Jun;5(6):555-570
pubmed: 33649564
Front Bioeng Biotechnol. 2019 May 15;7:102
pubmed: 31158269
J Natl Compr Canc Netw. 2018 Apr;16(4):359-369
pubmed: 29632055
Oncology. 2020;98(6):396-402
pubmed: 31177262
BMC Bioinformatics. 2017 May 26;18(1):281
pubmed: 28549410
NPJ Digit Med. 2019 Jun 21;2:56
pubmed: 31304402
JCO Clin Cancer Inform. 2019 Apr;3:1-7
pubmed: 30990737
Hum Pathol. 2013 Mar;44(3):357-64
pubmed: 22835956
J Digit Imaging. 2021 Feb;34(1):105-115
pubmed: 33169211
Sci Rep. 2018 Aug 13;8(1):12054
pubmed: 30104757
Biochem Med (Zagreb). 2012;22(3):276-82
pubmed: 23092060
IEEE Rev Biomed Eng. 2009;2:147-71
pubmed: 20671804
J Pathol Inform. 2017 Dec 19;8:51
pubmed: 29416914
Med Image Anal. 2019 Dec;58:101544
pubmed: 31466046
Med Image Anal. 2016 Oct;33:170-175
pubmed: 27423409
Lancet Oncol. 2019 May;20(5):e253-e261
pubmed: 31044723
JAMA Netw Open. 2021 Apr 1;4(4):e214708
pubmed: 33825840
Arch Pathol Lab Med. 2019 Dec;143(12):1545-1555
pubmed: 31173528
Gastroenterology. 2017 Feb;152(3):564-570.e4
pubmed: 27818167
Sci Rep. 2019 Mar 4;9(1):3358
pubmed: 30833650
Nat Med. 2019 Aug;25(8):1301-1309
pubmed: 31308507
J Pathol Inform. 2014 Mar 28;5(1):14
pubmed: 24843825
Nat Med. 2021 May;27(5):775-784
pubmed: 33990804
Clin Gastroenterol Hepatol. 2004 Jan;2(1):1-8
pubmed: 15017625
IEEE Trans Med Imaging. 2015 Nov;34(11):2366-78
pubmed: 25993703
J Pathol. 2019 Nov;249(3):286-294
pubmed: 31355445
Sci Rep. 2017 Dec 4;7(1):16852
pubmed: 29203775
Sci Rep. 2018 Sep 12;8(1):13692
pubmed: 30209315
Pathol Res Pract. 2020 Sep;216(9):153040
pubmed: 32825928
BioData Min. 2017 Dec 8;10:35
pubmed: 29234465
Med Image Anal. 2020 Oct;65:101759
pubmed: 32623277
J Clin Epidemiol. 2003 Mar;56(3):209-14
pubmed: 12725874
Mod Pathol. 2020 Nov;33(11):2115-2127
pubmed: 32572154
Sci Rep. 2021 Jul 13;11(1):14358
pubmed: 34257363

Auteurs

Niccolò Marini (N)

Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO Valais), Sierre, Switzerland. niccolo.marini@hevs.ch.
Centre Universitaire d'Informatique, University of Geneva, Geneva, Switzerland. niccolo.marini@hevs.ch.

Stefano Marchesin (S)

Department of Information Engineering, University of Padua, Padua, Italy.

Sebastian Otálora (S)

Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO Valais), Sierre, Switzerland.
Centre Universitaire d'Informatique, University of Geneva, Geneva, Switzerland.

Marek Wodzinski (M)

Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO Valais), Sierre, Switzerland.
Department of Measurement and Electronics, AGH University of Science and Technology, Krakow, Poland.

Alessandro Caputo (A)

Department of Pathology, Ruggi University Hospital, Salerno, Italy.
Pathology Unit, Gravina Hospital Caltagirone ASP, Catania, Italy.

Mart van Rijthoven (M)

Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands.

Witali Aswolinskiy (W)

Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands.

John-Melle Bokhorst (JM)

Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands.

Damian Podareanu (D)

SURFsara, Amsterdam, The Netherlands.

Edyta Petters (E)

MicroscopeIT, Wrocław, Poland.

Svetla Boytcheva (S)

Sirma AI, Sofia, Bulgaria.
Institute of Information and Communication Technologies, Bulgarian Academy of Sciences, Sofia, Bulgaria.

Genziana Buttafuoco (G)

Pathology Unit, Gravina Hospital Caltagirone ASP, Catania, Italy.

Simona Vatrano (S)

Pathology Unit, Gravina Hospital Caltagirone ASP, Catania, Italy.

Filippo Fraggetta (F)

Pathology Unit, Gravina Hospital Caltagirone ASP, Catania, Italy.
Pathology Unit, Cannizzaro Hospital, Catania, Italy.

Jeroen van der Laak (J)

Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands.
Center for Medical Image Science and Visualization, Linkoping University, Linkoping, Sweden.

Maristella Agosti (M)

Department of Information Engineering, University of Padua, Padua, Italy.

Francesco Ciompi (F)

Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands.

Gianmaria Silvello (G)

Department of Information Engineering, University of Padua, Padua, Italy.

Henning Muller (H)

Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO Valais), Sierre, Switzerland.
Medical Faculty, University of Geneva, Geneva, Switzerland.

Manfredo Atzori (M)

Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO Valais), Sierre, Switzerland.
Department of Neuroscience, University of Padua, Padua, Italy.

Classifications MeSH