Automated acquisition of explainable knowledge from unannotated histopathology images.


Journal

Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555

Informations de publication

Date de publication:
18 12 2019
Historique:
received: 14 12 2018
accepted: 19 11 2019
entrez: 20 12 2019
pubmed: 20 12 2019
medline: 26 2 2020
Statut: epublish

Résumé

Deep learning algorithms have been successfully used in medical image classification. In the next stage, the technology of acquiring explainable knowledge from medical images is highly desired. Here we show that deep learning algorithm enables automated acquisition of explainable features from diagnostic annotation-free histopathology images. We compare the prediction accuracy of prostate cancer recurrence using our algorithm-generated features with that of diagnosis by expert pathologists using established criteria on 13,188 whole-mount pathology images consisting of over 86 billion image patches. Our method not only reveals findings established by humans but also features that have not been recognized, showing higher accuracy than human in prognostic prediction. Combining both our algorithm-generated features and human-established criteria predicts the recurrence more accurately than using either method alone. We confirm robustness of our method using external validation datasets including 2276 pathology images. This study opens up fields of machine learning analysis for discovering uncharted knowledge.

Identifiants

pubmed: 31852890
doi: 10.1038/s41467-019-13647-8
pii: 10.1038/s41467-019-13647-8
pmc: PMC6920352
doi:

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

5642

Commentaires et corrections

Type : CommentIn

Références

IEEE Rev Biomed Eng. 2009;2:147-71
pubmed: 20671804
Int J Urol. 2015 Feb;22(2):140-5
pubmed: 25358604
Lancet. 2018 Dec 1;392(10162):2388-2396
pubmed: 30318264
Nature. 2017 Oct 18;550(7676):354-359
pubmed: 29052630
JAMA. 2017 Dec 12;318(22):2199-2210
pubmed: 29234806
Nature. 2016 Jan 28;529(7587):484-9
pubmed: 26819042
Sci Rep. 2018 Sep 3;8(1):13124
pubmed: 30177857
Nature. 2009 Aug 6;460(7256):748-52
pubmed: 19571811
Nat Med. 2018 Sep;24(9):1342-1350
pubmed: 30104768
Electron J Stat. 2015;9(1):1583-1607
pubmed: 26279737
N Engl J Med. 2005 Jan 13;352(2):125-34
pubmed: 15647575
Eur Urol. 2017 Apr;71(4):630-642
pubmed: 27591931
Urology. 2009 Sep;74(3):497-503
pubmed: 19376571
Radiology. 2017 Aug;284(2):574-582
pubmed: 28436741
Nature. 2017 Feb 2;542(7639):115-118
pubmed: 28117445
Lancet Respir Med. 2015 Jan;3(1):42-52
pubmed: 25466337
IEEE Trans Biomed Eng. 2012 May;59(5):1205-18
pubmed: 20570758
Science. 2006 Jul 28;313(5786):504-7
pubmed: 16873662
Am J Surg Pathol. 2016 Feb;40(2):244-52
pubmed: 26492179
Sci Rep. 2017 Apr 25;7:46732
pubmed: 28440283
Mod Pathol. 2019 Jan;32(1):122-127
pubmed: 30181565
Comput Struct Biotechnol J. 2018 Feb 09;16:34-42
pubmed: 30275936
Nat Med. 2019 Sep;25(9):1453-1457
pubmed: 31406351
Arch Pathol Lab Med. 2013 Dec;137(12):1723-32
pubmed: 23738764

Auteurs

Yoichiro Yamamoto (Y)

Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan. yoichiro.yamamoto@riken.jp.
Department of Pathology, Shinshu University School of Medicine, 3-1-1 Asahi, Matsumoto, Nagano, 390-8621, Japan. yoichiro.yamamoto@riken.jp.

Toyonori Tsuzuki (T)

Department of Surgical Pathology, Aichi Medical University Hospital, 1-1 Yazakokarimata, Nagakute, Aichi, 480-1195, Japan.

Jun Akatsuka (J)

Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.
Department of Urology, Nippon Medical School Hospital, 1-1-5 Sendagi, Bunkyo-ku, Tokyo, 113-8603, Japan.

Masao Ueki (M)

Statistical Genetics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.

Hiromu Morikawa (H)

Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.

Yasushi Numata (Y)

Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.

Taishi Takahara (T)

Department of Surgical Pathology, Aichi Medical University Hospital, 1-1 Yazakokarimata, Nagakute, Aichi, 480-1195, Japan.

Takuji Tsuyuki (T)

Department of Surgical Pathology, Aichi Medical University Hospital, 1-1 Yazakokarimata, Nagakute, Aichi, 480-1195, Japan.

Kotaro Tsutsumi (K)

Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.

Ryuto Nakazawa (R)

Department of Urology, St. Marianna University School of Medicine, 2-16-1 Sugao, Miyamae-ku, Kawasaki, Kanagawa, 216-8511, Japan.

Akira Shimizu (A)

Department of Analytic Human Pathology, Nippon Medical School, 1-1-5 Sendagi, Bunkyo-ku, Tokyo, 113-8603, Japan.

Ichiro Maeda (I)

Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.
Department of Pathology, St. Marianna University School of Medicine, 2-16-1 Sugao, Miyamae-ku, Kawasaki, Kanagawa, 216-8511, Japan.

Shinichi Tsuchiya (S)

Diagnostic Pathology, Ritsuzankai Iida Hospital, 1-15 Odori, Iida, Nagano, 395-8505, Japan.

Hiroyuki Kanno (H)

Department of Pathology, Shinshu University School of Medicine, 3-1-1 Asahi, Matsumoto, Nagano, 390-8621, Japan.

Yukihiro Kondo (Y)

Department of Urology, Nippon Medical School Hospital, 1-1-5 Sendagi, Bunkyo-ku, Tokyo, 113-8603, Japan.

Manabu Fukumoto (M)

Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.
Institute of Development, Aging and Cancer, Tohoku University, 4-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8575, Japan.

Gen Tamiya (G)

Statistical Genetics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.
Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8573, Japan.

Naonori Ueda (N)

Goal-Oriented Technology Research Group, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Bldg. 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.

Go Kimura (G)

Department of Urology, Nippon Medical School Hospital, 1-1-5 Sendagi, Bunkyo-ku, Tokyo, 113-8603, Japan. gokimura@nms.ac.jp.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH