Assessment of a computerized quantitative quality control tool for whole slide images of kidney biopsies.
NEPTUNE
batch effects
computational pathology
computer vision
digital pathology
inter-reader variability
kidney biopsies
machine learning
quality control
whole-slide image
Journal
The Journal of pathology
ISSN: 1096-9896
Titre abrégé: J Pathol
Pays: England
ID NLM: 0204634
Informations de publication
Date de publication:
03 2021
03 2021
Historique:
received:
10
08
2020
revised:
30
10
2020
accepted:
11
11
2020
pubmed:
17
11
2020
medline:
29
5
2021
entrez:
16
11
2020
Statut:
ppublish
Résumé
Inconsistencies in the preparation of histology slides and whole-slide images (WSIs) may lead to challenges with subsequent image analysis and machine learning approaches for interrogating the WSI. These variabilities are especially pronounced in multicenter cohorts, where batch effects (i.e. systematic technical artifacts unrelated to biological variability) may introduce biases to machine learning algorithms. To date, manual quality control (QC) has been the de facto standard for dataset curation, but remains highly subjective and is too laborious in light of the increasing scale of tissue slide digitization efforts. This study aimed to evaluate a computer-aided QC pipeline for facilitating a reproducible QC process of WSI datasets. An open source tool, HistoQC, was employed to identify image artifacts and compute quantitative metrics describing visual attributes of WSIs to the Nephrotic Syndrome Study Network (NEPTUNE) digital pathology repository. A comparison in inter-reader concordance between HistoQC aided and unaided curation was performed to quantify improvements in curation reproducibility. HistoQC metrics were additionally employed to quantify the presence of batch effects within NEPTUNE WSIs. Of the 1814 WSIs (458 H&E, 470 PAS, 438 silver, 448 trichrome) from n = 512 cases considered in this study, approximately 9% (163) were identified as unsuitable for subsequent computational analysis. The concordance in the identification of these WSIs among computational pathologists rose from moderate (Gwet's AC1 range 0.43 to 0.59 across stains) to excellent (Gwet's AC1 range 0.79 to 0.93 across stains) agreement when aided by HistoQC. Furthermore, statistically significant batch effects (p < 0.001) in the NEPTUNE WSI dataset were discovered. Taken together, our findings strongly suggest that quantitative QC is a necessary step in the curation of digital pathology cohorts. © 2020 The Pathological Society of Great Britain and Ireland. Published by John Wiley & Sons, Ltd.
Identifiants
pubmed: 33197281
doi: 10.1002/path.5590
pmc: PMC8392148
mid: NIHMS1733690
doi:
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't
Research Support, U.S. Gov't, Non-P.H.S.
Langues
eng
Sous-ensembles de citation
IM
Pagination
268-278Subventions
Organisme : NCI NIH HHS
ID : R01 CA216579
Pays : United States
Organisme : NIDDK NIH HHS
ID : R01-DK-118431.
Pays : United States
Organisme : NCI NIH HHS
ID : R01CA208236-01A1
Pays : United States
Organisme : NIDDK NIH HHS
ID : U54 DK083912
Pays : United States
Organisme : NCRR NIH HHS
ID : C06 RR012463
Pays : United States
Organisme : NCI NIH HHS
ID : R01 CA220581-01A1
Pays : United States
Organisme : NCI NIH HHS
ID : U24 CA199374
Pays : United States
Organisme : NCI NIH HHS
ID : 1U01 CA239055-01
Pays : United States
Organisme : NIBIB NIH HHS
ID : R43 EB028736
Pays : United States
Organisme : NCI NIH HHS
ID : U01 CA239055
Pays : United States
Organisme : NIDDK NIH HHS
ID : T32 DK007470
Pays : United States
Organisme : NHLBI NIH HHS
ID : R01 HL151277
Pays : United States
Organisme : NCI NIH HHS
ID : R01 CA220581
Pays : United States
Organisme : NCI NIH HHS
ID : 1U24CA199374-01
Pays : United States
Organisme : NCI NIH HHS
ID : R01 CA202752
Pays : United States
Organisme : NCI NIH HHS
ID : R01 CA208236
Pays : United States
Organisme : NCI NIH HHS
ID : U01 CA248226
Pays : United States
Organisme : NCI NIH HHS
ID : R01 CA216579-01A1
Pays : United States
Organisme : National Institute for Biomedical Imaging and Bioengineering
ID : 1R43EB028736-01
Organisme : BLRD VA
ID : I01 BX004121
Pays : United States
Organisme : NCI NIH HHS
ID : 1U01 CA248226-01
Pays : United States
Organisme : NCI NIH HHS
ID : R01CA202752-01A1
Pays : United States
Organisme : Neptune Career Development Award
ID : 5T32DK747033
Organisme : NCRR NIH HHS
ID : 1 C06 RR12463-01
Pays : United States
Informations de copyright
© 2020 The Pathological Society of Great Britain and Ireland. Published by John Wiley & Sons, Ltd.
Références
Clin Kidney J. 2017 Apr;10(2):176-187
pubmed: 28584625
Med Phys. 2020 Dec;47(12):6029-6038
pubmed: 33176026
Med Image Anal. 2016 Oct;33:170-175
pubmed: 27423409
J Proteome Res. 2016 Mar 4;15(3):777-87
pubmed: 26653327
Arch Pathol Lab Med. 2018 May;142(5):613-625
pubmed: 29457738
Bioinformatics. 2016 Oct 1;32(19):3047-8
pubmed: 27312411
Genet Epidemiol. 2010 Sep;34(6):591-602
pubmed: 20718045
Clin J Am Soc Nephrol. 2013 Aug;8(8):1449-59
pubmed: 23393107
IEEE Trans Med Imaging. 2020 Jan;39(1):62-74
pubmed: 31150339
Diagn Pathol. 2014;9 Suppl 1:S3
pubmed: 25565494
Bioinformatics. 2018 Aug 1;34(15):2634-2641
pubmed: 29506177
Curr Protoc Hum Genet. 2011 Jan;Chapter 1:Unit1.19
pubmed: 21234875
Kidney Int. 2013 Apr;83(4):749-56
pubmed: 23325076
Annu Rev Biomed Eng. 2016 Jul 11;18:387-412
pubmed: 27420575
JCO Clin Cancer Inform. 2019 Apr;3:1-7
pubmed: 30990737
Med J Armed Forces India. 2017 Oct;73(4):410-413
pubmed: 29386721
J Vet Diagn Invest. 2018 May;30(3):377-385
pubmed: 29429400