Reliability of whole mount radical prostatectomy histopathology as the ground truth for artificial intelligence assisted prostate imaging.
Ground truth
Pathology annotation
Prostate cancer
Radical prostatectomy
Journal
Virchows Archiv : an international journal of pathology
ISSN: 1432-2307
Titre abrégé: Virchows Arch
Pays: Germany
ID NLM: 9423843
Informations de publication
Date de publication:
Aug 2023
Aug 2023
Historique:
received:
20
04
2023
accepted:
26
06
2023
revised:
05
06
2023
medline:
10
8
2023
pubmed:
6
7
2023
entrez:
5
7
2023
Statut:
ppublish
Résumé
The development of artificial intelligence-based imaging techniques for prostate cancer (PCa) detection and diagnosis requires a reliable ground truth, which is generally based on histopathology from radical prostatectomy specimens. This study proposes a comprehensive protocol for the annotation of prostatectomy pathology slides. To evaluate the reliability of the protocol, interobserver variability was assessed between five pathologists, who annotated ten radical prostatectomy specimens consisting of 74 whole mount pathology slides. Interobserver variability was assessed for both the localization and grading of PCa. The results indicate excellent overall agreement on the localization of PCa (Gleason pattern ≥ 3) and clinically significant PCa (Gleason pattern ≥ 4), with Dice similarity coefficients (DSC) of 0.91 and 0.88, respectively. On a per-slide level, agreement for primary and secondary Gleason pattern was almost perfect and substantial, with Fleiss Kappa of .819 (95% CI .659-.980) and .726 (95% CI .573-.878), respectively. Agreement on International Society of Urological Pathology Grade Group was evaluated for the index lesions and showed agreement in 70% of cases, with a mean DSC of 0.92 for all index lesions. These findings show that a standardized protocol for prostatectomy pathology annotation provides reliable data on PCa localization and grading, with relatively high levels of interobserver agreement. More complicated tissue characterization, such as the presence of cribriform growth and intraductal carcinoma, remains a source of interobserver variability and should be treated with care when used in ground truth datasets.
Identifiants
pubmed: 37407736
doi: 10.1007/s00428-023-03589-4
pii: 10.1007/s00428-023-03589-4
pmc: PMC10412486
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
197-206Subventions
Organisme : European Union
ID : 101057919
Informations de copyright
© 2023. The Author(s).
Références
Acad Radiol. 2004 Feb;11(2):178-89
pubmed: 14974593
Am J Surg Pathol. 2020 Aug;44(8):e87-e99
pubmed: 32459716
Mod Pathol. 2019 Jan;32(1):139-146
pubmed: 30349027
Lancet Digit Health. 2020 Aug;2(8):e407-e416
pubmed: 33328045
Scand J Urol. 2016 Dec;50(6):420-424
pubmed: 27416104
Eur Urol. 2021 Feb;79(2):243-262
pubmed: 33172724
Urology. 2002 Aug;60(2):264-9
pubmed: 12137824
Mod Pathol. 2015 Mar;28(3):457-64
pubmed: 25189638
Urology. 2011 May;77(5):1155-60
pubmed: 21146858
Eur Urol Focus. 2022 Sep;8(5):1187-1191
pubmed: 34922897
Histopathology. 2006 May;48(6):644-54
pubmed: 16681679
Radiology. 2020 Apr;295(1):4-15
pubmed: 32068507
J Magn Reson Imaging. 2021 Aug;54(2):462-471
pubmed: 33719168
Eur Radiol. 2020 Feb;30(2):806-815
pubmed: 31602512
J Magn Reson Imaging. 2021 Jun;53(6):1632-1645
pubmed: 32410356
J Urol. 2011 Nov;186(5):1818-24
pubmed: 21944089
Am J Surg Pathol. 2021 Aug 1;45(8):1118-1126
pubmed: 33999555
Eur Urol. 2016 Nov;70(5):846-853
pubmed: 26810346
Virchows Arch. 2021 Feb;478(2):249-256
pubmed: 32815034
Eur Urol Open Sci. 2023 Jan 26;49:32-43
pubmed: 36874606
Can Urol Assoc J. 2021 Jan;15(1):E11-E16
pubmed: 32701437
Histopathology. 2016 Sep;69(3):441-9
pubmed: 27028587
Radiology. 2018 Mar;286(3):800-809
pubmed: 29309734
BJU Int. 2020 Oct;126(4):481-493
pubmed: 32315112
Eur Urol Focus. 2022 Mar;8(2):409-417
pubmed: 33773964