Semantic annotation for computational pathology: multidisciplinary experience and best practice recommendations.

annotations computational pathology guidelines whole-slide images

Journal

The journal of pathology. Clinical research
ISSN: 2056-4538
Titre abrégé: J Pathol Clin Res
Pays: England
ID NLM: 101658534

Informations de publication

Date de publication:
03 2022
Historique:
revised: 25 11 2021
received: 25 08 2021
accepted: 10 12 2021
pubmed: 12 1 2022
medline: 17 3 2022
entrez: 11 1 2022
Statut: ppublish

Résumé

Recent advances in whole-slide imaging (WSI) technology have led to the development of a myriad of computer vision and artificial intelligence-based diagnostic, prognostic, and predictive algorithms. Computational Pathology (CPath) offers an integrated solution to utilise information embedded in pathology WSIs beyond what can be obtained through visual assessment. For automated analysis of WSIs and validation of machine learning (ML) models, annotations at the slide, tissue, and cellular levels are required. The annotation of important visual constructs in pathology images is an important component of CPath projects. Improper annotations can result in algorithms that are hard to interpret and can potentially produce inaccurate and inconsistent results. Despite the crucial role of annotations in CPath projects, there are no well-defined guidelines or best practices on how annotations should be carried out. In this paper, we address this shortcoming by presenting the experience and best practices acquired during the execution of a large-scale annotation exercise involving a multidisciplinary team of pathologists, ML experts, and researchers as part of the Pathology image data Lake for Analytics, Knowledge and Education (PathLAKE) consortium. We present a real-world case study along with examples of different types of annotations, diagnostic algorithm, annotation data dictionary, and annotation constructs. The analyses reported in this work highlight best practice recommendations that can be used as annotation guidelines over the lifecycle of a CPath project.

Identifiants

pubmed: 35014198
doi: 10.1002/cjp2.256
pmc: PMC8822374
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

116-128

Informations de copyright

© 2022 The Authors. The Journal of Pathology: Clinical Research published by The Pathological Society of Great Britain and Ireland & John Wiley & Sons, Ltd.

Références

NPJ Digit Med. 2021 Oct 7;4(1):145
pubmed: 34620993
Methods. 2014 Nov;70(1):59-73
pubmed: 25034370
IEEE Trans Med Imaging. 2020 Nov;39(11):3655-3666
pubmed: 32746112
Nat Med. 2019 Aug;25(8):1301-1309
pubmed: 31308507
J Pathol Inform. 2015 Jun 23;6:38
pubmed: 26167382
Front Med (Lausanne). 2019 Nov 14;6:255
pubmed: 31799253
Sci Rep. 2017 Dec 4;7(1):16878
pubmed: 29203879
IEEE Trans Pattern Anal Mach Intell. 2021 Nov;43(11):4037-4058
pubmed: 32386141
Nat Methods. 2012 Feb 28;9(3):245-53
pubmed: 22373911
Med Image Anal. 2021 Jan;67:101813
pubmed: 33049577
Cancer Res. 2017 Nov 1;77(21):e75-e78
pubmed: 29092945
Eur Radiol Exp. 2020 May 5;4(1):30
pubmed: 32372200
BMC Med Inform Decis Mak. 2012 Feb 15;12:8
pubmed: 22336388
Emerg Med J. 2003 Sep;20(5):453-8
pubmed: 12954688
Breast Cancer. 2018 Jan;25(1):118-125
pubmed: 28856554
Mod Pathol. 2015 Mar;28(3):324-39
pubmed: 25216230
Nat Cancer. 2020 Aug;1(8):789-799
pubmed: 33763651
Breast. 2020 Feb;49:267-273
pubmed: 31935669
Mod Pathol. 2021 Sep;34(9):1780-1794
pubmed: 34017063
Med Image Anal. 2019 Dec;58:101544
pubmed: 31466046
Stud Health Technol Inform. 2006;121:279-90
pubmed: 17095826
Arch Pathol Lab Med. 2019 Feb;143(2):222-234
pubmed: 30307746
Nature. 2017 Feb 2;542(7639):115-118
pubmed: 28117445
Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. 2019 Jun;2019:8533-8542
pubmed: 34025103
Sci Rep. 2017 Dec 4;7(1):16852
pubmed: 29203775
J Pathol Inform. 2017 Apr 10;8:19
pubmed: 28480122
IEEE Rev Biomed Eng. 2017;10:213-234
pubmed: 28092576
Med Image Anal. 2019 Dec;58:101563
pubmed: 31561183
Methods Mol Biol. 2011;691:69-82
pubmed: 20972747
Cell Syst. 2017 Dec 27;5(6):620-627.e3
pubmed: 29153840
Bioinformatics. 2016 May 1;32(9):1395-401
pubmed: 26755625
Med Image Anal. 2020 Oct;65:101771
pubmed: 32769053
Histopathology. 1991 Nov;19(5):403-10
pubmed: 1757079
Nat Biomed Eng. 2020 Aug;4(8):827-834
pubmed: 32572199
JCO Clin Cancer Inform. 2019 Apr;3:1-7
pubmed: 30990737
Transl Res. 2018 Apr;194:19-35
pubmed: 29175265
J Pathol Inform. 2013 May 30;4:7
pubmed: 23869286
IEEE J Biomed Health Inform. 2021 Feb;25(2):307-314
pubmed: 33347418
Sci Rep. 2020 Jun 9;10(1):9297
pubmed: 32518413
Arch Pathol Lab Med. 2013 Dec;137(12):1723-32
pubmed: 23738764

Auteurs

Noorul Wahab (N)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Islam M Miligy (IM)

Pathology, University of Nottingham, Nottingham, UK.
Department of Pathology, Faculty of Medicine, Menoufia University, Shebin El-Kom, Egypt.

Katherine Dodd (K)

Histopathology, University Hospital Coventry and Warwickshire, Coventry, UK.

Harvir Sahota (H)

Histopathology, University Hospital Coventry and Warwickshire, Coventry, UK.

Michael Toss (M)

Pathology, University of Nottingham, Nottingham, UK.

Wenqi Lu (W)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Mostafa Jahanifar (M)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Mohsin Bilal (M)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Simon Graham (S)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Young Park (Y)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Giorgos Hadjigeorghiou (G)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Abhir Bhalerao (A)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Ayat G Lashen (AG)

Pathology, University of Nottingham, Nottingham, UK.

Asmaa Y Ibrahim (AY)

Pathology, University of Nottingham, Nottingham, UK.

Ayaka Katayama (A)

Graduate School of Medicine, Gunma University, Maebashi, Japan.

Henry O Ebili (HO)

Pathology, University of Nottingham, Nottingham, UK.

Matthew Parkin (M)

Pathology, University of Nottingham, Nottingham, UK.

Tom Sorell (T)

Department of Politics and International Studies, University of Warwick, Coventry, UK.

Shan E Ahmed Raza (SEA)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Emily Hero (E)

Histopathology, University Hospital Coventry and Warwickshire, Coventry, UK.
Leicester Royal Infirmary, Histopathology, University Hospitals Leicester, Leicester, UK.

Hesham Eldaly (H)

Histopathology, University Hospital Coventry and Warwickshire, Coventry, UK.

Yee Wah Tsang (YW)

Histopathology, University Hospital Coventry and Warwickshire, Coventry, UK.

Kishore Gopalakrishnan (K)

Histopathology, University Hospital Coventry and Warwickshire, Coventry, UK.

David Snead (D)

Histopathology, University Hospital Coventry and Warwickshire, Coventry, UK.

Emad Rakha (E)

Pathology, University of Nottingham, Nottingham, UK.

Nasir Rajpoot (N)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Fayyaz Minhas (F)

Tissue Image Analytics Centre, University of Warwick, Coventry, UK.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH