Issues in Melanoma Detection: Semisupervised Deep Learning Algorithm Development via a Combination of Human and Artificial Intelligence.

3-point checklist algorithm automatic diagnosis deep learning dermatology dermoscopic images melanoma melanoma classification semisupervised learning skin disease skin lesion

Journal

JMIR dermatology
ISSN: 2562-0959
Titre abrégé: JMIR Dermatol
Pays: Canada
ID NLM: 101770607

Informations de publication

Date de publication:
12 Dec 2022
Historique:
received: 28 04 2022
accepted: 12 10 2022
revised: 01 09 2022
medline: 27 8 2023
pubmed: 27 8 2023
entrez: 26 8 2023
Statut: epublish

Résumé

Automatic skin lesion recognition has shown to be effective in increasing access to reliable dermatology evaluation; however, most existing algorithms rely solely on images. Many diagnostic rules, including the 3-point checklist, are not considered by artificial intelligence algorithms, which comprise human knowledge and reflect the diagnosis process of human experts. In this paper, we aimed to develop a semisupervised model that can not only integrate the dermoscopic features and scoring rule from the 3-point checklist but also automate the feature-annotation process. We first trained the semisupervised model on a small, annotated data set with disease and dermoscopic feature labels and tried to improve the classification accuracy by integrating the 3-point checklist using ranking loss function. We then used a large, unlabeled data set with only disease label to learn from the trained algorithm to automatically classify skin lesions and features. After adding the 3-point checklist to our model, its performance for melanoma classification improved from a mean of 0.8867 (SD 0.0191) to 0.8943 (SD 0.0115) under 5-fold cross-validation. The trained semisupervised model can automatically detect 3 dermoscopic features from the 3-point checklist, with best performances of 0.80 (area under the curve [AUC] 0.8380), 0.89 (AUC 0.9036), and 0.76 (AUC 0.8444), in some cases outperforming human annotators. Our proposed semisupervised learning framework can help with the automatic diagnosis of skin disease based on its ability to detect dermoscopic features and automate the label-annotation process. The framework can also help combine semantic knowledge with a computer algorithm to arrive at a more accurate and more interpretable diagnostic result, which can be applied to broader use cases.

Sections du résumé

BACKGROUND BACKGROUND
Automatic skin lesion recognition has shown to be effective in increasing access to reliable dermatology evaluation; however, most existing algorithms rely solely on images. Many diagnostic rules, including the 3-point checklist, are not considered by artificial intelligence algorithms, which comprise human knowledge and reflect the diagnosis process of human experts.
OBJECTIVE OBJECTIVE
In this paper, we aimed to develop a semisupervised model that can not only integrate the dermoscopic features and scoring rule from the 3-point checklist but also automate the feature-annotation process.
METHODS METHODS
We first trained the semisupervised model on a small, annotated data set with disease and dermoscopic feature labels and tried to improve the classification accuracy by integrating the 3-point checklist using ranking loss function. We then used a large, unlabeled data set with only disease label to learn from the trained algorithm to automatically classify skin lesions and features.
RESULTS RESULTS
After adding the 3-point checklist to our model, its performance for melanoma classification improved from a mean of 0.8867 (SD 0.0191) to 0.8943 (SD 0.0115) under 5-fold cross-validation. The trained semisupervised model can automatically detect 3 dermoscopic features from the 3-point checklist, with best performances of 0.80 (area under the curve [AUC] 0.8380), 0.89 (AUC 0.9036), and 0.76 (AUC 0.8444), in some cases outperforming human annotators.
CONCLUSIONS CONCLUSIONS
Our proposed semisupervised learning framework can help with the automatic diagnosis of skin disease based on its ability to detect dermoscopic features and automate the label-annotation process. The framework can also help combine semantic knowledge with a computer algorithm to arrive at a more accurate and more interpretable diagnostic result, which can be applied to broader use cases.

Identifiants

pubmed: 37632881
pii: v5i4e39113
doi: 10.2196/39113
pmc: PMC10334941
doi:

Types de publication

Journal Article

Langues

eng

Pagination

e39113

Informations de copyright

©Xinyuan Zhang, Ziqian Xie, Yang Xiang, Imran Baig, Mena Kozman, Carly Stender, Luca Giancardo, Cui Tao. Originally published in JMIR Dermatology (http://derma.jmir.org), 12.12.2022.

Références

J Med Internet Res. 2020 Jun 19;22(6):e15154
pubmed: 32558657
J Am Acad Dermatol. 2011 Feb;64(2):302-9
pubmed: 21094560
JAMA Netw Open. 2019 Oct 2;2(10):e1913436
pubmed: 31617929
BMJ Open. 2019 Aug 20;9(8):e027529
pubmed: 31434767
JAMA Netw Open. 2019 Mar 1;2(3):e190096
pubmed: 30821822
Lancet Oncol. 2002 Mar;3(3):159-65
pubmed: 11902502
Comput Methods Programs Biomed. 2020 Apr;186:105241
pubmed: 31837637
IEEE J Biomed Health Inform. 2015 May;19(3):1146-52
pubmed: 25073179
MMWR Morb Mortal Wkly Rep. 2015 Jun 5;64(21):591-6
pubmed: 26042651
Int J Dermatol. 2010 Jan;49(1):33-8
pubmed: 20465608
Am Fam Physician. 2000 Jul 15;62(2):357-68, 375-6, 381-2
pubmed: 10929700
Ann Oncol. 2018 Aug 1;29(8):1836-1842
pubmed: 29846502
Dermatol Pract Concept. 2021 Jan 29;11(1):e2021153
pubmed: 33614221
Diagnostics (Basel). 2020 Nov 18;10(11):
pubmed: 33218060
J Am Acad Dermatol. 2017 Apr;76(4):676-682
pubmed: 28089728
JMIR Med Inform. 2019 Aug 16;7(3):e10010
pubmed: 31420959
Acta Derm Venereol. 2017 Jul 5;Suppl 218:14-21
pubmed: 28676882
Eur J Cancer. 2019 May;113:47-54
pubmed: 30981091
Melanoma Res. 2000 Dec;10(6):556-61
pubmed: 11198477
J Dtsch Dermatol Ges. 2014 Jul;12(7):606-14
pubmed: 24944011
Exp Dermatol. 2018 Nov;27(11):1261-1267
pubmed: 30187575
EClinicalMedicine. 2020 Nov 21;29-30:100641
pubmed: 33437950
Nature. 2017 Feb 2;542(7639):115-118
pubmed: 28117445
JAMA Dermatol. 2015 Dec 01;151(12):1346-1353
pubmed: 26501400
Med Decis Making. 2017 Aug;37(6):715-724
pubmed: 28355975
Dermatology. 2004;208(1):27-31
pubmed: 14730233
IEEE J Biomed Health Inform. 2018 Apr 09;:
pubmed: 29993994
Skin Res Technol. 2018 May;24(2):256-264
pubmed: 29057507
BMC Med Inform Decis Mak. 2018 Jul 23;18(Suppl 2):59
pubmed: 30066649
Int J Med Inform. 2021 Feb;146:104361
pubmed: 33348274
Dermatol Pract Concept. 2018 Jul 31;8(3):214-223
pubmed: 30116667
Dermatol Pract Concept. 2017 Apr 30;7(2):39-46
pubmed: 28515993
Am J Clin Dermatol. 2021 Mar;22(2):233-242
pubmed: 33354741
Eur J Cancer. 2019 Oct;120:114-121
pubmed: 31518967

Auteurs

Xinyuan Zhang (X)

School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, United States.

Ziqian Xie (Z)

School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, United States.

Yang Xiang (Y)

School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, United States.

Imran Baig (I)

McGovern Medical School, The University of Texas Health Science Center at Houston, Houston, TX, United States.

Mena Kozman (M)

McGovern Medical School, The University of Texas Health Science Center at Houston, Houston, TX, United States.

Carly Stender (C)

McGovern Medical School, The University of Texas Health Science Center at Houston, Houston, TX, United States.

Luca Giancardo (L)

School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, United States.

Cui Tao (C)

School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, United States.

Classifications MeSH