Improving Artificial Intelligence-Based Diagnosis on Pediatric Skin Lesions.
Journal
The Journal of investigative dermatology
ISSN: 1523-1747
Titre abrégé: J Invest Dermatol
Pays: United States
ID NLM: 0426720
Informations de publication
Date de publication:
08 2023
08 2023
Historique:
received:
06
10
2021
revised:
14
07
2022
accepted:
28
08
2022
pmc-release:
01
08
2024
medline:
18
7
2023
pubmed:
22
2
2023
entrez:
21
2
2023
Statut:
ppublish
Résumé
Artificial intelligence algorithms to classify melanoma are dependent on their training data, which limits generalizability. The objective of this study was to compare the performance of an artificial intelligence model trained on a standard adult-predominant dermoscopic dataset before and after the addition of additional pediatric training images. The performances were compared using held-out adult and pediatric test sets of images. We trained two models: one (model A) on an adult-predominant dataset (37,662 images from the International Skin Imaging Collaboration) and the other (model A+P) on an additional 1,536 pediatric images. We compared performance between the two models on adult and pediatric held-out test images separately using the area under the receiver operating characteristic curve. We then used Gradient-weighted Class Activation Maps and background skin masking to understand the contributions of the lesion versus background skin to algorithm decision making. Adding images from a pediatric population with different epidemiological and visual patterns to current reference standard datasets improved algorithm performance on pediatric images without diminishing performance on adult images. This suggests a way that dermatologic artificial intelligence models can be made more generalizable. The presence of background skin was important to the pediatric-specific improvement seen between models. Our study highlights the importance of carefully curated and labeled data from diverse inputs to improve the generalizability of AI models for dermatology, in this case applied to dermoscopic images of adult and pediatric lesions to improve melanoma detection.
Identifiants
pubmed: 36804150
pii: S0022-202X(23)00098-2
doi: 10.1016/j.jid.2022.08.058
pmc: PMC10431965
mid: NIHMS1875892
pii:
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Research Support, N.I.H., Extramural
Langues
eng
Sous-ensembles de citation
IM
Pagination
1423-1429.e1Subventions
Organisme : NCI NIH HHS
ID : P30 CA008748
Pays : United States
Organisme : NCI NIH HHS
ID : U24 CA264369
Pays : United States
Informations de copyright
Copyright © 2023 The Authors. Published by Elsevier Inc. All rights reserved.
Références
J Am Acad Dermatol. 2013 Jun;68(6):913-25
pubmed: 23395590
Nat Med. 2020 Aug;26(8):1229-1234
pubmed: 32572267
Dermatol Ther (Heidelb). 2020 Jun;10(3):365-386
pubmed: 32253623
Am J Epidemiol. 2009 Jan 1;169(1):41-53
pubmed: 19001133
JAMA Dermatol. 2020 Jan 1;156(1):57-64
pubmed: 31721989
Artif Intell Med. 2011 Jun;52(2):91-106
pubmed: 21664806
JAMA Dermatol. 2018 Nov 1;154(11):1247-1248
pubmed: 30073260
JAMA Dermatol. 2019 Oct 01;155(10):1167-1174
pubmed: 31290958
Br J Dermatol. 2019 Jun;180(6):1521-1522
pubmed: 31157429
Sci Data. 2021 Jan 28;8(1):34
pubmed: 33510154
J Am Acad Dermatol. 2016 Oct;75(4):813-823
pubmed: 27320410
Plast Reconstr Surg Glob Open. 2017 Mar 9;5(3):e1252
pubmed: 28458966
PLoS One. 2015 Jul 10;10(7):e0130140
pubmed: 26161953
BMC Bioinformatics. 2017 May 26;18(1):281
pubmed: 28549410
Sci Transl Med. 2012 Oct 24;4(157):157ra143
pubmed: 23100629
J Clin Oncol. 2005 Jul 20;23(21):4735-41
pubmed: 16034049
Sci Data. 2018 Aug 14;5:180161
pubmed: 30106392
J Eur Acad Dermatol Venereol. 2021 Oct;35(10):2022-2026
pubmed: 34146354