Simultaneous detection of dental caries and fissure sealant in intraoral photos by deep learning: a pilot study.
Artificial intelligence
Deep learning
Dental caries
Fissure sealant
Journal
BMC oral health
ISSN: 1472-6831
Titre abrégé: BMC Oral Health
Pays: England
ID NLM: 101088684
Informations de publication
Date de publication:
12 May 2024
12 May 2024
Historique:
received:
06
08
2023
accepted:
11
04
2024
medline:
13
5
2024
pubmed:
13
5
2024
entrez:
12
5
2024
Statut:
epublish
Résumé
Deep learning, as an artificial intelligence method has been proved to be powerful in analyzing images. The purpose of this study is to construct a deep learning-based model (ToothNet) for the simultaneous detection of dental caries and fissure sealants in intraoral photos. A total of 1020 intraoral photos were collected from 762 volunteers. Teeth, caries and sealants were annotated by two endodontists using the LabelMe tool. ToothNet was developed by modifying the YOLOX framework for simultaneous detection of caries and fissure sealants. The area under curve (AUC) in the receiver operating characteristic curve (ROC) and free-response ROC (FROC) curves were used to evaluate model performance in the following aspects: (i) classification accuracy of detecting dental caries and fissure sealants from a photograph (image-level); and (ii) localization accuracy of the locations of predicted dental caries and fissure sealants (tooth-level). The performance of ToothNet and dentist with 1year of experience (1-year dentist) were compared at tooth-level and image-level using Wilcoxon test and DeLong test. At the image level, ToothNet achieved an AUC of 0.925 (95% CI, 0.880-0.958) for caries detection and 0.902 (95% CI, 0.853-0.940) for sealant detection. At the tooth level, with a confidence threshold of 0.5, the sensitivity, precision, and F1-score for caries detection were 0.807, 0.814, and 0.810, respectively. For fissure sealant detection, the values were 0.714, 0.750, and 0.731. Compared with ToothNet, the 1-year dentist had a lower F1 value (0.599, p < 0.0001) and AUC (0.749, p < 0.0001) in caries detection, and a lower F1 value (0.727, p = 0.023) and similar AUC (0.829, p = 0.154) in sealant detection. The proposed deep learning model achieved multi-task simultaneous detection in intraoral photos and showed good performance in the detection of dental caries and fissure sealants. Compared with 1-year dentist, the model has advantages in caries detection and is equivalent in fissure sealants detection.
Sections du résumé
BACKGROUND
BACKGROUND
Deep learning, as an artificial intelligence method has been proved to be powerful in analyzing images. The purpose of this study is to construct a deep learning-based model (ToothNet) for the simultaneous detection of dental caries and fissure sealants in intraoral photos.
METHODS
METHODS
A total of 1020 intraoral photos were collected from 762 volunteers. Teeth, caries and sealants were annotated by two endodontists using the LabelMe tool. ToothNet was developed by modifying the YOLOX framework for simultaneous detection of caries and fissure sealants. The area under curve (AUC) in the receiver operating characteristic curve (ROC) and free-response ROC (FROC) curves were used to evaluate model performance in the following aspects: (i) classification accuracy of detecting dental caries and fissure sealants from a photograph (image-level); and (ii) localization accuracy of the locations of predicted dental caries and fissure sealants (tooth-level). The performance of ToothNet and dentist with 1year of experience (1-year dentist) were compared at tooth-level and image-level using Wilcoxon test and DeLong test.
RESULTS
RESULTS
At the image level, ToothNet achieved an AUC of 0.925 (95% CI, 0.880-0.958) for caries detection and 0.902 (95% CI, 0.853-0.940) for sealant detection. At the tooth level, with a confidence threshold of 0.5, the sensitivity, precision, and F1-score for caries detection were 0.807, 0.814, and 0.810, respectively. For fissure sealant detection, the values were 0.714, 0.750, and 0.731. Compared with ToothNet, the 1-year dentist had a lower F1 value (0.599, p < 0.0001) and AUC (0.749, p < 0.0001) in caries detection, and a lower F1 value (0.727, p = 0.023) and similar AUC (0.829, p = 0.154) in sealant detection.
CONCLUSIONS
CONCLUSIONS
The proposed deep learning model achieved multi-task simultaneous detection in intraoral photos and showed good performance in the detection of dental caries and fissure sealants. Compared with 1-year dentist, the model has advantages in caries detection and is equivalent in fissure sealants detection.
Identifiants
pubmed: 38735954
doi: 10.1186/s12903-024-04254-1
pii: 10.1186/s12903-024-04254-1
doi:
Substances chimiques
Pit and Fissure Sealants
0
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
553Informations de copyright
© 2024. The Author(s).
Références
Petersen PE, Bourgeois D, Ogawa H, Estupinan-Day S, Ndiaye C. The global burden of oral diseases and risks to oral health. Bull World Health Organ. 2005;83:661–9.
pubmed: 16211157
pmcid: 2626328
Wright JT, Crall JJ, Fontana M, Gillette EJ, Nový BB, Dhar V, Donly K, Hewlett ER, Quinonez RB, Chaffin J et al. Evidence-based clinical practice guideline for the use of pit-and-fissure sealants: a report of the American dental association and the American academy of pediatric dentistry. J Am Dent Assoc. 2016,147:672 – 82.e12.
Azarpazhooh A, Main PA. Pit and fissure sealants in the prevention of dental caries in children and adolescents: a systematic review. J Can Dent Assoc. 2008;74:171–7.
pubmed: 18353204
Schwendicke F, Golla T, Dreher M, Krois J. Convolutional neural networks for dental image diagnostics: a scoping review. J Dent. 2019;91:103226.
doi: 10.1016/j.jdent.2019.103226
pubmed: 31704386
Khanagar SB, Al-Ehaideb A, Maganur PC, Vishwanathaiah S, Patil S, Baeshen HA, Sarode SC, Bhandi S. Developments, application, and performance of artificial intelligence in dentistry - a systematic review. J Dent Sci. 2021;16:508–22.
doi: 10.1016/j.jds.2020.06.019
pubmed: 33384840
Lee JH, Kim DH, Jeong SN, Choi SH. Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm. J Dent. 2018;77:106–11.
doi: 10.1016/j.jdent.2018.07.015
pubmed: 30056118
Tripathi P, Malathy C, Prabhakaran M. Genetic algorithms based approach for dental caries detection using back propagation neural network. Int J Recent Technol Eng. 2019;8:317–9.
Leo LM, Reddy TK. Dental caries classification system using deep learning based convolutional neural network. J Comput Theor Nanosci. 2020;17:4660–5.
doi: 10.1166/jctn.2020.9295
Holtkamp A, Elhennawy K, de Oro JECG, Krois J, Paris S, Schwendicke F. Generalizability of deep learning models for caries detection in near-infrared light transillumination images. J Clin Med. 2021;10:961.
doi: 10.3390/jcm10050961
pubmed: 33804562
pmcid: 7957685
Schwendicke F, Elhennawy K, Paris S, Friebertshäuser P, Krois J. Deep learning for caries lesion detection in near-infrared light transillumination images: a pilot study. J Dent. 2020;92:103260.
doi: 10.1016/j.jdent.2019.103260
pubmed: 31821853
Salehi HS, Barchini M, Mahdian M. Optimization methods for deep neural networks classifying OCT images to detect dental caries. Lasers in dentistry XXVI. France: SPIE; 2020. pp. 53–61.
Yu-Ping H, Shyh-Yuan L. An effective and reliable methodology for deep machine learning application in caries detection. medRxiv. 2021. https://doi.org/10.1101/2021.05.04.21256502 .
doi: 10.1101/2021.05.04.21256502
Kühnisch J, Meyer O, Hesenius M, Hickel R, Gruhn V. Caries detection on intraoral images using artificial intelligence. J Dent Res. 2022;101:158–65.
doi: 10.1177/00220345211032524
pubmed: 34416824
Li W, Liang Y, Zhang X, Liu C, He L, Miao L, Sun W. A deep learning approach to automatic gingivitis screening based on classification and localization in RGB photos. Sci Rep. 2021;11:16831.
doi: 10.1038/s41598-021-96091-3
pubmed: 34413332
pmcid: 8376991
Schlickenrieder A, Meyer O, Schönewolf J, Engels P, Hickel R, Gruhn V, Hesenius M, Kühnisch J. Automatized detection and categorization of fissure sealants from intraoral digital photographs using artificial intelligence. Diagnostics (Basel). 2021;11:1608.
doi: 10.3390/diagnostics11091608
pubmed: 34573949
Engels P, Meyer O, Schönewolf J, Schlickenrieder A, Hickel R, Hesenius M, Gruhn V, Kühnisch J. Automated detection of posterior restorations in permanent teeth using artificial intelligence on intraoral photographs. J Dent. 2022;121:104124.
doi: 10.1016/j.jdent.2022.104124
pubmed: 35395346
Shivakumar K, Prasad S, Chandu G. International caries detection and assessment system: a new paradigm in detection of dental caries. J Conserv Dent. 2009;12:10–6.
doi: 10.4103/0972-0707.53335
pubmed: 20379434
pmcid: 2848805
de Souza AL, Bronkhorst EM, Creugers NH, Leal SC, Frencken JE. The caries assessment spectrum and treatment (CAST) instrument: its reproducibility in clinical studies. Int Dent J. 2014;64:187–94.
doi: 10.1111/idj.12104
pubmed: 24506822
Zhou D et al., Fang J, Song X,. Iou loss for 2d/3d object detection[C]//2019 international conference on 3D vision (3DV). IEEE, 2019: 85–94
Qin X et al., Zhang Z, Huang C,. Basnet: Boundary-aware salient object detection[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2019: 7479–7489
Zhang X, et al. A deep learning approach to automatic gingivitis screening based on classification and localization in RGB photos[J]. Sci Rep. 2021;11(1):16831. Liang Y.
doi: 10.1038/s41598-021-96091-3
pubmed: 34413332
pmcid: 8376991
Zhang X et al., Liang Y, Li W,. Development and evaluation of deep learning for screening dental caries from oral photographs[J]. Oral diseases, 2022, 28(1): 173–181
Kaur P. Khehra B S, Mavi E B S. Data augmentation for object detection: A review[C]//2021 IEEE International Midwest Symposium on Circuits and Systems (MWSCAS). IEEE, 2021: 537–543
Zoph B et al., Cubuk E D, Ghiasi G,. Learning data augmentation strategies for object detection[C]//Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXVII 16. Springer International Publishing, 2020: 566–583
Fluss R, Faraggi D, Reiser B. Estimation of the youden index and its associated cutoff point. Biom J. 2005;47:458–72.
doi: 10.1002/bimj.200410135
pubmed: 16161804
Pitts NB, Stamm JW. International consensus workshop on caries clinical trials (ICW-CCT)--final consensus statements: agreeing where the evidence leads. J Dent Res. 2004;83:C125–8.
doi: 10.1177/154405910408301s27
pubmed: 15286139
Boye U, Pretty IA, Tickle M, Walsh T. Comparison of caries detection methods using varying numbers of intra-oral digital photographs with visual examination for epidemiology in children. BMC Oral Health. 2013;13:6.
doi: 10.1186/1472-6831-13-6
pubmed: 23312001
pmcid: 3549278
Berdouses ED, Koutsouri GD, Tripoliti EE, Matsopoulos GK, Oulis CJ, Fotiadis DI. A computer-aided automated methodology for the detection and classification of occlusal caries from photographic color images. Comput Biol Med. 2015;62:119–35.
doi: 10.1016/j.compbiomed.2015.04.016
pubmed: 25932969
Moutselos K, Berdouses E, Oulis C, Maglogiannis I. Recognizing occlusal caries in dental intraoral images using deep learning. In: 2019 41st annual international conference of the IEEE engineering in medicine and biology society (EMBC). Berlin, Germany: IEEE; 2019: pp. 1617-20.
Zhang X, Liang Y, Li W, Liu C, Gu D, Sun W, Miao L. Development and evaluation of deep learning for screening dental caries from oral photographs. Oral Dis. 2022;28:173–81.
doi: 10.1111/odi.13735
pubmed: 33244805
Ding B, Zhang Z, Liang Y, Wang W, Hao S, Meng Z, Guan L, Hu Y, Guo B, Zhao R, et al. Detection of dental caries in oral photographs taken by mobile phones based on the YOLOv3 algorithm. Ann Transl Med. 2021;9:1622.
doi: 10.21037/atm-21-4805
pubmed: 34926666
pmcid: 8640896