Can chatbots enhance the management of pediatric sialadenitis in clinical practice?
Artificial intelligence chatbot
ChatGPT
Clinical decision support
Pediatric sialadenitis
Sialendoscopy
Journal
European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery
ISSN: 1434-4726
Titre abrégé: Eur Arch Otorhinolaryngol
Pays: Germany
ID NLM: 9002937
Informations de publication
Date de publication:
02 Jul 2024
02 Jul 2024
Historique:
received:
06
05
2024
accepted:
17
06
2024
medline:
3
7
2024
pubmed:
3
7
2024
entrez:
2
7
2024
Statut:
aheadofprint
Résumé
The purpose of this study was to assess how well ChatGPT, an AI-powered chatbot, performed in helping to manage pediatric sialadenitis and identify when sialendoscopy was necessary. 49 clinical cases of pediatric sialadenitis were retrospectively reviewed. ChatGPT was given patient data, and it offered differential diagnoses, proposed further tests, and suggested treatments. The decisions made by the treating otolaryngologists were contrasted with the answers provided by ChatGPT. Analysis was done on ChatGPT response consistency and interrater reliability. ChatGPT showed 78.57% accuracy in primary diagnosis, and 17.35% of cases were considered likely. On the other hand, otolaryngologists recommended fewer further examinations than ChatGPT (111 vs. 60, p < 0.001). For additional exams, poor agreement was found between ChatGPT and otolaryngologists. Only 28.57% of cases received a pertinent and essential treatment plan via ChatGPT, indicating that the platform's treatment recommendations were frequently lacking. For treatment ratings, judges' interrater reliability was greatest (Kendall's tau = 0.824, p < 0.001). For the most part, ChatGPT's response constancy was high. Although ChatGPT has the potential to correctly diagnose pediatric sialadenitis, there are a number of noteworthy limitations with regard to its ability to suggest further testing and treatment regimens. Before widespread clinical use, more research and confirmation are required. To guarantee that chatbots are utilized properly and effectively to supplement human expertise rather than to replace it, a critical viewpoint is required.
Identifiants
pubmed: 38955859
doi: 10.1007/s00405-024-08798-4
pii: 10.1007/s00405-024-08798-4
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Informations de copyright
© 2024. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.
Références
Chafin JB, Bayazid L (2022) Pediatric salivary gland disease. Pediatr Clin N Am 69(2):363–380. https://doi.org/10.1016/j.pcl.2022.01.004
doi: 10.1016/j.pcl.2022.01.004
Jabbour N, Tibesar R, Lander T, Sidman J (2010) Sialendoscopy in children. Int J Pediatr Otorhinolaryngol 74(4):347–350. https://doi.org/10.1016/j.ijporl.2009.12.013
doi: 10.1016/j.ijporl.2009.12.013
pubmed: 20116866
Hernandez S, Busso C, Walvekar RR (2016) Parotitis and sialendoscopy of the parotid gland. Otolaryngol Clin N Am 49(2):381–393. https://doi.org/10.1016/j.otc.2015.12.003
doi: 10.1016/j.otc.2015.12.003
Capaccio P, Canzi P, Gaffuri M, Occhini A, Benazzo M, Ottaviani F, Pignataro L (2017) Modern management of paediatric obstructive salivary disorders: long-term clinical experience. Acta Otorhinolaryngol Ital 37(2):160–167. https://doi.org/10.14639/0392-100X-1607
doi: 10.14639/0392-100X-1607
pubmed: 28516980
pmcid: 5463525
Martins-Carvalho C, Plouin-Gaudon I, Quenin S, Lesniak J, Froehlich P, Marchal F, Faure F (2010) Pediatric sialendoscopy: a 5-year experience at a single institution. Arch Otolaryngol Head Neck Surg 136(1):33–36. https://doi.org/10.1001/archoto.2009.184
doi: 10.1001/archoto.2009.184
Kanerva M, Tapiovaara L, Aro K, Saarinen R (2020) Pediatric sialendoscopy: An 11-year study from a single tertiary care center. Int J Pediatr Otorhinolaryngol 131:109869. https://doi.org/10.1016/j.ijporl.2020.109869
doi: 10.1016/j.ijporl.2020.109869
pubmed: 31972384
Capaccio P, Palermo A, Lucchinelli P, Marchesi T, Torretta S, Gaffuri M, Marchisio P, Pignataro L (2021) Deep sedation for pediatric parotid sialendoscopy in juvenile recurrent parotitis. J Clin Med 10(2):276. https://doi.org/10.3390/jcm10020276
doi: 10.3390/jcm10020276
pubmed: 33451162
pmcid: 7828661
Chiesa-Estomba CM, Speth MM, Mayo-Yanez M, Liu DT, Maniaci A, Borsetto D (2024) Is the evolving role of artificial intelligence and chatbots in the field of otolaryngology embracing the future? Eur Arch Otorhinolaryngol 281(4):2179–2180. https://doi.org/10.1007/s00405-023-08382-2
doi: 10.1007/s00405-023-08382-2
pubmed: 38133807
Mat Q, Briganti G, Maniaci A, Lelubre C (2024) Will ChatGPT soon replace otolaryngologists? Eur Arch Otorhinolaryngol. https://doi.org/10.1007/s00405-024-08543-x . (Epub ahead of print. PMID: 38438614)
doi: 10.1007/s00405-024-08543-x
pubmed: 38438614
Maniaci A, Fakhry N, Chiesa-Estomba C, Lechien JR, Lavalle S (2024) Synergizing ChatGPT and general AI for enhanced medical diagnostic processes in head and neck imaging. Eur Arch Otorhinolaryngol. https://doi.org/10.1007/s00405-024-08511-5
doi: 10.1007/s00405-024-08511-5
pubmed: 38795148
pmcid: 10943141
Soriano-Martín D, García-Consuegra L, Junquera L, Rodríguez-Santamarta T, Olay S, Junquera-Olay S (2023) Sialendoscopy approach in treating juvenile recurrent parotitis: a systematic review. J Otolaryngol Head Neck Surg 52(1):53. https://doi.org/10.1186/s40463-023-00658-1
doi: 10.1186/s40463-023-00658-1
pubmed: 37598195
pmcid: 10440031
Schwarz Y, Bezdjian A, Daniel SJ (2018) Sialendoscopy in treating pediatric salivary gland disorders: a systematic review. Eur Arch Otorhinolaryngol 275(2):347–356. https://doi.org/10.1007/s00405-017-4830-2
doi: 10.1007/s00405-017-4830-2
pubmed: 29204918
Gercama AJ, de Haan M, van der Vleuten CPM (2000) Reliability of the Amsterdam Clinical Challenge Scale (ACCS): a new instrument to assess the level of difficulty of patient cases in medical education. Med Educ 34(7):519–524
doi: 10.1046/j.1365-2923.2000.00663.x
pubmed: 10886633
Lechien JR, Naunheim MR, Maniaci A, Radulesco T, Saibene AM, Chiesa-Estomba CM, Vaira LA (2024) Performance and consistency of ChatGPT-4 versus otolaryngologists: a clinical case series. Otolaryngol Head Neck Surg. https://doi.org/10.1002/ohn.759
doi: 10.1002/ohn.759
pubmed: 38716790
Müskens JLJM, Kool RB, van Dulmen SA, Westert GP (2022) Overuse of diagnostic testing in healthcare: a systematic review. BMJ Qual Saf 31(1):54–63. https://doi.org/10.1136/bmjqs-2020-012576
doi: 10.1136/bmjqs-2020-012576
pubmed: 33972387
Langlie J, Kamrava B, Pasick LJ, Mei C, Hoffer ME (2024) Artificial intelligence and ChatGPT: an otolaryngology patient’s ally or foe? Am J Otolaryngol 45(3):104220. https://doi.org/10.1016/j.amjoto.2024.104220
doi: 10.1016/j.amjoto.2024.104220
pubmed: 38219629
Chiesa-Estomba CM, Lechien JR, Vaira LA, Brunet A, Cammaroto G, Mayo-Yanez M, Sanchez-Barrueco A, Saga-Gutierrez C (2024) Exploring the potential of Chat-GPT as a supportive tool for sialendoscopy clinical decision making and patient information support. Eur Arch Otorhinolaryngol 281(4):2081–2086. https://doi.org/10.1007/s00405-023-08104-8
doi: 10.1007/s00405-023-08104-8
pubmed: 37405455