The role of generative language systems in increasing patient awareness of colon cancer screening.

This study aims to evaluate the effectiveness of ChatGPT (Chat Generative Pretrained Transformer) in answering patients' questions about colorectal cancer (CRC) screening, with the ultimate goal of enhancing patients' awareness and adherence to national screening programs. 15 questions on CRC screening were posed to ChatGPT4. The answers were rated by 20 gastroenterology experts and 20 non-experts in three domains (accuracy, completeness, and comprehensibility), and by 100 patients in three dichotomic domains (completeness, comprehensibility and trustability). According to expert rating, the mean accuracy score was 4.8±1.1 on a scale ranging from 1 to 6. Men completeness score was 2.1±0.7 and mean comprehensibility score was 2.8±0.4 on a scale ranging from 1 to 3. Overall, accuracy (4.8±1.1 vs 5.6±0.7, P<0.001) and completeness (2.1±0.7 vs 2.7±0.4, P<0.001) scores were significantly lower for expert compared to non-expert, while comprehensibility was comparable among the two groups (2.7±0.4 vs 2.8±0.3, P=0.546). Patients rated all questions as complete, comprehensible and trustable in 97 to 100% of cases. ChatGPT shows good performance with the potential to enhance awareness about CRC and improve screening outcomes. Generative language systems may be further improved after proper training in accordance with scientific evidence and current guidelines.

Informations de copyright

Thieme. All rights reserved.

Déclaration de conflit d'intérêts

YM: Olympus (consulting, device loan, speaking honorarium); Cybernet System Corp. (loyalty). All the other authors have no proprietary, financial, professional or other personal interest of any nature or kind in any product, service and/or company that could be construed as influencing the position presented in, or the review of this manuscript.