The learning curve in bladder MRI using VI-RADS assessment score during an interactive dedicated training program.
Bladder cancer
Internship and residency
Learning curve
Magnetic resonance imaging
Training program
Journal
European radiology
ISSN: 1432-1084
Titre abrégé: Eur Radiol
Pays: Germany
ID NLM: 9114774
Informations de publication
Date de publication:
Nov 2022
Nov 2022
Historique:
received:
21
12
2021
accepted:
22
03
2022
revised:
18
03
2022
pubmed:
3
4
2022
medline:
19
11
2022
entrez:
2
4
2022
Statut:
ppublish
Résumé
The purpose of the study was to evaluate the effect of an interactive training program on the learning curve of radiology residents for bladder MRI interpretation using the VI-RADS score. Three radiology residents with minimal experience in bladder MRI served as readers. They blindly evaluated 200 studies divided into 4 subsets of 50 cases over a 3-month period. After 2 months, the first subset was reassessed, resulting in a total of 250 evaluations. An interactive training program was provided and included educational lessons and case-based practice. The learning curve was constructed by plotting mean agreement as the ratio of correct evaluations per batch. Inter-reader agreement and diagnostic performance analysis were performed with kappa statistics and ROC analysis. As for the VI-RADS scoring agreement, the kappa differences between pre-training and post-training evaluation of the same group of cases were 0.555 to 0.852 for reader 1, 0.522 to 0.695 for reader 2, and 0.481 to 0.794 for reader 3. Using VI-RADS ≥ 3 as cut-off for muscle invasion, sensitivity ranged from 84 to 89% and specificity from 91 to 94%, while the AUCs from 0.89 (95% CI:0.84, 0.94) to 0.90 (95% CI:0.86, 0.95). Mean evaluation time decreased from 5.21 ± 1.12 to 3.52 ± 0.69 min in subsets 1 and 5. Mean grade of confidence improved from 3.31 ± 0.93 to 4.21 ± 0.69, in subsets 1 and 5. An interactive dedicated education program on bladder MRI and the VI-RADS score led to a significant increase in readers' diagnostic performance over time, with a general improvement observed after 100-150 cases. • After the first educational lesson and 100 cases were interpreted, the concordance on VI-RADS scoring between the residents and the experienced radiologist was significantly higher. • An increase in the grade of confidence was experienced after 100 cases. • We found a decrease in the evaluation time after 150 cases.
Identifiants
pubmed: 35366122
doi: 10.1007/s00330-022-08766-8
pii: 10.1007/s00330-022-08766-8
pmc: PMC8976109
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
7494-7503Informations de copyright
© 2022. The Author(s).
Références
Bray F, Ferlay J, Soerjomataram I, Siegel RS, Torre LA, Jemal A (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 68:394–424. https://doi.org/10.3322/caac.21492
Sievert KD, Amend B, Nagele U et al (2009) Economic aspects of bladder cancer: what are the benefits and costs? World J Urol 27:295–300. https://doi.org/10.1007/s00345-009-0395-z
doi: 10.1007/s00345-009-0395-z
Panebianco V, Narumi Y, Altun E et al (2018) Multiparametric magnetic resonance imaging for bladder cancer: development of VI-RADS (Vesical Imaging-Reporting And Data System). Eur Urol 74:294–306. https://doi.org/10.1016/j.eururo.2018.04.029
doi: 10.1016/j.eururo.2018.04.029
Metwally MI, Zeed NA, Hamed EM et al (2021) The validity, reliability, and reviewer acceptance of VI-RADS in assessing muscle invasion by bladder cancer: a multicenter prospective study. Eur Radiol. https://doi.org/10.1007/s00330-021-07765-5
Del Giudice F, Pecoraro M, Vargas HA et al (2020) Systematic review and meta-analysis of Vesical Imaging-Reporting and Data System (VI-RADS) inter-observer reliability: an added value for muscle invasive bladder cancer detection. Cancers (Basel) 12. https://doi.org/10.3390/cancers12102994
Del Giudice F, Barchetti G, De Berardinis E et al (2020) Prospective assessment of Vesical Imaging Reporting and Data System (VI-RADS) and its clinical impact on the management of high-risk non–muscle-invasive bladder cancer patients candidate for repeated transurethral resection. Eur Urol 77:101–109. https://doi.org/10.1016/j.eururo.2019.09.029
doi: 10.1016/j.eururo.2019.09.029
Ueno Y, Tamada T, Takeuchi M et al (2021) VI-RADS: multiinstitutional multireader diagnostic accuracy and interobserver agreement study. AJR Am J Roentgenol 216:1257–1266. https://doi.org/10.2214/AJR.20.23604
doi: 10.2214/AJR.20.23604
Woo S, Panebianco V, Narumi Y et al (2020) Diagnostic performance of vesical imaging reporting and data system for the prediction of muscle-invasive bladder cancer: a systematic review and meta-analysis. Eur Urol Oncol S2588931120300328. https://doi.org/10.1016/j.euo.2020.02.007
Caglic I, Panebianco V, Vargas HA et al (2020) MRI of bladder cancer: local and nodal staging. J Magn Reson Imaging.27090. https://doi.org/10.1002/jmri.27090
Panebianco V, Pecoraro M, Del Giudice F et al (2020) VI-RADS for bladder cancer: current applications and future developments. J Magn Reson Imaging jmri.27361. https://doi.org/10.1002/jmri.27361
Stabile A, Giganti F, Kasivisvanathan V et al (2020) Factors influencing variability in the performance of multiparametric magnetic resonance imaging in detecting clinically significant prostate cancer: a systematic literature review. Eur Urol Oncol 3:145–167. https://doi.org/10.1016/j.euo.2020.02.005
doi: 10.1016/j.euo.2020.02.005
Rosenkrantz AB, Ayoola A, Hoffman D et al (2017) The learning curve in prostate MRI interpretation: self-directed learning versus continual reader feedback. AJR Am J Roentgenol 208:W92–W100. https://doi.org/10.2214/AJR.16.16876
Gaziev G, Wadhwa K, Barrett T et al (2016) Defining the learning curve for multiparametric magnetic resonance imaging (MRI) of the prostate using MRI-transrectal ultrasonography (TRUS) fusion-guided transperineal prostate biopsies as a validation tool. BJU Int 117:80–86. https://doi.org/10.1111/bju.12892
doi: 10.1111/bju.12892
Garcia-Reyes K, Passoni NM, Palmeri ML et al (2015) Detection of prostate cancer with multiparametric MRI (mpMRI): effect of dedicated reader education on accuracy and confidence of index and anterior cancer diagnosis. Abdom Imaging 40:134–142. https://doi.org/10.1007/s00261-014-0197-7
doi: 10.1007/s00261-014-0197-7
Akin O, Riedl CC, Ishill NM, Moskowitz CS, Zhang J, Hricak H (2010) Interactive dedicated training curriculum improves accuracy in the interpretation of MR imaging of prostate cancer. Eur Radiol 20:995–1002. https://doi.org/10.1007/s00330-009-1625-x
Latchamsetty KC, Borden LS, Porter CR et al (2007) Experience improves staging accuracy of endorectal magnetic resonance imaging in prostate cancer: what is the learning curve? Can J Urol 14:3429–3434
Harris RD, Schned AR, Heaney JA (1995) Staging of prostate cancer with endorectal MR imaging: lessons from a learning curve. Radiographics 15:813–829; discussion 829-832. https://doi.org/10.1148/radiographics.15.4.7569131
doi: 10.1148/radiographics.15.4.7569131
Pavone P, Laghi A, Panebianco V, Catalano C, Lobina L, Passariello R (1998) MR cholangiography: techniques and clinical applications. Eur Radiol 8:901–910. https://doi.org/10.1007/s003300050486
Panebianco V, Giganti F, Kitzing YX et al (2018) An update of pitfalls in prostate mpMRI: a practical approach through the lens of PI-RADS v. 2 guidelines. Insights Imaging 9:87–101. https://doi.org/10.1007/s13244-017-0578-x
doi: 10.1007/s13244-017-0578-x
Panebianco V, Sciarra A, Marcantonio A et al (2012) Conventional imaging and multiparametric magnetic resonance (MRI, MRS, DWI, MRP) in the diagnosis of prostate cancer. Q J Nucl Med Mol Imaging 56:331–342
Sciarra A, Panebianco V, Cattarino S et al (2012) Multiparametric magnetic resonance imaging of the prostate can improve the predictive value of the urinary prostate cancer antigen 3 test in patients with elevated prostate-specific antigen levels and a previous negative biopsy. BJU Int 110:1661–1665. https://doi.org/10.1111/j.1464-410X.2012.11146.x
doi: 10.1111/j.1464-410X.2012.11146.x
Pickersgill NA, Vetter JM, Raval NS et al (2019) The accuracy of prostate magnetic resonance imaging interpretation: impact of the individual radiologist and clinical factors. Urology 127:68–73. https://doi.org/10.1016/j.urology.2019.01.035
doi: 10.1016/j.urology.2019.01.035
Tureli D, Altas H, Cengic I, Ekinci G, Baltacioglu F (2015) Utility of interobserver agreement statistics in establishing radiology resident learning curves during self-directed radiologic anatomy training. Acad Radiol 22:1236–1241. https://doi.org/10.1016/j.acra.2015.07.004
de Rooij M, Israël B, Tummers M et al (2020) ESUR/ESUI consensus statements on multi-parametric MRI for the detection of clinically significant prostate cancer: quality requirements for image acquisition, interpretation and radiologists’ training. Eur Radiol. https://doi.org/10.1007/s00330-020-06929-z
Rosenkrantz AB, Begovic J, Pires A, Won E, Taneja SS, Babb JS (2019) Online interactive case-based instruction in prostate magnetic resonance imaging interpretation using Prostate Imaging and Reporting Data System Version 2: Effect for Novice Readers. Curr Probl Diagn Radiol 48:132–141. https://doi.org/10.1067/j.cpradiol.2018.01.003
Schoots IG (2018) MRI in early prostate cancer detection: how to manage indeterminate or equivocal PI-RADS 3 lesions? Transl Androl Urol 7:70–82. https://doi.org/10.21037/tau.2017.12.31
doi: 10.21037/tau.2017.12.31