A novel regression method for the analysis of multireader multicase-free-response receiver operating characteristics studies.
ROC
free-response
multireader analysis
pseudo-likelihood
regression analysis
Journal
Statistics in medicine
ISSN: 1097-0258
Titre abrégé: Stat Med
Pays: England
ID NLM: 8215016
Informations de publication
Date de publication:
20 07 2022
20 07 2022
Historique:
revised:
12
03
2022
received:
25
06
2021
accepted:
14
03
2022
pubmed:
7
4
2022
medline:
24
6
2022
entrez:
6
4
2022
Statut:
ppublish
Résumé
In diagnostic radiology, the multireader multicase (MRMC) design and the free-response receiver operating characteristics (FROC) method are often used in combination. The cross-correlated data generated by the MRMC-FROC study leads to difficulties in the corresponding analysis, and the need to include covariates in the model further complicates the subsequent analysis. In this paper, we propose a regression approach based on three new measures with good interpretability. The correlation structure of the original test results is taken directly into account in the estimation procedure. The proposed method also allows the inclusion of continuous or discrete covariates. Consistent and asymptotically normal estimators are derived for the new measures. Simulation studies are conducted to evaluate the performance of the proposed approach. The simulation results show that the regression approach performs well under a wide range of scenarios. We also apply the proposed regression approach to a diagnostic study of computer-aided diagnosis in lung cancer.
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
3022-3038Informations de copyright
© 2022 John Wiley & Sons Ltd.
Références
Winawer SJ. Colorectal cancer screening. Best Pract Res Clin Gastroenterol. 2007;21(6):1031-1048.
Zhou XH, Obuchowski NA, McClish DK. Statistical Methods in Diagnostic Medicine. Hoboken, NJ: John Wiley & Sons; 2011.
Bunch PC, Hamilton JF, Sanderson GK, Simmons AH. A free response approach to the measurement and characterization of radiographic observer performance. In: Gray JE, Hendee WR, eds. Application of Optical Instrumentation in Medicine VI. Vol 0127. Philadelphia, PA: SPIE; 1977:124-135.
Starr SJ, Metz CE, Lusted LB, Goodenough DJ. Visual detection and localization of radiographic images. Radiology. 1975;116(3):533-538.
Obuchowski NA, Lieber ML, Powell KA. Data analysis for detection and localization of multiple abnormalities with application to mammography. Acad Radiol. 2000;7(7):516-525.
Bandos AI, Obuchowski NA. Evaluation of diagnostic accuracy in free-response detection-localization tasks using ROC tools. Stat Methods Med Res. 2019;28(6):1808-1825.
Bandos AI, Rockette HE, Song T, Gur D. Area under the free-response ROC curve (FROC) and a related summary index. Biometrics. 2009;65(1):247-256.
Samuelson FW, Petrick N. Comparing image detection algorithms using resampling. Proceedings of the 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro; 2006:1312-1315.
Popescu LM. Nonparametric signal detectability evaluation using an exponential transformation of the FROC curve. Med Phys. 2011;38(10):5690-5702.
Chakraborty DP, Winter L. Free-response methodology: alternate analysis and a new observer-performance experiment. Radiology. 1990;174(3):873-881.
Chakraborty DP, Berbaum KS. Observer studies involving detection and localization: modeling, analysis, and validation. Med Phys. 2004;31(8):2313-2330.
Chakraborty DP. Observer performance methods for diagnostic imaging: foundations, modeling, and applications with R-based examples. Imaging in Medical Diagnosis and Therapy. Boca Raton, FL: CRC Press; 2017.
Hillis SL, Chakraborty DP, Orton CG. ROC or FROC? It depends on the research question. Med Phys. 2017;44(5):1603-1606.
Dorfman DD, Berbaum KS, Metz CE. Receiver operating characteristic rating analysis: generalization to the population of readers and patients with the jackknife method. Investig Radiol. 1992;27(9):723-731.
Johnson TD, Johnson VE. A Bayesian hierarchical approach to multirater correlated ROC analysis. Stat Med. 2006;25(11):1858-1871.
Song X, Zhou XH. A marginal model approach for analysis of multi-reader multi-test receiver operating characteristic (ROC) data. Biostatistics. 2005;6(2):303-312.
Hillis SL, Obuchowski NA, Schartz KM, Berbaum KS. A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data. Stat Med. 2005;24(10):1579-1607.
Dodd LE, Pepe MS. Semiparametric regression for the area under the receiver operating characteristic curve. J Am Stat Assoc. 2003;98(462):409-417.
Lumley T, Mayer HN. Asymptotics for marginal generalized linear models with sparse correlations. Working Paper 207, UW Biostatistics Working Paper Series; 2003.
Liu W, Pantoja-Galicia N, Zhang B, et al. Generalized linear mixed models for multi-reader multi-case studies of diagnostic tests. Stat Methods Med Res. 2017;26(3):1373-1388.
Kim E, Zhang Z, Wang Y, Zeng D. Power calculation for comparing diagnostic accuracies in a multi-reader, multi-test design. Biometrics. 2014;70(4):1033-1041.
Obuchowski NA, Beiden SV, Berbaum KS, et al. Multireader, multicase receiver operating characteristic analysis: an empirical comparison of five methods1. Acad Radiol. 2004;11(9):980-995.
Song T, Bandos AI, Rockette HE, Gur D. On comparing methods for discriminating between actually negative and actually positive subjects with FROC type data. Med Phys. 2008;35(4):1547-1558.