Recurrent attention network for false positive reduction in the detection of pulmonary nodules in thoracic CT scans.
LUNA challenge
chest CT
computer-aided diagnosis
pulmonary nodule detection
recurrent neural network
Journal
Medical physics
ISSN: 2473-4209
Titre abrégé: Med Phys
Pays: United States
ID NLM: 0425746
Informations de publication
Date de publication:
Jun 2020
Jun 2020
Historique:
received:
24
10
2019
revised:
13
12
2019
accepted:
13
01
2020
pubmed:
8
2
2020
medline:
2
3
2021
entrez:
8
2
2020
Statut:
ppublish
Résumé
Multiview two-dimensional (2D) convolutional neural networks (CNNs) and three-dimensional (3D) CNNs have been successfully used for analyzing volumetric data in many state-of-the-art medical imaging applications. We propose an alternative modular framework that analyzes volumetric data with an approach that is analogous to radiologists' interpretation, and apply the framework to reduce false positives that are generated in computer-aided detection (CADe) systems for pulmonary nodules in thoracic computed tomography (CT) scans. In our approach, a deep network consisting of 2D CNNs first processes slices individually. The features extracted in this stage are then passed to a recurrent neural network (RNN), thereby modeling consecutive slices as a sequence of temporal data and capturing the contextual information across all three dimensions in the volume of interest. Outputs of the RNN layer are weighed before the final fully connected layer, enabling the network to scale the importance of different slices within a volume of interest in an end-to-end training framework. We validated the proposed architecture on the false positive reduction track of the lung nodule analysis (LUNA) challenge for pulmonary nodule detection in chest CT scans, and obtained competitive results compared to 3D CNNs. Our results show that the proposed approach can encode the 3D information in volumetric data effectively by achieving a sensitivity >0.8 with just 1/8 false positives per scan. Our experimental results demonstrate the effectiveness of temporal analysis of volumetric images for the application of false positive reduction in chest CT scans and show that state-of-the-art 2D architectures from the literature can be directly applied to analyzing volumetric medical data. As newer and better 2D architectures are being developed at a much faster rate compared to 3D architectures, our approach makes it easy to obtain state-of-the-art performance on volumetric data using new 2D architectures.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
2150-2160Informations de copyright
© 2020 American Association of Physicists in Medicine.
Références
Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394-424.
National Lung Screening Trial Research Team. Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med. 2011;365:395-409.
National Lung Screening Trial Research Team. The national lung screening trial: overview and study design. Radiology. 2011;258:243-253.
Van Ginneken B, Setio AA, Jacobs C, Ciompi F. Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans, in Biomedical Imaging (ISBI), 2015 IEEE 12th International Symposium on, pages 286-289, IEEE, 2015.
Tang H, Kim DR, Xie X. Automated pulmonary nodule detection using 3D deep convolutional neural networks, in Biomedical Imaging (ISBI 2018), 2018 IEEE 15th International Symposium on, pages 523-526, IEEE, 2018.
Setio AAA, Ciompi F, Litjens G, et al. Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging. 2016;35:1160-1169.
Jiang H, Ma H, Qian W, Gao M, Li Y. An automatic detection system of lung nodule based on multigroup patch-based deep learning network. IEEE J Biomed Health Inform. 2018;22:1227-1237.
Frangi AF, Niessen WJ, Vincken KL, Viergever MA. Multiscale vessel enhancement filtering. in International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 130-137, Springer, 1998.
Dou Q, Chen H, Yu L, Qin J, Heng P-A. Multilevel contextual 3-D CNNs for false positive reduction in pulmonary nodule detection. IEEE Trans Biomed Eng. 2017;64:1558-1567.
Dou Q, Chen H, Jin Y, Lin H, Qin J, Heng P-A. Automated pulmonary nodule detection via 3D convnets with online sample filtering and hybrid-loss residual learning, in International Conference on Medical Image Computing and Computer-Assisted Intervention pages 630-638, Springer, 2017.
Jin H, Li Z, Tong R, Lin L. A deep 3D residual CNN for false-positive reduction in pulmonary nodule detection. Med Phys. 2018;45:2097-2107.
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition, in Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770-778, 2016.
Khosravan N, Bagci U. S4nd: Single-shot single-scale lung nodule detection, in International Conference on Medical Image omputing and Computer-Assisted Intervention, pages 794-802, Springer, 2018.
Szegedy C, Liu W, Jia Y, et al. Going deeper with convolutions, in Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1-9, 2015.
Donahue J, Anne Hendricks L, Guadarrama S, et al. Long-term recurrent convolutional networks for visual recognition and description, in Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2625-2634, 2015.
Shi B, Bai X, Yao C. An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition. IEEE Trans Pattern Anal Mach Intell. 2017;39:2298-2304.
Chen J, Yang L, Zhang Y, Alber M, Chen DZ. Combining fully convolutional and recurrent neural networks for 3D biomedical image segmentation, in Advances in Neural Information Processing Systems, pages 3036-3044, 2016.
Ypsilantis P-P, Montana G. Recurrent convolutional networks for pulmonary nodule detection in CT imaging, arXiv preprint arXiv:1609.09143; 2016.
Grewal M, Srivastava MM, Kumar P, Varadarajan S. RADnet: Radiologist level accuracy using deep learning for hemorrhage detection in CT scans, in Biomedical Imaging (ISBI 2018), 2018 IEEE 15th International Symposium on, pages 281-284, IEEE, 2018.
Cheng D, Liu M. Combining convolutional and recurrent neural networks for Alzheimer's disease diagnosis using PET images, in Imaging Systems and Techniques (IST), 2017 IEEE International Conference on, pages 1-5, IEEE, 2017.
Setio AAA, Traverso A, De Bel T, et al. Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Med Image Anal. 2017;42:1-13.
Armato SG III, McLennan G, Bidaut L, et al. Data From LIDC-IDRI. Cancer Imag Arch. 2015;9.
Amodei D, Ananthanarayanan S, Anubhai R, et al. Deep speech 2: End-to-end speech recognition in english and mandarin, in International Conference on Machine Learning, pages 173-182, 2016.
Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9:1735-1780.
Cho K, Van Merriënboer B, Gulcehre C, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation, arXiv preprint arXiv:1406.1078; 2014.
Schuster M, Paliwal KK. Bidirectional recurrent neural networks. IEEE Trans Signal Process. 1997;45:2673-2681.
Sharma S, Kiros R, Salakhutdinov R. Action recognition using visual attention, arXiv preprint arXiv:1511.04119; 2015.
He K, Sun J. Convolutional neural networks at constrained time cost, in Proceedings of the IEEE conference on computer vision and pattern recognition, pages 5353-5360, 2015.
Egan JP, Greenberg GZ, Schulman AI. Operating characteristics, signal detectability, and the method of free response. J Acoust Soc Am. 1961;33:993-1007.
Niemeijer M, Loog M, Abramoff MD, Viergever MA, Prokop M, van Ginneken B. On combining computer-aided detection systems. IEEE Trans Med Imaging. 2011;30:215-223.
Glorot X, Bengio Y. Understanding the difficulty of training deep feedforward neural networks, in Proceedings of the thirteenth international conference on artificial intelligence and statistics, pages 249-256, 2010.
Kingma DP, Ba J. Adam: A method for stochastic optimization, arXiv preprint arXiv:1412.6980; 2014.
Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014;15:1929-1958.
Xie H, Yang D, Sun N, Chen Z, Zhang Y. Automated pulmonary nodule detection in CT images using deep convolutional neural networks. Pattern Recogn. 2018;85:109-119.
Pezeshk A, Hamidian S, Petrick N, Sahiner B. 3D convolutional neural networks for automatic detection of pulmonary nodules in chest CT. IEEE J Biomed Health Inform. 2018;23:2080-2090.
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks, in Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4700-4708, 2017.
Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L, Imagenet: A large-scale hierarchical image database, in Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 248-255, IEEE, 2009.