Automated lung tumor delineation on positron emission tomography/computed tomography via a hybrid regional network.
PET/CT
deep learning
lung tumor
radiotherapy
segmentation
Journal
Medical physics
ISSN: 2473-4209
Titre abrégé: Med Phys
Pays: United States
ID NLM: 0425746
Informations de publication
Date de publication:
Jan 2023
Jan 2023
Historique:
revised:
20
09
2022
received:
16
04
2021
accepted:
20
09
2022
pmc-release:
01
01
2024
pubmed:
8
10
2022
medline:
25
1
2023
entrez:
7
10
2022
Statut:
ppublish
Résumé
Multimodality positron emission tomography/computed tomography (PET/CT) imaging combines the anatomical information of CT with the functional information of PET. In the diagnosis and treatment of many cancers, such as non-small cell lung cancer (NSCLC), PET/CT imaging allows more accurate delineation of tumor or involved lymph nodes for radiation planning. In this paper, we propose a hybrid regional network method of automatically segmenting lung tumors from PET/CT images. The hybrid regional network architecture synthesizes the functional and anatomical information from the two image modalities, whereas the mask regional convolutional neural network (R-CNN) and scoring fine-tune the regional location and quality of the output segmentation. This model consists of five major subnetworks, that is, a dual feature representation network (DFRN), a regional proposal network (RPN), a specific tumor-wise R-CNN, a mask-Net, and a score head. Given a PET/CT image as inputs, the DFRN extracts feature maps from the PET and CT images. Then, the RPN and R-CNN work together to localize lung tumors and reduce the image size and feature map size by removing irrelevant regions. The mask-Net is used to segment tumor within a volume-of-interest (VOI) with a score head evaluating the segmentation performed by the mask-Net. Finally, the segmented tumor within the VOI was mapped back to the volumetric coordinate system based on the location information derived via the RPN and R-CNN. We trained, validated, and tested the proposed neural network using 100 PET/CT images of patients with NSCLC. A fivefold cross-validation study was performed. The segmentation was evaluated with two indicators: (1) multiple metrics, including the Dice similarity coefficient, Jacard, 95th percentile Hausdorff distance, mean surface distance (MSD), residual mean square distance, and center-of-mass distance; (2) Bland-Altman analysis and volumetric Pearson correlation analysis. In fivefold cross-validation, this method achieved Dice and MSD of 0.84 ± 0.15 and 1.38 ± 2.2 mm, respectively. A new PET/CT can be segmented in 1 s by this model. External validation on The Cancer Imaging Archive dataset (63 PET/CT images) indicates that the proposed model has superior performance compared to other methods. The proposed method shows great promise to automatically delineate NSCLC tumors on PET/CT images, thereby allowing for a more streamlined clinical workflow that is faster and reduces physician effort.
Sections du résumé
BACKGROUND
BACKGROUND
Multimodality positron emission tomography/computed tomography (PET/CT) imaging combines the anatomical information of CT with the functional information of PET. In the diagnosis and treatment of many cancers, such as non-small cell lung cancer (NSCLC), PET/CT imaging allows more accurate delineation of tumor or involved lymph nodes for radiation planning.
PURPOSE
OBJECTIVE
In this paper, we propose a hybrid regional network method of automatically segmenting lung tumors from PET/CT images.
METHODS
METHODS
The hybrid regional network architecture synthesizes the functional and anatomical information from the two image modalities, whereas the mask regional convolutional neural network (R-CNN) and scoring fine-tune the regional location and quality of the output segmentation. This model consists of five major subnetworks, that is, a dual feature representation network (DFRN), a regional proposal network (RPN), a specific tumor-wise R-CNN, a mask-Net, and a score head. Given a PET/CT image as inputs, the DFRN extracts feature maps from the PET and CT images. Then, the RPN and R-CNN work together to localize lung tumors and reduce the image size and feature map size by removing irrelevant regions. The mask-Net is used to segment tumor within a volume-of-interest (VOI) with a score head evaluating the segmentation performed by the mask-Net. Finally, the segmented tumor within the VOI was mapped back to the volumetric coordinate system based on the location information derived via the RPN and R-CNN. We trained, validated, and tested the proposed neural network using 100 PET/CT images of patients with NSCLC. A fivefold cross-validation study was performed. The segmentation was evaluated with two indicators: (1) multiple metrics, including the Dice similarity coefficient, Jacard, 95th percentile Hausdorff distance, mean surface distance (MSD), residual mean square distance, and center-of-mass distance; (2) Bland-Altman analysis and volumetric Pearson correlation analysis.
RESULTS
RESULTS
In fivefold cross-validation, this method achieved Dice and MSD of 0.84 ± 0.15 and 1.38 ± 2.2 mm, respectively. A new PET/CT can be segmented in 1 s by this model. External validation on The Cancer Imaging Archive dataset (63 PET/CT images) indicates that the proposed model has superior performance compared to other methods.
CONCLUSION
CONCLUSIONS
The proposed method shows great promise to automatically delineate NSCLC tumors on PET/CT images, thereby allowing for a more streamlined clinical workflow that is faster and reduces physician effort.
Identifiants
pubmed: 36203393
doi: 10.1002/mp.16001
pmc: PMC9868056
mid: NIHMS1841065
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
274-283Subventions
Organisme : NCI NIH HHS
ID : R01 CA215718
Pays : United States
Organisme : NIBIB NIH HHS
ID : R56 EB033332
Pays : United States
Organisme : NIH HHS
ID : R01CA215718
Pays : United States
Organisme : NIH HHS
ID : R56EB033332
Pays : United States
Informations de copyright
© 2022 American Association of Physicists in Medicine.
Références
Phys Med Biol. 2015 Feb 21;60(4):R115-54
pubmed: 25650582
Phys Med. 2020 Aug;76:294-306
pubmed: 32738777
Comput Biol Med. 2014 Jul;50:76-96
pubmed: 24845019
Radiother Oncol. 2010 Sep;96(3):302-7
pubmed: 20708286
Inf Process Med Imaging. 2011;22:245-56
pubmed: 21761661
Curr Med Imaging. 2020;16(3):231-240
pubmed: 32133953
Med Phys. 2021 Jan;48(1):204-214
pubmed: 33128230
Annu Int Conf IEEE Eng Med Biol Soc. 2017 Jul;2017:1998-2001
pubmed: 29060287
Med Phys. 2008 Apr;35(4):1207-13
pubmed: 18491512
Phys Med Biol. 2021 Feb 11;66(4):045021
pubmed: 33412527
Br J Cancer. 2019 Apr;120(8):779-790
pubmed: 30911090
Radiother Oncol. 2019 Dec;141:192-199
pubmed: 31630868
Neurocomputing. 2020 Jun 7;392:277-295
pubmed: 32773965
Annu Rev Biomed Eng. 2015;17:385-414
pubmed: 26643024
Stat Methods Med Res. 1994;3(3):211-26
pubmed: 7820292
J Nucl Med. 2006 Nov;47(11):1808-12
pubmed: 17079814
Med Phys. 2020 Sep;47(9):4316-4324
pubmed: 32654153
Phys Med Biol. 2017 Jul 06;62(15):6008-6025
pubmed: 28682793
Med Phys. 2021 Oct;48(10):5862-5873
pubmed: 34342878
Int J Radiat Oncol Biol Phys. 2005 Apr 1;61(5):1385-92
pubmed: 15817341
Phys Med Biol. 2018 Dec 21;64(1):015011
pubmed: 30523964
J Nucl Med. 2007 Jun;48(6):932-45
pubmed: 17504879
Phys Med Biol. 2020 Sep 18;65(18):185009
pubmed: 32674075
PET Clin. 2021 Oct;16(4):553-576
pubmed: 34537130
Biochem Med (Zagreb). 2015 Jun 05;25(2):141-51
pubmed: 26110027
PLoS One. 2019 Jan 22;14(1):e0210075
pubmed: 30668601