Lesion Classification by Model-Based Feature Extraction: A Differential Affine Invariant Model of Soft Tissue Elasticity in CT Images.

Affine transformation Elastic deformation Invariant characteristics Lesion classification Tissue elasticity

Journal

Journal of imaging informatics in medicine
ISSN: 2948-2933
Titre abrégé: J Imaging Inform Med
Pays: Switzerland
ID NLM: 9918663679206676

Informations de publication

Date de publication:
20 Aug 2024
Historique:
received: 06 02 2024
accepted: 14 06 2024
revised: 29 05 2024
medline: 21 8 2024
pubmed: 21 8 2024
entrez: 20 8 2024
Statut: aheadofprint

Résumé

The elasticity of soft tissues has been widely considered a characteristic property for differentiation of healthy and lesions and, therefore, motivated the development of several elasticity imaging modalities, for example, ultrasound elastography, magnetic resonance elastography, and optical coherence elastography to directly measure the tissue elasticity. This paper proposes an alternative approach of modeling the elasticity for prior knowledge-based extraction of tissue elastic characteristic features for machine learning (ML) lesion classification using computed tomography (CT) imaging modality. The model describes a dynamic non-rigid (or elastic) soft tissue deformation in differential manifold to mimic the tissues' elasticity under wave fluctuation in vivo. Based on the model, a local deformation invariant is formulated using the 1

Identifiants

pubmed: 39164453
doi: 10.1007/s10278-024-01178-8
pii: 10.1007/s10278-024-01178-8
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Subventions

Organisme : NIH/NCI
ID : CA206171
Organisme : NIH/NCI
ID : CA220004

Informations de copyright

© 2024. The Author(s) under exclusive licence to Society for Imaging Informatics in Medicine.

Références

R. Oerter, "The theory of almost everything: the standard model, the unsung triumph of modern physics," (Kindle ed.). Penguin Group. p. 2. ISBN 978-0-13-236678-6, 2006.
S. Goenezen, J.-F. Dord, Z. Sink, P. E. Barbone, J. Jiang, T. J. Hall, and A. A. Oberai, "Linear and Nonlinear Elastic Modulus Imaging: An application to breast cancer diagnosis," IEEE Transactions on Medical Imaging, vol. 31, no. 8, pp. 1628-1637, 2012.
doi: 10.1109/TMI.2012.2201497 pubmed: 22665504 pmcid: 3698046
F. Paparo, L. Cevasco, D. Zefiro, E. Biscaldi, L. Bacigalupo, M. Balocco, M. Pongiglione, S. Banderali, G. L. Forni, and G. A. Rollandi, "Diagnostic Value of Real-time Elastography in the Assessment of Hepatic Fibrosis in Patients with Liver Iron Overload," European Journal of Radiology, vol. 82, no. 12, pp. e755-e761, 2013.
doi: 10.1016/j.ejrad.2013.08.038 pubmed: 24050879
F. P. Beer, E. R. Johnston Jr., J. T. DeWolf, and D. F. Mazurek, "Mechanics of Materials," McGraw Hill. pp. 56, 2009. ISBN 978-0-07-015389-9.
Y. Xiao, J. Zeng, L. Niu, Q. Zeng, T. Wu, C. Wang, R. Zheng, and H. Zheng, "Computer-Aided Diagnosis Based on Quantitative Elastographic Features with Supersonic Shear Wave Imaging," Ultrasound in Medicine & Biology, vol. 40, no. 2, pp. 275-286, 2014.
doi: 10.1016/j.ultrasmedbio.2013.09.032
B. F. Kennedy, K. M. Kennedy, and D. D. Sampson, "A Review of Optical Coherence Elastography: Fundamentals, techniques and prospects," IEEE Journal of Selected Topics in Quantum Electronics, vol. 20, no. 2, 7101217, 2014.
doi: 10.1109/JSTQE.2013.2291445
M. C. Murphy, A. Manduca, J. D. Trzasko, K. J. Glaser, J. Huston III, and R. L. Ehman, "Artificial Neural Networks for Stiffness Estimation in Magnetic Resonance Elastography," Magnetic Resonance in Medicine, vol. 80, pp. 351-360, 2018.
doi: 10.1002/mrm.27019 pubmed: 29193306
S. Park, S Salavat R. Aglyamov, and S. Y. Emelianov, "Elasticity imaging using conventional and high-frame rate ultrasound imaging: experimental study," IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, vol. 54, no. 11, pp.2246-2256, 2007.
doi: 10.1109/TUFFC.2007.529 pubmed: 18051159
A. Nowicki and K. Dobruch-Sobczak, "Introduction to Ultrasound Elastography," Journal of Ultrasonography, vol. 16, pp. 113-124, 2016.
doi: 10.15557/JoU.2016.0013 pubmed: 27446596 pmcid: 4954857
D. Wu, P. Isaksson, S. J. Ferguson, and C. Persson, "Young’s Modulus of Trabecular Bone at the Tissue Level: A review," Acta Biomaterialia, vol. 78, pp. 1-12, 2018.
doi: 10.1016/j.actbio.2018.08.001 pubmed: 30081232
J. M. Lee, "Manifolds and Differential Geometry," Studies in Mathematics, vol. 107, American Mathematical Society, 2010, ISBN:9780821848159.
F. Kantarci, E. Ustabasioglu, S. Delil, D. C. Olgun, B. Korkmazer, A. S. Dikici, O. Tutar, M. Nalbantoglu, N. Uzun, and I. Mihmanli, "Median Nerve Stiffness Measure by Shear Wave Elastography: A potential sonographic method in the diagnosis of carpal tunnel syndrome," European Radiology, vol. 24, pp.434-440, 2014.
doi: 10.1007/s00330-013-3023-7 pubmed: 24220753
D. R. Nolan, A. L. Gower, M. Destrade, R. W. Ogden, and J. P. McGarry, "A Robust Anisotropic Hyperelastic Formulation for the Modelling of Soft Tissue," Journal of the Mechanical Behavior of Biomedical Materials, vol. 39, pp. 48-60, 2014.
doi: 10.1016/j.jmbbm.2014.06.016 pubmed: 25104546
A. Baranwal, P. K. Agnihotri, and J. P. McGarry, "The Influence of Fibre Alignment on the Fracture Toughness of Anisotropic Soft Tissue," Engineering Fracture Mechanics, vol. 239, pp. 107289, 2020.
doi: 10.1016/j.engfracmech.2020.107289
B. Fereidoonnezhad, C. O’Connor, and J. P. McGarry, "A New Anisotropic Soft Tissue Model for Elimination of Unphysical Auxetic Behaviour," Journal of Biomechanics, vol. 111, pp. 110006, 2020.
doi: 10.1016/j.jbiomech.2020.110006 pubmed: 32927115
B. O’Neill, "Elementary Differential Geometry (Revised Second Edition)," Waltham, Massachusetts: Academic Press Elsevier), 2006.
M. Mirzakhani and A. Wright, "The Boundary of an Affine Invariant Submanifold," Inventiones Mathematicae, vol. 209, pp. 927-984, 2017. https://doi.org/10.1007/s00222-017-0722-8 .
doi: 10.1007/s00222-017-0722-8
J. Kostkova, T. Suk, and J. Flusser, "Affine Invariants of Vector Fields," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 4, 2021. https://doi.org/10.1109/TPAMI.2019.2951664 .
H. Li, X. Huang, and L. He, "Object Matching Using a Locally Affine Invariant and Linear Programming Techniques," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 2, pp. 411-424, 2013.
doi: 10.1109/TPAMI.2012.99 pubmed: 22529322
T. Panchal, H. Patel, and A. Panchal, "License Plate Detection using Harris Corner and Character Segmentation by Integrated Approach from an Image," Procedia Computer Science, vol. 79, pp. 415-425, 2016.
M. Reuter, F.-E. Wolter, and N. Peinecke, "Laplace–Beltrami Spectra as 'Shape-DNA' of Surfaces and Solids," Computer-Aided Design, vol. 38, no. 4, pp. 342-366, 2006.
doi: 10.1016/j.cad.2005.10.011
S. Papazoglou, U. Hamhaber, J. Braun, and I. Sack, "Algebraic Helmholtz Inversion in Planar Magnetic Resonance Elastography," Physics in Medicine & Biology, vol. 53, no. 12, pp. 3147-3158, 2008.
doi: 10.1088/0031-9155/53/12/005
G. Low, S. A. Kruse, and D. J. Lomas, "General Review of Magnetic Resonance Elastography," World Journal of Radiology, vol. 28, no. 1, pp. 59-72, 2016.
doi: 10.4329/wjr.v8.i1.59
O. Monga and S. Benayoun, "Using Partial Derivatives of 3D Images to Extract Typical Surface Features," Computer Vision and Image Understanding, vol. 61, no. 2, pp.171-189, 1995.
doi: 10.1006/cviu.1995.1014
S. Gupta and S. G. Mazumdar, "Sobel Edge Detection Algorithm," International Journal of Computer Science and Management Research, 2(2): 1578-1583, 2013.
L. Zhao, H. Bai, J. Liang, A. Wang, B. Zeng, and Y. Zhao, "Local Activity-driven Structural-preserving Filtering for Noise Removal and Image Smoothing," Signal Processing, vol. 157, pp. 62-72, 2019.
doi: 10.1016/j.sigpro.2018.11.012
T. Ojala, M. Pietikainen, and T. Maenpa, "Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no.7, pp.971-987, 2002.
doi: 10.1109/TPAMI.2002.1017623
J. Chen, S. Shan, C. He, G. Zhao, M. Pietikainen, X. Chen, and W. Gao, "WLD: A robust local image descriptor," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 9, pp. 1705-1720, 2010.
doi: 10.1109/TPAMI.2009.155 pubmed: 20634562
D. Zhang, A. Wong, M. Indrawan, and G. Lu, "Content-based image retrieval using gabor texture features," In IEEE Pacific Rim Conference on Multimedia, pp. 392-395, 2000.
D. Chen, R. Chang, W. Kuo, M. Chen, and Y. Huang, "Diagnosis of Breast Tumors with Sonographic Texture Analysis Using Wavelet Transform and Neural Networks," Ultrasound in Medicine & Biology, vol. 28, no.10, pp.1301-1310, 2002.
doi: 10.1016/S0301-5629(02)00620-8
R. M. Haralick, K. Shanmugam, and I. H. Dinstein, "Textural Features for Image Classification," IEEE Transactions on Systems, Man, and Cybernetics, vol. 3, no.6, pp. 610-621, 1973.
doi: 10.1109/TSMC.1973.4309314
C. Sun and W. G. Wee, "Neighboring Gray Level Dependence Matrix for Texture Classification," Computer Vision, Graphics, and Image Processing, vol. 23, no.3, pp. 341-352, 1983.
doi: 10.1016/0734-189X(83)90032-4
X. Tang, "Texture Information in Run-length Matrices," IEEE Transactions on Imaging Processing, vol. 7, no.11, pp. 1602-1609, 1998.
doi: 10.1109/83.725367
G. Thibault, J. Angulo, and F. Meyer, "Advanced Statistical Matrices for Texture Characterization: Application to Cell Classification," IEEE Transactions on Biomedical Engineering, vol. 61, no.3, pp. 630-637, 2014.
doi: 10.1109/TBME.2013.2284600 pubmed: 24108747
Y. Hu, Z. Liang, B. Song, H. Han, P. J. Pickhardt, W. Zhu, and C. E. Lascarides,” Texture feature extraction and analysis for polyp differentiation via computed tomography colonography," IEEE Transactions on Medical Imaging, vol. 35, no.6, pp. 1522-1531, 2016.
doi: 10.1109/TMI.2016.2518958 pubmed: 26800530 pmcid: 4891231
W. Cao, Z. Liang, M. J. Pomeroy, K. Ng, S. Zhang, Y. Gao, P. J. Pickhardt, M. A. Barish, A. F. Abbasi, and H. Lu, "Multilayer Feature Selection Method for Polyp Classification via Computed Tomographic Colonography," Journal of Medical Imaging, vol. 6, no.4, pp. 044503 (2019), https://doi.org/10.1117/1.JMI.6.4.044503 .
doi: 10.1117/1.JMI.6.4.044503 pubmed: 32280727 pmcid: 7144683
Z. Wang, Z. Liang, X. Li, L. Li, B. Li, D. Eremina, and H. Lu, "An Improved Electronic Colon Cleansing Method for Detection of Colonic Polyps by Virtual Colonoscopy," IEEE Transactions on Biomedical Engineering, vol. 53, no. 8, pp. 1635-1646,2006.
doi: 10.1109/TBME.2006.877793 pubmed: 16916098
K. Simonyan and A. Zisserman, "Very deep convolution newtworks for large-scale image recognition," ArXiv: 1409-1556, 2014.
K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016.
C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, "Rethinking the inception architecture for computer vision," In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2818-2826, 2016.
B. Li and G. J. Babu, "Convolution theorem and asymptotic efficiency," In: A Graduate Course on Statistical Inference, Springer Texts in Statistics, Springer, 2019, New York, NY. https://doi.org/10.1007/978-1-4939-9761-9_10 .
L. Breiman, "Random Forest," Machine Learning, vol. 45, no. 5, pp. 5-32, 2001.
doi: 10.1023/A:1010933404324
Z. H. Zhang, "Variable Selection with Stepwise and Best Subset Approaches," Annuals of Translational Medicine, vol. 4, no.7, pp. 136-136, 2016.
doi: 10.21037/atm.2016.03.35
P. Prasanna, P. Tiwari, and A. Madabhushi, "Co-occurrence of Local Anisotropic Gradient Orientations (CoLIAGe): A new radiomics descriptor," Scientific Reports, vol. 6, pp. 37241, 2016.
doi: 10.1038/srep37241 pubmed: 27872484 pmcid: 5118705
Y. Hao, S. Li, H. Mo, and H. Li, "Affine-gradient based local binary pattern descriptor for texture classification," In International Conference on Image and Graphics, pp. 199-210, 2017.
S. K. Roy, D. K. Ghosh, R. K. Pal, and B. B. Chaudhuri, "Affine differential local mean zigzag pattern for texture classification," In TENCON 2018 - IEEE Region 10 Conference, pp. 488-493, 2018.
C. Szegedy, A. Toshev, and D. Erhan, "Deep neural networks for object detection," In Advances in Neural Information Processing Systems (NIPS), pp. 2553-2561, 2013.
M. Roberts, D. Driggs, M. Thorpe, J. Gilbey , M. Yeung , S. Ursprung , A. I. Aviles-Rivero, C. Etmann, C. McCague, L. Beer, J. R. Weir-McCall , Z. Teng, E. Gkrania-Klotsas, A. Covnet, J. H. F. Rudd , E. Sala , and C-B. Schönlieb, "Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans," Nature Machine Intelligence, vol. 3, pp. 199-217, (2021), https://www.nature.com/natmachintell199/
S. J. Adams, D. K. Madtes, B. Burbridge, J. Johnston, I. G. Goldber, E. L. Siegel, P. Babyn, V. S. Nair, and M. E. Calhoun, “Clinical impact and generalizability of a computer-assisted diagnostic tool to risk-stratify lung nodules with CT,” Journal of the American College of Radiology, vol. 20, no. 2, pp. 232-242, 2023.
doi: 10.1016/j.jacr.2022.08.006 pubmed: 36064040
MIT Technology Review, "Hundreds of AI tools have been built to catch COVID-19. none of them helped," Artificial Intelligence/Machine Learning, July 30, 2021, https://www.technologyreview.com/2021/07/30/1030329/machine-learning-ai-failed-covid-hospital-diagnosis-pandemic/
J. Tan, Y. Gao, Z. Liang, W. Cao, M. J. Pomeroy, Y. Huo, L. Li, M. A. Barish, A. F. Abbasi, and P. J. Pickhardt, "3D-GLCM CNN: A 3-dimensional gray-level co-occurrence matrix based CNN model for polyp classification via CT colonography," IEEE Transactions on Medical Imaging, vol. 39, no. 6, pp. 2013-2024, 2020.
doi: 10.1109/TMI.2019.2963177 pubmed: 31899419

Auteurs

Weiguo Cao (W)

Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA. george.wg.cao@gmail.com.

Marc J Pomeroy (MJ)

Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA.
Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA.

Zhengrong Liang (Z)

Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA. jerome.liang@stonybrook.edu.
Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA. jerome.liang@stonybrook.edu.

Yongfeng Gao (Y)

Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA.

Yongyi Shi (Y)

Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA.

Jiaxing Tan (J)

Department of Computer Science, City University of New York, New York, NY, 10314, USA.

Fangfang Han (F)

School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China.

Jing Wang (J)

Department of Radiation Oncology, University of Texas Southwestern Medical Centre, Dallas, TX, 75235, USA.

Jianhua Ma (J)

Department of Radiation Oncology, University of Texas Southwestern Medical Centre, Dallas, TX, 75235, USA.

Hongbin Lu (H)

Department of Biomedical Engineering, The Fourth Medical University, Xi'an, China.

Almas F Abbasi (AF)

Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA.

Perry J Pickhardt (PJ)

Department of Radiology, School of Medicine, University of Wisconsin, Madison, WI, 53792, USA.

Classifications MeSH