Deep learning performance for detection and classification of microcalcifications on mammography.

Artificial intelligence Machine learning Mammography Microcalcifications Neural networks (computer)

Journal

European radiology experimental
ISSN: 2509-9280
Titre abrégé: Eur Radiol Exp
Pays: England
ID NLM: 101721752

Informations de publication

Date de publication:
07 11 2023
Historique:
received: 27 05 2023
accepted: 07 09 2023
medline: 8 11 2023
pubmed: 7 11 2023
entrez: 7 11 2023
Statut: epublish

Résumé

Breast cancer screening through mammography is crucial for early detection, yet the demand for mammography services surpasses the capacity of radiologists. Artificial intelligence (AI) can assist in evaluating microcalcifications on mammography. We developed and tested an AI model for localizing and characterizing microcalcifications. Three expert radiologists annotated a dataset of mammograms using histology-based ground truth. The dataset was partitioned for training, validation, and testing. Three neural networks (AlexNet, ResNet18, and ResNet34) were trained and evaluated using specific metrics including receiver operating characteristics area under the curve (AUC), sensitivity, and specificity. The reported metrics were computed on the test set (10% of the whole dataset). The dataset included 1,000 patients aged 21-73 years and 1,986 mammograms (180 density A, 220 density B, 380 density C, and 220 density D), with 389 malignant and 611 benign groups of microcalcifications. AlexNet achieved the best performance with 0.98 sensitivity, 0.89 specificity of, and 0.98 AUC for microcalcifications detection and 0.85 sensitivity, 0.89 specificity, and 0.94 AUC of for microcalcifications classification. For microcalcifications detection, ResNet18 and ResNet34 achieved 0.96 and 0.97 sensitivity, 0.91 and 0.90 specificity and 0.98 and 0.98 AUC, retrospectively. For microcalcifications classification, ResNet18 and ResNet34 exhibited 0.75 and 0.84 sensitivity, 0.85 and 0.84 specificity, and 0.88 and 0.92 AUC, respectively. The developed AI models accurately detect and characterize microcalcifications on mammography. AI-based systems have the potential to assist radiologists in interpreting microcalcifications on mammograms. The study highlights the importance of developing reliable deep learning models possibly applied to breast cancer screening. • A novel AI tool was developed and tested to aid radiologists in the interpretation of mammography by accurately detecting and characterizing microcalcifications. • Three neural networks (AlexNet, ResNet18, and ResNet34) were trained, validated, and tested using an annotated dataset of 1,000 patients and 1,986 mammograms. • The AI tool demonstrated high accuracy in detecting/localizing and characterizing microcalcifications on mammography, highlighting the potential of AI-based systems to assist radiologists in the interpretation of mammograms.

Sections du résumé

BACKGROUND
Breast cancer screening through mammography is crucial for early detection, yet the demand for mammography services surpasses the capacity of radiologists. Artificial intelligence (AI) can assist in evaluating microcalcifications on mammography. We developed and tested an AI model for localizing and characterizing microcalcifications.
METHODS
Three expert radiologists annotated a dataset of mammograms using histology-based ground truth. The dataset was partitioned for training, validation, and testing. Three neural networks (AlexNet, ResNet18, and ResNet34) were trained and evaluated using specific metrics including receiver operating characteristics area under the curve (AUC), sensitivity, and specificity. The reported metrics were computed on the test set (10% of the whole dataset).
RESULTS
The dataset included 1,000 patients aged 21-73 years and 1,986 mammograms (180 density A, 220 density B, 380 density C, and 220 density D), with 389 malignant and 611 benign groups of microcalcifications. AlexNet achieved the best performance with 0.98 sensitivity, 0.89 specificity of, and 0.98 AUC for microcalcifications detection and 0.85 sensitivity, 0.89 specificity, and 0.94 AUC of for microcalcifications classification. For microcalcifications detection, ResNet18 and ResNet34 achieved 0.96 and 0.97 sensitivity, 0.91 and 0.90 specificity and 0.98 and 0.98 AUC, retrospectively. For microcalcifications classification, ResNet18 and ResNet34 exhibited 0.75 and 0.84 sensitivity, 0.85 and 0.84 specificity, and 0.88 and 0.92 AUC, respectively.
CONCLUSIONS
The developed AI models accurately detect and characterize microcalcifications on mammography.
RELEVANCE STATEMENT
AI-based systems have the potential to assist radiologists in interpreting microcalcifications on mammograms. The study highlights the importance of developing reliable deep learning models possibly applied to breast cancer screening.
KEY POINTS
• A novel AI tool was developed and tested to aid radiologists in the interpretation of mammography by accurately detecting and characterizing microcalcifications. • Three neural networks (AlexNet, ResNet18, and ResNet34) were trained, validated, and tested using an annotated dataset of 1,000 patients and 1,986 mammograms. • The AI tool demonstrated high accuracy in detecting/localizing and characterizing microcalcifications on mammography, highlighting the potential of AI-based systems to assist radiologists in the interpretation of mammograms.

Identifiants

pubmed: 37934382
doi: 10.1186/s41747-023-00384-3
pii: 10.1186/s41747-023-00384-3
pmc: PMC10630180
doi:

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

69

Informations de copyright

© 2023. The Author(s).

Références

Curr Oncol. 2021 Jun 25;28(4):2351-2372
pubmed: 34202321
Eur Radiol. 2021 Aug;31(8):5902-5912
pubmed: 33496829
J Am Coll Radiol. 2020 Jan;17(1 Pt A):56-63
pubmed: 31153798
CA Cancer J Clin. 2021 May;71(3):209-249
pubmed: 33538338
Semin Cancer Biol. 2021 Jul;72:214-225
pubmed: 32531273
Invest Radiol. 2021 Apr 1;56(4):224-231
pubmed: 33038095
Radiology. 2019 Feb;290(2):305-314
pubmed: 30457482
Eur Radiol Exp. 2018 Oct 24;2(1):35
pubmed: 30353365
Nature. 2020 Jan;577(7788):89-94
pubmed: 31894144
Eur Radiol. 2021 Mar;31(3):1687-1692
pubmed: 32876835
J Healthc Eng. 2019 Apr 9;2019:9360941
pubmed: 31093321
Lancet. 2021 Nov 20;398(10314):1867
pubmed: 34801097
Br J Radiol. 2023 Jan 1;96(1141):20220569
pubmed: 36314388
Radiol Artif Intell. 2019 Jul 31;1(4):e180096
pubmed: 32076660
Radiology. 2019 Oct;293(1):38-46
pubmed: 31385754
Sci Rep. 2016 Jun 07;6:27327
pubmed: 27273294
Br J Radiol. 2020 Oct 1;93(1114):20200679
pubmed: 32877209
Korean J Radiol. 2017 Jul-Aug;18(4):570-584
pubmed: 28670152
Insights Imaging. 2018 Oct;9(5):745-753
pubmed: 30112675
J Immigr Minor Health. 2017 Dec;19(6):1362-1371
pubmed: 26852236
Radiol Artif Intell. 2020 Nov 04;2(6):e190208
pubmed: 33937844
Eur Radiol. 2021 Nov;31(11):8682-8691
pubmed: 33948701
Lancet Digit Health. 2020 Mar;2(3):e138-e148
pubmed: 33334578
Eur J Radiol. 2020 Nov;132:109309
pubmed: 33010682
J Natl Compr Canc Netw. 2018 Nov;16(11):1362-1389
pubmed: 30442736
J Natl Cancer Inst. 2019 Sep 1;111(9):916-922
pubmed: 30834436
Radiology. 2021 Jul;300(1):57-65
pubmed: 33944627
Radiology. 2018 Mar;286(3):800-809
pubmed: 29309734
Front Genet. 2023 Jan 04;13:1097207
pubmed: 36685963
Comput Math Methods Med. 2019 Mar 3;2019:2717454
pubmed: 30944574
JAMA Oncol. 2020 Oct 1;6(10):1581-1588
pubmed: 32852536
Med Clin North Am. 2015 May;99(3):451-68
pubmed: 25841594

Auteurs

Filippo Pesapane (F)

Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy. filippo.pesapane@ieo.it.

Chiara Trentin (C)

Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy.

Federica Ferrari (F)

Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy.

Giulia Signorelli (G)

Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy.

Priyan Tantrige (P)

Department of Radiology, King's College Hospital NHS Foundation Trust, London, UK.

Marta Montesano (M)

Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy.

Crispino Cicala (C)

Laife Reply, Milan, Italy.

Roberto Virgoli (R)

Laife Reply, Milan, Italy.

Silvia D'Acquisto (S)

Laife Reply, Milan, Italy.

Luca Nicosia (L)

Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy.

Daniela Origgi (D)

Medical Physics Unit, IEO European Institute of Oncology IRCCS, Milan, Italy.

Enrico Cassano (E)

Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH