Accurate quantification of dislocation loops in complex functional alloys enabled by deep learning image analysis.
Alloys
Deep learning
Defect characterization
Dislocation loops
Electron microscopy
Ion irradiation
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
24 Oct 2024
24 Oct 2024
Historique:
received:
05
04
2024
accepted:
30
09
2024
medline:
25
10
2024
pubmed:
25
10
2024
entrez:
25
10
2024
Statut:
epublish
Résumé
In-depth statistics of individual defects observed during transmission electron microscopy (TEM) experiments are essential for the thorough characterization of materials. In this study, we aim to quantitatively characterize the population of dislocation loops in ion-irradiated CrFeMnNi alloys. To this end, we propose an efficient guideline to prepare TEM micrographs dataset for deep learning analysis, adapted for accurate characterization of microstructures produced by thousands of overlapping defects, a very common situation in TEM images, unfeasible by previous existing methods. To reduce human effort, we annotate only a few images and complement the database through a two-step process: initially, singular value decomposition to normalize image background, followed by a controlled data augmentation. The performed analysis provides precise quantitative information about the number of loops of different types, as well as their spatial distribution, their size, and the inter-object distances. These characteristics provide insights into the nucleation, mobility, and growth of dislocation loops, as well as the elastic anisotropy of the material. Our results emphasize how accurate analysis of complex microstructures can provide insights into the physical properties of materials and open up many perspectives for attaining quantitative information on materials properties based solely on their image analysis.
Identifiants
pubmed: 39448616
doi: 10.1038/s41598-024-74894-4
pii: 10.1038/s41598-024-74894-4
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
25168Subventions
Organisme : Grand Équipement National De Calcul Intensif,France
ID : A0150906973
Organisme : Grand Équipement National De Calcul Intensif,France
ID : A0150906973
Organisme : Grand Équipement National De Calcul Intensif,France
ID : A0150906973
Informations de copyright
© 2024. The Author(s).
Références
Williams, D. B. & Carter, C. B. The Transmission Electron Microscope, 3–17 (Springer, US, Boston, MA, 1996).
doi: 10.1007/978-1-4757-2519-3
Hirsch, P. B. Electron Microscopy of Thin Crystals 6th edn. (Krieger Pub Co, Huntington, N.Y., 1977).
Arakawa, K. et al. Quantum de-trapping and transport of heavy defects in tungsten. Nat. Mater. 19, 508–511. https://doi.org/10.1038/s41563-019-0584-0 (2020).
doi: 10.1038/s41563-019-0584-0
pubmed: 31988514
Gao, J. J. et al. Temperature effect on radiation-induced dislocation loops in an fcc high purity crfemnni multi-principal element alloy. Materialia 26, 101580. https://doi.org/10.1016/j.mtla.2022.101580 (2022).
doi: 10.1016/j.mtla.2022.101580
Kan, M., Décamps, B., Fraczkiewicz, A., Prima, F. & Loyer-Prost, M. Inversion of dislocation loop nature driven by cluster migration in self-ion irradiated nickel. Scripta Materialia 208, 114338. https://doi.org/10.1016/j.scriptamat.2021.114338 (2022).
doi: 10.1016/j.scriptamat.2021.114338
Prokhodtseva, A., Décamps, B., Ramar, A. & Schäublin, R. Impact of He and Cr on defect accumulation in ion-irradiated ultrahigh-purity Fe(Cr) alloys. Acta Mater. 61, 6958–6971. https://doi.org/10.1016/j.actamat.2013.08.007 (2013).
doi: 10.1016/j.actamat.2013.08.007
Hernández-Mayoral, M., Heintze, C. & Oñorbe, E. Transmission electron microscopy investigation of the microstructure of Fe-Cr alloys induced by neutron and ion irradiation at [Formula: see text]C. J. Nucl. Mater. 474, 88–98. https://doi.org/10.1016/j.jnucmat.2016.03.002 (2016).
doi: 10.1016/j.jnucmat.2016.03.002
Nastar, M., Belkacémi, L., Meslin, E. & Loyer-Prost, M. Thermodynamic model for lattice point defect-mediated semi-coherent precipitation in alloys. Commun. Mater. 2, 1–11. https://doi.org/10.1038/s43246-021-00136-z (2021).
doi: 10.1038/s43246-021-00136-z
Jenkins, M. L. & Kirk, M. A. Characterisation of Radiation Damage by Transmission Electron Microscopy (CRC Press, 2000).
doi: 10.1201/9781420034646
Lu, C. et al. Radiation-induced segregation on defect clusters in single-phase concentrated solid-solution alloys. Acta Mater. 127, 98–107. https://doi.org/10.1016/j.actamat.2017.01.019 (2017).
doi: 10.1016/j.actamat.2017.01.019
Barr, C. M. et al. Exploring radiation induced segregation mechanisms at grain boundaries in equiatomic cocrfenimn high entropy alloy under heavy ion irradiation. Scripta Mater. 156, 80–84. https://doi.org/10.1016/j.scriptamat.2018.06.041 (2018).
doi: 10.1016/j.scriptamat.2018.06.041
Chen, W.-Y. et al. Irradiation effects in high entropy alloys and 316H stainless steel at [Formula: see text] C. J. Nucl. Mater. 510, 421–430. https://doi.org/10.1016/j.jnucmat.2018.08.031 (2018).
doi: 10.1016/j.jnucmat.2018.08.031
Yang, T. et al. Influence of irradiation temperature on void swelling in NiCoFeCrMn and NiCoFeCrPd. Scripta Mater. 158, 57–61. https://doi.org/10.1016/j.scriptamat.2018.08.021 (2019).
doi: 10.1016/j.scriptamat.2018.08.021
Xiu, P. et al. Dislocation loop evolution and radiation hardening in nickel-based concentrated solid solution alloys. J. Nucl. Mater. 538, 152247. https://doi.org/10.1016/j.jnucmat.2020.152247 (2020).
doi: 10.1016/j.jnucmat.2020.152247
Lambrecht, M. et al. On the correlation between irradiation-induced microstructural features and the hardening of reactor pressure vessel steels. J. Nucl. Mater. 406, 84–89. https://doi.org/10.1016/j.jnucmat.2010.05.020 (2010).
doi: 10.1016/j.jnucmat.2010.05.020
Mason, D., Sand, A., Yi, X. & Dudarev, S. Direct observation of the spatial distribution of primary cascade damage in tungsten. Acta Mater. 144, 905–917. https://doi.org/10.1016/j.actamat.2017.10.031 (2018).
doi: 10.1016/j.actamat.2017.10.031
Aggarwal, C. C. Neural Networks and Deep Learning (Springer International Publishing AG, 2018).
doi: 10.1007/978-3-319-94463-0
Zou, Z., Chen, K., Shi, Z., Guo, Y. & Ye, J. Object detection in 20 years: A survey. Proc. IEEE 111, 257–276. https://doi.org/10.1109/JPROC.2023.3238524 (2023).
doi: 10.1109/JPROC.2023.3238524
Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. Commun. ACM 60, 84–90. https://doi.org/10.1145/3065386 (2017).
doi: 10.1145/3065386
He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770–778, https://doi.org/10.1109/CVPR.2016.90 (2016).
Girshick, R., Donahue, J., Darrell, T. & Malik, J. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, 580-587, https://doi.org/10.1109/CVPR.2014.81 (2014).
Girshick, R. Fast R-CNN. In 2015 IEEE International Conference on Computer Vision (ICCV), 1440–1448, https://doi.org/10.1109/ICCV.2015.169 (2015).
Ren, S., He, K., Girshick, R. & Sun, J. Faster r-cnn: Towards real-time object detection with region proposal networks. In Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 1, 91–99, https://doi.org/10.5555/2969239.2969250 (2015).
He, K., Gkioxari, G., Dollár, P. & Girshick, R. Mask R-CNN. In 2017 IEEE International Conference on Computer Vision (ICCV), 2980–2988, https://doi.org/10.1109/ICCV.2017.322 (2017).
Redmon, J., Divvala, S., Girshick, R. & Farhadi, A. You Only Look Once: Unified, real-time object detection. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 779–788, https://doi.org/10.1109/CVPR.2016.91 (2016).
Wang, C.-Y., Bochkovskiy, A. & Liao, H.-Y. M. Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors, https://doi.org/10.48550/ARXIV.2207.02696 (2022).
Terven, J. & Cordova-Esparza, D. A comprehensive review of yolo: From yolov1 and beyond (2023). arXiv:2304.00501 .
Wang, C.-Y., Yeh, I.-H. & Liao, H.-Y. M. Yolov9: Learning what you want to learn using programmable gradient information (2024). arXiv:2402.13616 .
Jacobs, R. Deep learning object detection in materials science: Current state and future directions. Comput. Mater. Sci. 211, 111527. https://doi.org/10.1016/j.commatsci.2022.111527 (2022).
doi: 10.1016/j.commatsci.2022.111527
Ziatdinov, M. A. et al. Deep learning of atomically resolved scanning transmission electron microscopy images: Chemical identification and tracking local transformations. ACS Nano 11(12), 12742–12752. https://doi.org/10.1021/acsnano.7b07504 (2017).
doi: 10.1021/acsnano.7b07504
pubmed: 29215876
Kim, H., Inoue, J. & Kasuya, T. Unsupervised microstructure segmentation by mimicking metallurgists’ approach to pattern recognition. Sci. Rep. 10, 17835. https://doi.org/10.1038/s41598-020-74935-8 (2020).
doi: 10.1038/s41598-020-74935-8
pubmed: 33082434
pmcid: 7575545
Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 234–241 (Springer International Publishing, 2015). https://doi.org/10.1007/978-3-319-24574-4_28 .
doi: 10.1007/978-3-319-24574-4_28
Anderson, C. M., Klein, J., Rajakumar, H., Judge, C. D. & Béland, L. K. Automated detection of helium bubbles in irradiated X-750. Ultramicroscopy 217, 113068. https://doi.org/10.1016/j.ultramic.2020.113068 (2020).
doi: 10.1016/j.ultramic.2020.113068
pubmed: 32688232
Shen, M. et al. Multi defect detection and analysis of electron microscopy images with deep learning. Comput. Mater. Sci. 199, 110576. https://doi.org/10.1016/j.commatsci.2021.110576 (2021).
doi: 10.1016/j.commatsci.2021.110576
Jacobs, R. et al. Performance and limitations of deep learning semantic segmentation of multiple defects in transmission electron micrographs. Cell Rep. Phys. Sci. 3, 100876. https://doi.org/10.1016/j.xcrp.2022.100876 (2022).
doi: 10.1016/j.xcrp.2022.100876
Jacobs, R. et al. Materials swelling revealed through automated semantic segmentation of cavities in electron microscopy images. Sci. Rep. 13, 5178. https://doi.org/10.1038/s41598-023-32454-2 (2023).
doi: 10.1038/s41598-023-32454-2
pubmed: 36997628
pmcid: 10063681
Wei, J., Blaiszik, B., Scourtas, A., Morgan, D. & Voyles, P. M. Benchmark tests of atom segmentation deep learning models with a consistent dataset. Microsc. Microanal. 29, 552–562. https://doi.org/10.1093/micmic/ozac043 (2022).
doi: 10.1093/micmic/ozac043
Traversier, M. et al. Nitrogen-induced hardening in an austenitic crfemnni high-entropy alloy (HEA). Mater. Sci. Eng., A 804, 140725. https://doi.org/10.1016/j.msea.2020.140725 (2021).
doi: 10.1016/j.msea.2020.140725
Kumar, N. K., Li, C., Leonard, K., Bei, H. & Zinkle, S. Microstructural stability and mechanical behavior of FeNiMnCr high entropy alloy under ion irradiation. Acta Mater. 113, 230–244. https://doi.org/10.1016/j.actamat.2016.05.007 (2016).
doi: 10.1016/j.actamat.2016.05.007
Kamboj, A. & Marquis, E. Effect of dose rate on the phase stability of a CrFeNiMn alloy. Scripta Mater. 215, 114697. https://doi.org/10.1016/j.scriptamat.2022.114697 (2022).
doi: 10.1016/j.scriptamat.2022.114697
Li, C. et al. Neutron irradiation response of a co-free high entropy alloy. J. Nuclear Mater. 527, 151838 (2022).
doi: 10.1016/j.jnucmat.2019.151838
Otto, F. et al. The influences of temperature and microstructure on the tensile properties of a CoCrFeMnNi high-entropy alloy. Acta Mater. 61, 5743–5755. https://doi.org/10.1016/j.actamat.2013.06.018 (2013).
doi: 10.1016/j.actamat.2013.06.018
George, E. P., Raabe, D. & Ritchie, R. O. High-entropy alloys. Nat. Rev. Mater. 4, 515–534. https://doi.org/10.1038/s41578-019-0121-4 (2019).
doi: 10.1038/s41578-019-0121-4
Pickering, E. J. et al. High-entropy alloys for advanced nuclear applications. Entropy 23, 98. https://doi.org/10.3390/e23010098 (2021).
doi: 10.3390/e23010098
pubmed: 33440904
pmcid: 7827623
Jin, K. et al. Effects of compositional complexity on the ion-irradiation induced swelling and hardening in ni-containing equiatomic alloys. Scripta Mater. 119, 65–70. https://doi.org/10.1016/j.scriptamat.2016.03.030 (2016).
doi: 10.1016/j.scriptamat.2016.03.030
Lu, C. et al. Enhancing radiation tolerance by controlling defect mobility and migration pathways in multicomponent single-phase alloys. Nat. Commun. 7, 13564. https://doi.org/10.1038/ncomms13564 (2016).
doi: 10.1038/ncomms13564
pubmed: 27976669
pmcid: 5171798
Wu, Y., Kirillov, A., Massa, F., Lo, W.-Y. & Girshick, R. Detectron2. https://github.com/facebookresearch/detectron2 (2019).
Jäger, W., Rühle, M. & Wilkens, M. Elastic interaction of a dislocation loop with a traction-free surface. Phys. Status Solidi A 31, 525–533. https://doi.org/10.1002/pssa.2210310224 (1975).
doi: 10.1002/pssa.2210310224
Ma, K. et al. Free surface impact on radiation damage in pure nickel by in-situ self-ion irradiation: Can it be avoided?. Acta Mater. 212, 116874. https://doi.org/10.1016/j.actamat.2021.116874 (2021).
doi: 10.1016/j.actamat.2021.116874
Bonafos, C., Mathiot, D. & Claverie, A. Ostwald ripening of end-of-range defects in silicon. J. Appl. Phys. 83, 3008–3017. https://doi.org/10.1063/1.367056 (1998).
doi: 10.1063/1.367056
Moll, S., Jourdan, T. & Lefaix-Jeuland, H. Direct observation of interstitial dislocation loop coarsening in α- iron. Phys. Rev. Lett. 11, 015503. https://doi.org/10.1103/PhysRevLett.111.015503 (2013).
doi: 10.1103/PhysRevLett.111.015503
Congyi, L. et al. First principle study of magnetism and vacancy energetics in a near equimolar nifemncr high entropy alloy. J. Appl. Phys. 125, 155103. https://doi.org/10.1063/1.5086172 (2019).
doi: 10.1063/1.5086172
Gentils, A. & Cabet, C. Investigating radiation damage in nuclear energy materials using jannus multiple ion beams. Nucl. Instrum. Methods Phys. Res. Sect. B 447, 107–112. https://doi.org/10.1016/j.nimb.2019.03.039 (2019).
doi: 10.1016/j.nimb.2019.03.039
Crocombette, J.-P. & Wambeke, C. V. Quick calculation of damage for ion irradiation: Implementation in Iradina and comparisons to SRIM. EPJ Nuclear Sci. Technol. 5, 7. https://doi.org/10.1051/epjn/2019003 (2019).
doi: 10.1051/epjn/2019003
Borschel, C. & Ronning, C. Ion beam irradiation of nanostructures - a 3D Monte Carlo simulation code. Nucl. Instrum. Methods Phys. Res. Sect. B 269, 2133–2138. https://doi.org/10.1016/j.nimb.2011.07.004 (2011).
doi: 10.1016/j.nimb.2011.07.004
Xiu, P., Bei, H., Zhang, Y., Wang, L. & Field, K. G. Stem characterization of dislocation loops in irradiated fcc alloys. J. Nucl. Mater. 544, 152658. https://doi.org/10.1016/j.jnucmat.2020.152658 (2020).
doi: 10.1016/j.jnucmat.2020.152658
Bruno, G., Lynch, M. J., Jacobs, R., Morgan, D. D. & Field, K. G. Evaluation of human-bias in labeling of ambiguous features in electron microscopy machine learning models. Microsc. Microanal. 29, 1493–1494. https://doi.org/10.1093/micmic/ozad067.767 (2023).
doi: 10.1093/micmic/ozad067.767
pubmed: 37613766