High-speed 4-dimensional scanning transmission electron microscopy using compressive sensing techniques.
4‐D STEM
compressive sensing
ptychography
Journal
Journal of microscopy
ISSN: 1365-2818
Titre abrégé: J Microsc
Pays: England
ID NLM: 0204522
Informations de publication
Date de publication:
06 May 2024
06 May 2024
Historique:
revised:
28
03
2024
received:
12
01
2024
accepted:
22
04
2024
medline:
7
5
2024
pubmed:
7
5
2024
entrez:
7
5
2024
Statut:
aheadofprint
Résumé
Here we show that compressive sensing allows 4-dimensional (4-D) STEM data to be obtained and accurately reconstructed with both high-speed and reduced electron fluence. The methodology needed to achieve these results compared to conventional 4-D approaches requires only that a random subset of probe locations is acquired from the typical regular scanning grid, which immediately generates both higher speed and the lower fluence experimentally. We also consider downsampling of the detector, showing that oversampling is inherent within convergent beam electron diffraction (CBED) patterns and that detector downsampling does not reduce precision but allows faster experimental data acquisition. Analysis of an experimental atomic resolution yttrium silicide dataset shows that it is possible to recover over 25 dB peak signal-to-noise ratio in the recovered phase using 0.3% of the total data. Lay abstract: Four-dimensional scanning transmission electron microscopy (4-D STEM) is a powerful technique for characterizing complex nanoscale structures. In this method, a convergent beam electron diffraction pattern (CBED) is acquired at each probe location during the scan of the sample. This means that a 2-dimensional signal is acquired at each 2-D probe location, equating to a 4-D dataset. Despite the recent development of fast direct electron detectors, some capable of 100kHz frame rates, the limiting factor for 4-D STEM is acquisition times in the majority of cases, where cameras will typically operate on the order of 2kHz. This means that a raster scan containing 256^2 probe locations can take on the order of 30s, approximately 100-1000 times longer than a conventional STEM imaging technique using monolithic radial detectors. As a result, 4-D STEM acquisitions can be subject to adverse effects such as drift, beam damage, and sample contamination. Recent advances in computational imaging techniques for STEM have allowed for faster acquisition speeds by way of acquiring only a random subset of probe locations from the field of view. By doing this, the acquisition time is significantly reduced, in some cases by a factor of 10-100 times. The acquired data is then processed to fill-in or inpaint the missing data, taking advantage of the inherently low-complex signals which can be linearly combined to recover the information. In this work, similar methods are demonstrated for the acquisition of 4-D STEM data, where only a random subset of CBED patterns are acquired over the raster scan. We simulate the compressive sensing acquisition method for 4-D STEM and present our findings for a variety of analysis techniques such as ptychography and differential phase contrast. Our results show that acquisition times can be significantly reduced on the order of 100-300 times, therefore improving existing frame rates, as well as further reducing the electron fluence beyond just using a faster camera.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Subventions
Organisme : Engineering and Physical Sciences Research Council
ID : EP/S023445/1
Organisme : U.S. Department of Energy
ID : FWP#ERKCZ55
Informations de copyright
© 2024 The Authors. Journal of Microscopy published by John Wiley & Sons Ltd on behalf of Royal Microscopical Society.
Références
Ophus, C. (2019). Four‐dimensional scanning transmission electron microscopy (4D‐STEM): From scanning nanodiffraction to ptychography and beyond. Microscopy and Microanalysis, 25(3), 563–582.
Nellist, P., McCallum, B., & Rodenburg, J. M. (1995). Resolution beyond the information limit in transmission electron microscopy. Nature, 374(6523), 630–632.
Zaluzec, N. J. (2001). Lorentz STEM: A digital approach to an old technique. Microscopy and Microanalysis, 7(S2), 222–223.
Zaluzec, N. J. (2002). Quantitative measurements of magnetic vortices using position resolved diffraction in Lorentz STEM. Microscopy and Microanalysis, 8(S02), 376–377.
Lozano, J. G., Martinez, G. T., Jin, L., Nellist, P. D., & Bruce, P. G. (2018). Low‐dose aberration‐free imaging of Li‐rich cathode materials at various states of charge using electron ptychography. Nano letters, 18(11), 6850–6855.
Zhou, L., Song, J., Kim, J., Pei, X., Huang, C., Boyce, M., Mendonça, L., Clare, D., Siebert, A., Allen, C., Liberti, E., Stuart, D., Pan, X., Nellist, P., Zhang, P., Kirkland, A., & Wang, P. (2020). Low‐dose phase retrieval of biological specimens using cryo‐electron ptychography. Nature Communications, 11(1), 1–9.
Chen, Z., Jiang, Y., Shao, Y. T., Holtz, M. E., Odstrčil, M., Guizar‐Sicairos, M., Hanke, I., Ganschow, S., Schlom, D. G., & Muller, D. A. (2021). Electron ptychography achieves atomic‐resolution limits set by lattice vibrations. Science, 372(6544), 826–831.
Shibata, N., Findlay, S. D., Kohno, Y., Sawada, H., Kondo, Y., & Ikuhara, Y. (2012). Differential phase‐contrast microscopy at atomic resolution. Nature Physics, 8(8), 611–615.
Müller‐Caspary, K., Krause, F. F., Grieb, T., Löffler, S., Schowalter, M., Béché, A., Galioit, V., Marquardt, D., Zweck, J., Schattschneider, P., Verbeeck, J., & Rosenauer, A. (2017). Measurement of atomic electric fields and charge densities from average momentum transfers using scanning transmission electron microscopy. Ultramicroscopy, 178, 62–80.
Hoppe, W. (1969). Beugung im inhomogenen Primärstrahlwellenfeld. III. Amplituden‐und Phasenbestimmung bei unperiodischen Objekten. Acta Crystallographica Section A: Crystal Physics, Diffraction, Theoretical and General Crystallography, 25(4), 508–514.
Hoppe, W., & Strube, G. (1969). Beugung in inhomogenen Primärstrahlenwellenfeld. II. Lichtoptische analogieversuche zur Phasenmessung von gitterinterferenzen. Acta Crystallographica Section A: Crystal Physics, Diffraction, Theoretical and General Crystallography, 25(4), 502–507.
Hegerl, R., & Hoppe, W. (1970). Dynamische theorie der kristallstrukturanalyse durch elektronenbeugung im inhomogenen primärstrahlwellenfeld. Berichte der Bunsengesellschaft für physikalische Chemie, 74(11), 1148–1154.
Hoppe, W. (1982). Trace structure analysis, ptychography, phase tomography. Ultramicroscopy, 10(3), 187–198.
Yang, H., Rutte, R., Jones, L., Simson, M., Sagawa, R., Ryll, H., Huth, M., Pennycook, T., Green, M., Soltau, H., Kondo, Y., Davis, B., & Nellist, P. (2016). Simultaneous atomic‐resolution electron ptychography and Z‐contrast imaging of light and heavy elements in complex nanostructures. Nature Communications, 7(1), 1–8.
Faruqi, A., Henderson, R., Pryddetch, M., Allport, P., & Evans, A. (2005). Direct single electron detection with a CMOS detector for electron microscopy. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 546(1–2), 170–175.
Ryll, H., Simson, M., Hartmann, R., Holl, P., Huth, M., Ihle, S., Kondo, Y., Kotula, P., Liebel, A., Müller‐Caspary, K., Rosenauer, A., Sagawa, R., Schmidt, J., Soltau, H., & Strüder, L. (2016). A pnCCD‐based, fast direct single electron imaging camera for TEM and STEM. Journal of Instrumentation, 11(04), P04006.
Faruqi, A., & McMullan, G. (2018). Direct imaging detectors for electron microscopy. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 878, 180–190.
Ciston, J., Johnson, I. J., Draney, B. R., Ercius, P., Fong, E., Goldschmidt, A., Joseph, J. M., Lee, J. R., Mueller, A., Ophus, C., Selvarajan, A., Skinner, D. E., Stezelberger, T., Tindall, C. S., Minor, A. M., & Denes, P. (2019). The 4D camera: Very high speed electron counting for 4D‐STEM. Microscopy and Microanalysis, 25(S2), 1930–1931.
Philipp, H. T., Tate, M. W., Shanks, K. S., Mele, L., Peemen, M., Dona, P., Hartong, R., van Veen, G., Shao, Y. T., Chen, Z., Thom‐Levy, J., Muller, D. A., & Gruner, S. M. (2022). Very‐high dynamic range, 10,000 frames/second pixel array detector for electron microscopy. Microscopy and Microanalysis, 28(2), 425–440.
MacLaren, I., Macgregor, T. A., Allen, C. S., & Kirkland, A. I. (2020). Detectors – the ongoing revolution in scanning transmission electron microscopy and why this important to material characterization. APL Materials, 8(11), 110901.
Faruqi, A., & Henderson, R. (2007). Electronic detectors for electron microscopy. Current Opinion in Structural Biology, 17(5), 549–555.
Egerton, R. (2021). Radiation damage and nanofabrication in TEM and STEM. Microscopy Today, 29(3), 56–59.
Bustillo, K. C., Zeltmann, S. E., Chen, M., Donohue, J., Ciston, J., Ophus, C., & Minor, A. M. (2021). 4D‐STEM of beam‐sensitive materials. Accounts of Chemical Research, 54(11), 2543–2551.
Li, G., Zhang, H., & Han, Y. (2022). 4D‐STEM ptychography for electron‐beam‐sensitive materials. ACS Central Science, 8, 1579–1588.
Egerton, R. (2021). Dose measurement in the TEM and STEM. Ultramicroscopy, 229, 113363.
Yang, H., Jones, L., Ryll, H., Simson, M., Soltau, H., Kondo, Y., Sagawa, R., Banba, H., MacLaren, I., & Nellist, P. (2015). 4D STEM: High efficiency phase contrast imaging using a fast pixelated detector. Journal of Physics: Conference Series, 644, 012032.
O'Leary, C., Allen, C., Huang, C., Kim, J., Liberti, E., Nellist, P., & Kirkland, A. (2020). Phase reconstruction using fast binary 4D STEM data. Applied Physics Letters, 116(12), 124101.
Pennycook, T. J., Martinez, G. T., Nellist, P. D., & Meyer, J. C. (2019). High dose efficiency atomic resolution imaging via electron ptychography. Ultramicroscopy, 196, 131–135.
Donoho, D. L. (2006). Compressed sensing. IEEE Transactions on Information Theory, 52(4), 1289–1306.
Candès, E. J., Romberg, J., & Tao, T. (2006). Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on Information Theory, 52(2), 489–509.
Binev, P., Dahmen, W., DeVore, R., Lamby, P., Savu, D., & Sharpley, R. (2012). Compressed sensing and electron microscopy. In T. Vogt, W. Dahmen, & P. Binev (Eds.), Modelling nanoscale imaging in electron microscopy (pp. 73–126). Springer.
Anderson, H. S., Ilic‐Helms, J., Rohrer, B., Wheeler, J., & Larson, K. (2013). Sparse imaging for fast electron microscopy. Computational Imaging XI, 8657, 94–105.
Stevens, A., Yang, H., Carin, L., Arslan, I., & Browning, N. D. (2014). The potential for Bayesian compressive sensing to significantly reduce electron dose in high‐resolution STEM images. Microscopy, 63(1), 41–51.
Stevens, A., Yang, H., Hao, W., Jones, L., Ophus, C., Nellist, P. D., & Browning, N. D. (2018). Subsampled STEM‐ptychography. Applied Physics Letters, 113(3), 033104.
Nicholls, D., Lee, J., Amari, H., Stevens, A. J., Mehdi, B. L., & Browning, N. D. (2020). Minimising damage in high resolution scanning transmission electron microscope images of nanoscale structures and processes. Nanoscale, 12(41), 21248–21254.
Mehdi, B. L., Stevens, A., Kovarik, L., Jiang, N., Mehta, H., Liyu, A., Reehl, S., Stanfill, B., Luzi, L., Hao, W., Bramer, L., & Browning, N. D. (2019). Controlling the spatio‐temporal dose distribution during STEM imaging by subsampled acquisition: In‐situ observations of kinetic processes in liquids. Applied Physics Letters, 115(6), 063102.
Nicholls, D., Wells, J., Stevens, A., Zheng, Y., Castagna, J., & Browning, N. D. (2021). Sub‐sampled imaging for STEM: Maximising image speed, resolution and precision through reconstruction parameter refinement. Ultramicroscopy, 233, 113451.
Nicholls, D., Robinson, A., Wells, J., Moshtaghpour, A., Bahri, M., Kirkland, A., & Browning, N. (2022). Compressive scanning transmission electron microscopy. In Proceedings of the IEEE International Conference on Acoustics (pp. 1586–1590). Speech and Signal Processing (ICASSP).
Nicholls, D., Wells, J., Robinson, A. W., Moshtaghpour, A., Kobylynska, M., Fleck, R. A., Kirkland, A. I., & Browning, N. D. (2022). A targeted sampling strategy for compressive cryo focused ion beam scanning electron microscopy. arXiv preprint arXiv:2211.03494.
Robinson, A., Nicholls, D., Wells, J., Moshtaghpour, A., Kirkland, A., & Browning, N. D. (2022). SIM‐STEM Lab: Incorporating compressed sensing theory for fast STEM simulation. Ultramicroscopy, 242, 113625.
Robinson, A. W., Nicholls, D., Wells, J., Moshtaghpour, A., Kirkland, A. I., & Browning, N. D. (2022). Compressed STEM simulations. Microscopy and Microanalysis, 28(S1), 3116–3117.
Robinson, A. W., Wells, J., Nicholls, D., Moshtaghpour, A., Chi, M., Kirkland, A. I., & Browning, N. D. (2023). Towards real‐time STEM simulations through targeted subsampling strategies. Journal of microscopy, 290(1), 53–66.
Stevens, A., Pu, Y., Sun, Y., Spell, G., & Carin, L. (2017). Tensor‐dictionary learning with deep kruskal‐factor analysis. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, (pp. 121–129). PMLR.
Zhang, X., Chen, Z., & Muller, D. (2021). How many detector pixels do we need for super‐resolution ptychography? Microscopy and Microanalysis, 27(S1), 620–622.
Ni, H. C., Yuan, R., Zhang, J., & Zuo, J. M. (2024). Framework of compressive sensing and data compression for 4d‐stem. Ultramicroscopy, 259, 113938.
Wang, L., Feng, Y., Gao, Y., Wang, Z., & He, M. (2018). Compressed sensing reconstruction of hyperspectral images based on spectral unmixing. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11(4), 1266–1284.
Paisley, J., & Carin, L. (2009). Nonparametric factor analysis with beta process priors. In Proceedings of the 26th Annual International Conference on Machine Learning (pp. 777–784), Montreal, Quebec, Canada.
Zheng, Q., Feng, T., Hachtel, J. A., Ishikawa, R., Cheng, Y., Daemen, L., Xing, J., Idrobo, J. C., Yan, J., Shibata, N., Ikuhara, Y., Sales, B. C., Pantelides, S. T., & Chi, M. (2021). Direct visualization of anionic electrons in an electride reveals inhomogeneities. Science Advances, 7(15), eabe6819.
Isogai, T., Tanaka, H., Goto, T., Teramoto, A., Sugawa, S., & Ohmi, T. (2008). Formation and property of yttrium and yttrium silicide films as low Schottcky barrier material for n‐type silicon. Japanese Journal of Applied Physics, 47(4S), 3138.
Okunishi, E., Sawada, H., & Kondo, Y. (2012). Experimental study of annular bright field (ABF) imaging using aberration‐corrected scanning transmission electron microscopy (STEM). Micron, 43(4), 538–544.
Rodenburg, J. M., & Faulkner, H. M. (2004). A phase retrieval algorithm for shifting illumination. Applied Physics Letters, 85(20), 4795–4797.
Maiden, A. M., & Rodenburg, J. M. (2009). An improved ptychographical phase retrieval algorithm for diffractive imaging. Ultramicroscopy, 109(10), 1256–1262.
Maiden, A., Humphry, M., Sarahan, M., Kraus, B., & Rodenburg, J. (2012). An annealing algorithm to correct positioning errors in ptychography. Ultramicroscopy, 120, 64–72.
Maiden, A. M., Humphry, M. J., & Rodenburg, J. M. (2012). Ptychographic transmission microscopy in three dimensions using a multi‐slice approach. JOSA A, 29(8), 1606–1614.
Elser, V. (2003). Phase retrieval by iterated projections. JOSA A, 20(1), 40–55.
D'alfonso, A., Morgan, A., Yan, A., Wang, P., Sawada, H., Kirkland, A., & Allen, L. (2014). Deterministic electron ptychography at atomic resolution. Physical Review B, 89(6), 064101.
Bates, R., & Rodenburg, J. (1989). Sub‐ångström transmission microscopy: A Fourier transform algorithm for microdiffraction plane intensity information. Ultramicroscopy, 31(3), 303–307.
Rodenburg, J., & Bates, R. (1992). The theory of super‐resolution electron microscopy via Wigner‐distribution deconvolution. Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences, 339(1655), 521–553.
Yang, H., MacLaren, I., Jones, L., Martinez, G. T., Simson, M., Huth, M., Ryll, H., Soltau, H., Sagawa, R., Kondo, Y., Ophus, C., Ercius, P., Jin, L., Kovács, A., & Nellist, P. D. (2017). Electron ptychographic phase imaging of light elements in crystalline materials using Wigner distribution deconvolution. Ultramicroscopy, 180, 173–179.
Martinez, G., Humphry, M., & Nellist, P. (2017). A comparison of phase‐retrieval algorithms for focused‐probe electron ptychography. Microscopy and Microanalysis, 23(S1), 476–477.
O'Leary, C. M., Martinez, G. T., Liberti, E., Humphry, M. J., Kirkland, A. I., & Nellist, P. D. (2021). Contrast transfer and noise considerations in focused‐probe electron ptychography. Ultramicroscopy, 221, 113189.
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612.
SenseAI Innovations. Introduction to 4D‐STEM Survey Mode. YouTube. [Online]. Available at: https://youtu.be/RDCkd1clk4?feature=shared