Deep learning at the edge enables real-time streaming ptychographic imaging.


Journal

Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555

Informations de publication

Date de publication:
03 Nov 2023
Historique:
received: 13 01 2023
accepted: 06 09 2023
medline: 4 11 2023
pubmed: 4 11 2023
entrez: 4 11 2023
Statut: epublish

Résumé

Coherent imaging techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent imaging methods like ptychography are poised to revolutionize nanoscale materials characterization. However, these advancements are accompanied by significant increase in data and compute needs, which precludes real-time imaging, feedback and decision-making capabilities with conventional approaches. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHz. The proposed AI-enabled workflow eliminates the oversampling constraints, allowing low-dose imaging using orders of magnitude less data than required by traditional methods.

Identifiants

pubmed: 37923741
doi: 10.1038/s41467-023-41496-z
pii: 10.1038/s41467-023-41496-z
pmc: PMC10624836
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

7059

Informations de copyright

© 2023. UChicago Argonne, LLC, Operator of Argonne National Laboratory.

Références

Ultramicroscopy. 2009 Sep;109(10):1256-62
pubmed: 19541420
Science. 2021 May 21;372(6544):826-831
pubmed: 34016774
Sci Rep. 2018 Feb 1;8(1):2049
pubmed: 29391564
Rev Sci Instrum. 2019 Aug;90(8):083701
pubmed: 31472643
Nat Mater. 2017 Feb;16(2):244-251
pubmed: 27869823
Patterns (N Y). 2022 Oct 14;3(10):100606
pubmed: 36277824
J Appl Crystallogr. 2021 Feb 19;54(Pt 2):386-401
pubmed: 33953650
Nano Lett. 2018 Feb 14;18(2):811-819
pubmed: 29345956
J Synchrotron Radiat. 2006 Mar;13(Pt 2):120-30
pubmed: 16495612
Proc Natl Acad Sci U S A. 2015 Feb 24;112(8):2314-9
pubmed: 25675478
J Opt Soc Am A Opt Image Sci Vis. 2020 Mar 1;37(3):422-434
pubmed: 32118926
IUCrJ. 2021 Jan 01;8(Pt 1):1-3
pubmed: 33520237
Sci Rep. 2022 Mar 29;12(1):5334
pubmed: 35351971
Phys Rev Lett. 2018 Dec 14;121(24):243902
pubmed: 30608745
Nature. 2010 Sep 23;467(7314):436-9
pubmed: 20864997
Opt Express. 2020 Mar 30;28(7):9603-9630
pubmed: 32225565
J Synchrotron Radiat. 2023 Nov 1;30(Pt 6):1064-1075
pubmed: 37850560
Opt Express. 2020 Jun 8;28(12):17511-17520
pubmed: 32679958
Nature. 2017 Mar 15;543(7645):402-406
pubmed: 28300088
Struct Dyn. 2020 Feb 26;7(1):014305
pubmed: 32128347
Phys Rev Lett. 2023 Jan 6;130(1):016101
pubmed: 36669218
Opt Express. 2018 Oct 1;26(20):26470-26484
pubmed: 30469733
Opt Lett. 2018 Nov 1;43(21):5379-5382
pubmed: 30383012
Nature. 2018 Jul;559(7714):343-349
pubmed: 30022131
IUCrJ. 2021 Dec 10;9(Pt 1):104-113
pubmed: 35059215
IEEE Trans Image Process. 2004 Apr;13(4):600-12
pubmed: 15376593
Microsc Microanal. 2022 Mar 07;:1-16
pubmed: 35249574
Microsc Microanal. 2016 Feb;22(1):237-49
pubmed: 26750260

Auteurs

Anakha V Babu (AV)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.
KLA Corporation, Ann Arbor, MI, USA.

Tao Zhou (T)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Saugat Kandel (S)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Tekin Bicer (T)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Zhengchun Liu (Z)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

William Judge (W)

Department of Chemistry, University of Illinois, Chicago, IL, USA.

Daniel J Ching (DJ)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Yi Jiang (Y)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Sinisa Veseli (S)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Steven Henke (S)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Ryan Chard (R)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Yudong Yao (Y)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Ekaterina Sirazitdinova (E)

NVIDIA Corporation, Santa Clara, CA, USA.

Geetika Gupta (G)

NVIDIA Corporation, Santa Clara, CA, USA.

Martin V Holt (MV)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Ian T Foster (IT)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA.

Antonino Miceli (A)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA. amiceli@anl.gov.

Mathew J Cherukara (MJ)

Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL, USA. mcherukara@anl.gov.

Classifications MeSH