Depth-enhanced high-throughput microscopy by compact PSF engineering.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
07 Jun 2024
07 Jun 2024
Historique:
received:
24
05
2023
accepted:
03
05
2024
medline:
8
6
2024
pubmed:
8
6
2024
entrez:
7
6
2024
Statut:
epublish
Résumé
High-throughput microscopy is vital for screening applications, where three-dimensional (3D) cellular models play a key role. However, due to defocus susceptibility, current 3D high-throughput microscopes require axial scanning, which lowers throughput and increases photobleaching and photodamage. Point spread function (PSF) engineering is an optical method that enables various 3D imaging capabilities, yet it has not been implemented in high-throughput microscopy due to the cumbersome optical extension it typically requires. Here we demonstrate compact PSF engineering in the objective lens, which allows us to enhance the imaging depth of field and, combined with deep learning, recover 3D information using single snapshots. Beyond the applications shown here, this work showcases the usefulness of high-throughput microscopy in obtaining training data for deep learning-based algorithms, applicable to a variety of microscopy modalities.
Identifiants
pubmed: 38849376
doi: 10.1038/s41467-024-48502-y
pii: 10.1038/s41467-024-48502-y
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
4861Subventions
Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 802567
Organisme : Israel Science Foundation (ISF)
ID : 450/18
Informations de copyright
© 2024. The Author(s).
Références
Li, Y. & Kumacheva, E. Hydrogel microenvironments for cancer spheroid growth and drug screening. Sci. Adv. 4, eaas8998 (2018).
pubmed: 29719868
pmcid: 5922799
doi: 10.1126/sciadv.aas8998
Bickle, M. The beautiful cell: high-content screening in drug discovery. Anal. Bioanal. Chem. 398, 219–226 (2010).
pubmed: 20577725
doi: 10.1007/s00216-010-3788-3
Zhou, X. & Wong, S. T. C. Informatics challenges of high-throughput microscopy. IEEE Signal Process. Mag. 23, 63–72 (2006).
doi: 10.1109/MSP.2006.1628879
Hanson, K. M. & Finkelstein, J. N. An accessible and high-throughput strategy of continuously monitoring apoptosis by fluorescent detection of caspase activation. Anal. Biochem. 564–565, 96–101 (2019).
pubmed: 30365977
doi: 10.1016/j.ab.2018.10.022
Pegoraro, G. & Misteli, T. High-throughput imaging for the discovery of cellular mechanisms of disease. Trends Genet. 33, 604–615 (2017).
pubmed: 28732598
pmcid: 5562530
doi: 10.1016/j.tig.2017.06.005
Murphy, D. A., Cheng, H., Yang, T., Yan, X. & Adjei, I. M. Reversing hypoxia with PLGA-encapsulated manganese dioxide nanoparticles improves natural killer cell response to tumor spheroids. Mol. Pharm. 18, 2935–2946 (2021).
pubmed: 34191525
doi: 10.1021/acs.molpharmaceut.1c00085
Åkerfelt, M. et al. Automated tracking of tumor-stroma morphology in microtissues identifies functional targets within the tumor microenvironment for therapeutic intervention. Oncotarget 6, 30035–30056 (2015).
pubmed: 26375443
pmcid: 4745780
doi: 10.18632/oncotarget.5046
Zanoni, M., Pignatta, S., Arienti, C., Bonafè, M. & Tesei, A. Anticancer drug discovery using multicellular tumor spheroid models. Expert Opin. Drug Discov. 14, 289–301 (2019).
pubmed: 30689452
doi: 10.1080/17460441.2019.1570129
Desmaison, A. et al. Impact of physical confinement on nuclei geometry and cell division dynamics in 3D spheroids. Sci. Rep. 8, 8785 (2018).
pubmed: 29884887
pmcid: 5993719
doi: 10.1038/s41598-018-27060-6
Beghin, A. et al. Automated high-speed 3D imaging of organoid cultures with multi-scale phenotypic quantification. Nat. Methods 19, 881–892 (2022).
pubmed: 35697835
doi: 10.1038/s41592-022-01508-0
Zhu, T. et al. Large-scale high-throughput 3D culture, imaging, and analysis of cell spheroids using microchip-enhanced light-sheet microscopy. Biomed. Opt. Express 14, 1659 (2023).
pubmed: 37078040
pmcid: 10110308
doi: 10.1364/BOE.485217
Alonso, J. R., Silva, A., Fernández, A. & Arocena, M. Computational multifocus fluorescence microscopy for three-dimensional visualization of multicellular tumor spheroids. J. Biomed. Opt. 27, 066501 (2022).
pubmed: 35655357
pmcid: 9162503
doi: 10.1117/1.JBO.27.6.066501
Greengard, A., Schechner, Y. Y. & Piestun, R. Depth from diffracted rotation. Opt. Lett. 31, 181 (2006).
pubmed: 16441023
doi: 10.1364/OL.31.000181
Huang, B., Wang, W., Bates, M. & Zhuang, X. Three-dimensional super-resolution imaging by stochastic optical reconstruction microscopy. Science (1979) 319, 810–813 (2008).
Shechtman, Y., Sahl, S. J., Backer, A. S. & Moerner, W. E. Optimal point spread function design for 3D imaging. Phys. Rev. Lett. 113, 133902 (2014).
pubmed: 25302889
pmcid: 4381866
doi: 10.1103/PhysRevLett.113.133902
Pavani, S. R. P. et al. Three-dimensional single-molecule fluorescence imaging beyond the diffraction limit by using a double-helix point spread function. Proc. Natl. Acad. Sci. 106, 2995–2999 (2009).
Weiss, L. E. et al. Three-dimensional localization microscopy in live flowing cells. Nat. Nanotechnol. 15, 500–506 (2020).
pubmed: 32313220
doi: 10.1038/s41565-020-0662-0
Nehme, E. et al. DeepSTORM3D: dense 3D localization microscopy and PSF design by deep learning. Nat. Methods 17, 734–740 (2020).
pubmed: 32541853
pmcid: 7610486
doi: 10.1038/s41592-020-0853-5
Opatovski, N. et al. Multiplexed PSF engineering for three-dimensional multicolor particle tracking. Nano Lett. 21, 5888–5895 (2021).
pubmed: 34213332
doi: 10.1021/acs.nanolett.1c02068
Shechtman, Y., Weiss, L. E., Backer, A. S., Lee, M. Y. & Moerner, W. E. Multicolour localization microscopy by point-spread-function engineering. Nat. Photonics 10, 590–594 (2016).
pubmed: 28413434
pmcid: 5391844
doi: 10.1038/nphoton.2016.137
Hershko, E., Weiss, L. E., Michaeli, T. & Shechtman, Y. Multicolor localization microscopy and point-spread-function engineering by deep learning. Opt. Express https://doi.org/10.1364/oe.27.006158 (2019).
Ben-Eliezer, E., Marom, E., Konforti, N. & Zalevsky, Z. Experimental realization of an imaging system with an extended depth of field. Appl. Opt. 44, 2792 (2005).
pubmed: 15943331
doi: 10.1364/AO.44.002792
Nehme, E. et al. Learning optimal wavefront shaping for multi-channel imaging. IEEE Trans. Pattern Anal. Mach. Intell. 43, 2179–2192 (2021).
pubmed: 34029185
doi: 10.1109/TPAMI.2021.3076873
Chen, B. et al. Extended depth of focus multiphoton microscopy via incoherent pulse splitting. Biomed. Opt. Express 11, 3830 (2020).
pubmed: 33014569
pmcid: 7510929
doi: 10.1364/BOE.393931
Backer, A. S. & Moerner, W. E. Extending single-molecule microscopy using optical Fourier processing. J. Phys. Chem. B 118, 8313–8329 (2014).
pubmed: 24745862
pmcid: 4317050
doi: 10.1021/jp501778z
Abrahamsson, S., Usawa, S. & Gustafsson, M. A new approach to extended focus for high-speed high-resolution biological microscopy. In: Proc. SPIE 6090, Three-Dimensional and Multidimensional Microscopy: Image Acquisition and Processing XIII, 60900N (eds Conchello, J.-A. et al.) (2006).
Rieu, M. et al. Parallel, linear, and subnanometric 3D tracking of microparticles with stereo darkfield interferometry. Sci. Adv. 7, eabe3902 (2021).
pubmed: 33547081
pmcid: 7864575
doi: 10.1126/sciadv.abe3902
Liu, C., Lewin Mejia, D., Chiang, B., Luker, K. E. & Luker, G. D. Hybrid collagen alginate hydrogel as a platform for 3D tumor spheroid invasion. Acta Biomater. 75, 213–225 (2018).
pubmed: 29879553
pmcid: 6119473
doi: 10.1016/j.actbio.2018.06.003
Cao, R. et al. Optical-resolution photoacoustic microscopy with a needle-shaped beam. Nat. Photonics 17, 89–95 (2023).
pubmed: 38149029
doi: 10.1038/s41566-022-01112-w
Ferdman, B. et al. VIPR: vectorial implementation of phase retrieval for fast and accurate microscopic pixel-wise pupil estimation. Opt. Express 28, 10179 (2020).
pubmed: 32225609
doi: 10.1364/OE.388248
Ovesný, M., Křížek, P., Borkovec, J., Švindrych, Z. & Hagen, G. M. ThunderSTORM: a comprehensive ImageJ plug-in for PALM and STORM data analysis and super-resolution imaging. Bioinformatics 30, 2389–2390 (2014).
pubmed: 24771516
pmcid: 4207427
doi: 10.1093/bioinformatics/btu202
Richardson, W. H. Bayesian-based iterative method of image restoration*. J. Opt. Soc. Am. 62, 55 (1972).
doi: 10.1364/JOSA.62.000055
Lucy, L. B. An iterative technique for the rectification of observed distributions. Astron J. 79, 745 (1974).
doi: 10.1086/111605
Antipa, N. et al. DiffuserCam: lensless single-exposure 3D imaging. Optica 5, 1 (2018).
doi: 10.1364/OPTICA.5.000001
Skocek, O. et al. High-speed volumetric imaging of neuronal activity in freely moving rodents. Nat. Methods 15, 429–432 (2018).
pubmed: 29736000
pmcid: 7990085
doi: 10.1038/s41592-018-0008-0
Yanny, K. et al. Miniscope3D: optimized single-shot miniature 3D fluorescence microscopy. Light Sci. Appl. 9, 171 (2020).
pubmed: 33082940
pmcid: 7532148
doi: 10.1038/s41377-020-00403-7
Lu, Z. et al. Phase-space deconvolution for light field microscopy. Opt. Express 27, 18131 (2019).
pubmed: 31252761
doi: 10.1364/OE.27.018131
Wang, Z. et al. Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning. Nat. Methods 18, 551–556 (2021).
pubmed: 33574612
pmcid: 8107123
doi: 10.1038/s41592-021-01058-x
Weigert, M., Schmidt, U., Haase, R., Sugawara, K. & Myers, G. Star-convex polyhedra for 3D object detection and segmentation in microscopy. In 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) 3655–3662 (IEEE, 2020).
Stringer, C., Wang, T., Michaelos, M. & Pachitariu, M. Cellpose: a generalist algorithm for cellular segmentation. Nat. Methods 18, 100–106 (2021).
pubmed: 33318659
doi: 10.1038/s41592-020-01018-x
Ollion, J., Cochennec, J., Loll, F., Escudé, C. & Boudier, T. TANGO: a generic tool for high-throughput 3D image analysis for studying nuclear organization. Bioinformatics 29, 1840–1841 (2013).
pubmed: 23681123
pmcid: 3702251
doi: 10.1093/bioinformatics/btt276
Natarajan, N., Dhillon, I. S., Ravikumar, P. & Tewari, A. Learning with noisy labels. In Advances in Neural Information Processing Systems 26 (eds Burges, C. J. et al.) (Curran Associates, 2013).
Dragovic, R. A. et al. Sizing and phenotyping of cellular vesicles using nanoparticle tracking analysis. Nanomedicine 7, 780–788 (2011).
pubmed: 21601655
doi: 10.1016/j.nano.2011.04.003
Weigert, M. et al. Content-aware image restoration: pushing the limits of fluorescence microscopy. Nat. Methods 15, 1090–1097 (2018).
pubmed: 30478326
doi: 10.1038/s41592-018-0216-7
Pachitariu, M. & Stringer, C. Cellpose 2.0: how to train your own model. Nat. Methods 19, 1634–1641 (2022).
pubmed: 36344832
pmcid: 9718665
doi: 10.1038/s41592-022-01663-4
Lalit, M., Tomancak, P. & Jug, F. EmbedSeg: embedding-based instance segmentation for biomedical microscopy data. Med. Image Anal. 81, 102523 (2022).
pubmed: 35926335
doi: 10.1016/j.media.2022.102523
Ho, J., Jain, A. & Abbeel, P. Denoising diffusion probabilistic models. In Advances in Neural Information Processing Systems 34 (eds Larochelle, H. et al.) (Curran Associates, 2020).
Yosef, E., Elmalem, S. & Giryes, R. Video reconstruction from a single motion blurred image using learned dynamic phase coding. Sci Rep 13, 13625 (2023).
Oldenbourg, R. Polarized light microscopy: principles and practice. Cold Spring Harb. Protoc. 2013, pdb.top078600 (2013).
pubmed: 24184765
doi: 10.1101/pdb.top078600
Opatovski, N., Nehme, E. et al. Depth-enhanced High-throughput Microscopy by Compact PSF Engineering—Data Repository https://zenodo.org/records/10928122 (2024).
Opatovski, N, Nehme, E. et al. Depth-enhanced High-throughput Microscopy By Compact PSF Engineering—Code Repository https://zenodo.org/records/10938035 (2024).