Deep learning pipeline for automated cell profiling from cyclic imaging.


Journal

Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288

Informations de publication

Date de publication:
09 10 2024
Historique:
received: 12 12 2023
accepted: 27 09 2024
medline: 10 10 2024
pubmed: 10 10 2024
entrez: 9 10 2024
Statut: epublish

Résumé

Cyclic fluorescence microscopy enables multiple targets to be detected simultaneously. This, in turn, has deepened our understanding of tissue composition, cell-to-cell interactions, and cell signaling. Unfortunately, analysis of these datasets can be time-prohibitive due to the sheer volume of data. In this paper, we present CycloNET, a computational pipeline tailored for analyzing raw fluorescent images obtained through cyclic immunofluorescence. The automated pipeline pre-processes raw image files, quickly corrects for translation errors between imaging cycles, and leverages a pre-trained neural network to segment individual cells and generate single-cell molecular profiles. We applied CycloNET to a dataset of 22 human samples from head and neck squamous cell carcinoma patients and trained a neural network to segment immune cells. CycloNET efficiently processed a large-scale dataset (17 fields of view per cycle and 13 staining cycles per specimen) in 10 min, delivering insights at the single-cell resolution and facilitating the identification of rare immune cell clusters. We expect that this rapid pipeline will serve as a powerful tool to understand complex biological systems at the cellular level, with the potential to facilitate breakthroughs in areas such as developmental biology, disease pathology, and personalized medicine.

Identifiants

pubmed: 39384907
doi: 10.1038/s41598-024-74597-w
pii: 10.1038/s41598-024-74597-w
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

23600

Subventions

Organisme : NCI NIH HHS
ID : U01CA279858
Pays : United States

Informations de copyright

© 2024. The Author(s).

Références

Zheng, G., Shen, C., Jiang, S., Song, P. & Yang, C. Concept, implementations and applications of Fourier ptychography. Nat. Rev. Phys. 3, 207–223 (2021).
doi: 10.1038/s42254-021-00280-y
Capitanio, A., Dina, R. E. & Treanor, D. Digital cytology: a short review of technical and methodological approaches and applications. Cytopathology. 29, 317–325 (2018).
doi: 10.1111/cyt.12554 pubmed: 29665178
Niazi, M. K. K., Parwani, A. V. & Gurcan, M. N. Digital pathology and artificial intelligence. Lancet Oncol. 20, e253–e261 (2019).
doi: 10.1016/S1470-2045(19)30154-8 pubmed: 31044723 pmcid: 8711251
Black, S. et al. CODEX multiplexed tissue imaging with DNA-conjugated antibodies. Nat. Protoc. 16, 3802–3835 (2021).
doi: 10.1038/s41596-021-00556-8 pubmed: 34215862 pmcid: 8647621
Hickey, J. W. et al. Spatial mapping of protein composition and tissue organization: a primer for multiplexed antibody-based imaging. Nat. Methods. 19, 284–295 (2022).
doi: 10.1038/s41592-021-01316-y pubmed: 34811556
Lewis, S. M. et al. Spatial omics and multiplexed imaging to explore cancer biology. Nat. Methods. 18, 997–1012 (2021).
doi: 10.1038/s41592-021-01203-6 pubmed: 34341583
Pandey, S. & Bodas, D. High-quality quantum dots for multiplexed bioimaging: a critical review. Adv. Colloid Interface Sci. 278, 102137 (2020).
doi: 10.1016/j.cis.2020.102137 pubmed: 32171116
Seo, J. et al. PICASSO allows ultra-multiplexed fluorescence imaging of spatially overlapping proteins without reference spectra measurements. Nat. Commun. 13, 2475 (2022).
doi: 10.1038/s41467-022-30168-z pubmed: 35513404 pmcid: 9072354
Tan, W. C. C. et al. Overview of multiplex immunohistochemistry/immunofluorescence techniques in the era of cancer immunotherapy. Cancer Commun. (Lond). 40, 135–153 (2020).
doi: 10.1002/cac2.12023 pubmed: 32301585
Weissleder, R. & Lee, H. Automated molecular-image cytometry and analysis in modern oncology. Nat. Rev. Mater. 5, 409–422 (2020).
doi: 10.1038/s41578-020-0180-6
Oh, J. et al. Multiplexed single-cell analysis of FNA allows accurate diagnosis of salivary gland tumors. Cancer Cytopathol. 130, 581–594 (2022).
doi: 10.1002/cncy.22594 pubmed: 35666645 pmcid: 9542730
Ko, J. et al. In vivo click Chemistry enables multiplexed Intravital Microscopy. Adv. Sci. (Weinh). 9, e2200064 (2022).
doi: 10.1002/advs.202200064 pubmed: 35750648
Ko, J. et al. Spatiotemporal multiplexed immunofluorescence imaging of living cells and tissues with bioorthogonal cycling of fluorescent probes. Nat. Biotechnol. 40, 1654–1662 (2022).
doi: 10.1038/s41587-022-01339-6 pubmed: 35654978 pmcid: 9669087
Halabi, E. A. & Weissleder, R. Light-deactivated fluorescent probes (FLASH-Off) for multiplexed imaging. J. Am. Chem. Soc. 145, 8455–8463 (2023).
doi: 10.1021/jacs.3c00170
He, S. et al. High-plex imaging of RNA and proteins at subcellular resolution in fixed tissue by spatial molecular imaging. Nat. Biotechnol. 40, 1794–1806 (2022).
doi: 10.1038/s41587-022-01483-z pubmed: 36203011
Lin, J. R. et al. Highly multiplexed immunofluorescence imaging of human tissues and tumors using t-CyCIF and conventional optical microscopes. Elife. 7, e31657 (2018).
doi: 10.7554/eLife.31657 pubmed: 29993362 pmcid: 6075866
Oh, J. et al. Rapid serial immunoprofiling of the Tumor Immune Microenvironment by Fine Needle Sampling. Clin. Cancer Res. 27, 4781–4793 (2021).
doi: 10.1158/1078-0432.CCR-21-1252 pubmed: 34233961 pmcid: 8416923
Stirling, D. R. et al. CellProfiler 4: improvements in speed, utility and usability. BMC Bioinf. 22, 433 (2021).
doi: 10.1186/s12859-021-04344-9
Pachitariu, M. & Stringer, C. Cellpose 2.0: how to train your own model. Nat. Methods. 19, 1634–1641 (2022).
doi: 10.1038/s41592-022-01663-4 pubmed: 36344832 pmcid: 9718665
Greenwald, N. F. et al. Whole-cell segmentation of tissue images with human-level performance using large-scale data annotation and deep learning. Nat. Biotechnol. 40, 555–565 (2022).
doi: 10.1038/s41587-021-01094-0 pubmed: 34795433
Petukhov, V. et al. Cell segmentation in imaging-based spatial transcriptomics. Nat. Biotechnol. 40, 345–354 (2022).
doi: 10.1038/s41587-021-01044-w pubmed: 34650268
Muhlich, J. L. et al. Stitching and registering highly multiplexed whole-slide images of tissues and tumors using ASHLAR. Bioinformatics. 38, 4613–4621 (2022).
doi: 10.1093/bioinformatics/btac544 pubmed: 35972352 pmcid: 9525007
Schapiro, D. et al. MCMICRO: a scalable, modular image-processing pipeline for multiplexed tissue imaging. Nat. Methods. 19, 311–315 (2022).
doi: 10.1038/s41592-021-01308-y pubmed: 34824477
Blampey, Q. et al. Sopa: a technology-invariant pipeline for analyses of image-based spatial omics. Nat. Commun. 15, 4981 (2024).
doi: 10.1038/s41467-024-48981-z pubmed: 38862483 pmcid: 11167053
Ronneberger, O., Fischer, P. & Brox, T. In Lecture Notes in Computer Science: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015234–241 (Springer International Publishing, 2015).
Myronenko, A. In Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: Lecture Notes in Computer Science, pp. 311–320 (Springer International Publishing, 2019).
Campello, R. J. G. B., Moulavi, D. & Sander, J. In Advances in Knowledge Discovery and Data Mining: Lecture Notes in Computer Science, pp. 160–172 (Springer Berlin Heidelberg, 2013).
McInnes, L., Healy, J., Saul, N. & Grossberger, L. UMAP: Uniform manifold approximation and projection. J. Open. Source Softw. 3, 861 (2018).
doi: 10.21105/joss.00861
Jang, J. et al. A deep learning-based segmentation pipeline for profiling cellular morphodynamics using multiple types of live cell microscopy. Cell. Rep. Methods. 1, 100105 (2021).
doi: 10.1016/j.crmeth.2021.100105 pubmed: 34888542 pmcid: 8654120
Prasad, A. & Alizadeh, E. Cell form and function: Interpreting and controlling the shape of adherent cells. Trends Biotechnol. 37, 347–357 (2019).
doi: 10.1016/j.tibtech.2018.09.007 pubmed: 30316557
Sebastian, J. A., Moore, M. J., Berndl, E. S. L. & Kolios, M. C. An image-based flow cytometric approach to the assessment of the nucleus-to-cytoplasm ratio. PLoS One. 16, e0253439 (2021).
doi: 10.1371/journal.pone.0253439 pubmed: 34166419 pmcid: 8224973
Nassar, M. et al. Label-free identification of White Blood cells using machine learning. Cytometry A. 95, 836–842 (2019).
doi: 10.1002/cyto.a.23794 pubmed: 31081599 pmcid: 6767740
Wu, T. et al. Cell granularity reflects Immune cell function and enables selection of lymphocytes with Superior attributes for Immunotherapy. Adv. Sci. (Weinh). 10, e2302175 (2023).
doi: 10.1002/advs.202302175 pubmed: 37544893
Pedregosa, F. et al. Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011).

Auteurs

Christian Landeros (C)

Center for Systems Biology, Massachusetts General Hospital, 185 Cambridge St, CPZN 5206, Boston, MA, 02114, USA.
Harvard-MIT Program in Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.

Juhyun Oh (J)

Center for Systems Biology, Massachusetts General Hospital, 185 Cambridge St, CPZN 5206, Boston, MA, 02114, USA.
Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA.

Ralph Weissleder (R)

Center for Systems Biology, Massachusetts General Hospital, 185 Cambridge St, CPZN 5206, Boston, MA, 02114, USA. rweissleder@mgh.harvard.edu.
Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA. rweissleder@mgh.harvard.edu.
Department of Systems Biology, Harvard Medical School, Boston, MA, 02115, USA. rweissleder@mgh.harvard.edu.

Hakho Lee (H)

Center for Systems Biology, Massachusetts General Hospital, 185 Cambridge St, CPZN 5206, Boston, MA, 02114, USA. hlee@mgh.harvard.edu.
Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA. hlee@mgh.harvard.edu.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH