An end-to-end workflow for multiplexed image processing and analysis.


Journal

Nature protocols
ISSN: 1750-2799
Titre abrégé: Nat Protoc
Pays: England
ID NLM: 101284307

Informations de publication

Date de publication:
Nov 2023
Historique:
received: 30 09 2022
accepted: 23 06 2023
medline: 8 11 2023
pubmed: 11 10 2023
entrez: 10 10 2023
Statut: ppublish

Résumé

Multiplexed imaging enables the simultaneous spatial profiling of dozens of biological molecules in tissues at single-cell resolution. Extracting biologically relevant information, such as the spatial distribution of cell phenotypes from multiplexed tissue imaging data, involves a number of computational tasks, including image segmentation, feature extraction and spatially resolved single-cell analysis. Here, we present an end-to-end workflow for multiplexed tissue image processing and analysis that integrates previously developed computational tools to enable these tasks in a user-friendly and customizable fashion. For data quality assessment, we highlight the utility of napari-imc for interactively inspecting raw imaging data and the cytomapper R/Bioconductor package for image visualization in R. Raw data preprocessing, image segmentation and feature extraction are performed using the steinbock toolkit. We showcase two alternative approaches for segmenting cells on the basis of supervised pixel classification and pretrained deep learning models. The extracted single-cell data are then read, processed and analyzed in R. The protocol describes the use of community-established data containers, facilitating the application of R/Bioconductor packages for dimensionality reduction, single-cell visualization and phenotyping. We provide instructions for performing spatially resolved single-cell analysis, including community analysis, cellular neighborhood detection and cell-cell interaction testing using the imcRtools R/Bioconductor package. The workflow has been previously applied to imaging mass cytometry data, but can be easily adapted to other highly multiplexed imaging technologies. This protocol can be implemented by researchers with basic bioinformatics training, and the analysis of the provided dataset can be completed within 5-6 h. An extended version is available at https://bodenmillergroup.github.io/IMCDataAnalysis/ .

Identifiants

pubmed: 37816904
doi: 10.1038/s41596-023-00881-0
pii: 10.1038/s41596-023-00881-0
doi:

Types de publication

Journal Article Review

Langues

eng

Sous-ensembles de citation

IM

Pagination

3565-3613

Subventions

Organisme : EC | EU Framework Programme for Research and Innovation H2020 | H2020 Priority Excellent Science | H2020 European Research Council (H2020 Excellent Science - European Research Council)
ID : ERC-2019-CoG
Organisme : EC | EU Framework Programme for Research and Innovation H2020 | H2020 Priority Excellent Science | H2020 Marie Skłodowska-Curie Actions (H2020 Excellent Science - Marie Skłodowska-Curie Actions)
ID : 892225

Informations de copyright

© 2023. Springer Nature Limited.

Références

Lin, J.-R. et al. Highly multiplexed immunofluorescence imaging of human tissues and tumors using t-CyCIF and conventional optical microscopes. eLife 7, e31657 (2018).
pubmed: 29993362 pmcid: 6075866 doi: 10.7554/eLife.31657
Gut, G., Herrmann, M. D. & Pelkmans, L. Multiplexed protein maps link subcellular organization to cellular states. Science 361, eaar7042 (2018).
pubmed: 30072512 doi: 10.1126/science.aar7042
Radtke, A. J. et al. IBEX: a versatile multiplex optical imaging approach for deep phenotyping and spatial analysis of cells in complex tissues. Proc. Natl Acad. Sci. USA 117, 33455–33465 (2020).
pubmed: 33376221 pmcid: 7776876 doi: 10.1073/pnas.2018488117
Saka, S. K. et al. Immuno-SABER enables highly multiplexed and amplified protein imaging in tissues. Nat. Biotechnol. 37, 1080–1090 (2019).
pubmed: 31427819 pmcid: 6728175 doi: 10.1038/s41587-019-0207-y
Goltsev, Y. et al. Deep profiling of mouse splenic architecture with CODEX multiplexed imaging. Cell 174, 968–981.e15 (2018).
pubmed: 30078711 pmcid: 6086938 doi: 10.1016/j.cell.2018.07.010
Giesen, C. et al. Highly multiplexed imaging of tumor tissues with subcellular resolution by mass cytometry. Nat. Methods 11, 417–422 (2014).
pubmed: 24584193 doi: 10.1038/nmeth.2869
Angelo, M. et al. Multiplexed ion beam imaging of human breast tumors. Nat. Med. 20, 436–442 (2014).
pubmed: 24584119 pmcid: 4110905 doi: 10.1038/nm.3488
Jackson, H. W. et al. The single-cell pathology landscape of breast cancer. Nature 578, 615–620 (2020).
pubmed: 31959985 doi: 10.1038/s41586-019-1876-x
Ali, H. R. et al. Imaging mass cytometry and multiplatform genomics define the phenogenomic landscape of breast cancer. Nat. Cancer 1, 163–175 (2020).
pubmed: 35122013 doi: 10.1038/s43018-020-0026-6
Schürch, C. M. et al. Coordinated cellular neighborhoods orchestrate antitumoral immunity at the colorectal cancer invasive front. Cell 183, 838 (2020).
pubmed: 33125896 pmcid: 7658307 doi: 10.1016/j.cell.2020.10.021
Hoch, T. et al. Multiplexed imaging mass cytometry of the chemokine milieus in melanoma characterizes features of the response to immunotherapy. Sci. Immunol. 7, eabk1692 (2022).
pubmed: 35363540 doi: 10.1126/sciimmunol.abk1692
Jiang, S. et al. Combined protein and nucleic acid imaging reveals virus-dependent B cell and macrophage immunosuppression of tissue microenvironments. Immunity 55, 1118–1134.e8 (2022).
pubmed: 35447093 pmcid: 9220319 doi: 10.1016/j.immuni.2022.03.020
Rendeiro, A. F. et al. The spatial landscape of lung pathology during COVID-19 progression. Nature 593, 564–569 (2021).
pubmed: 33780969 pmcid: 8204801 doi: 10.1038/s41586-021-03475-6
Mitamura, Y. et al. Cutaneous and systemic hyperinflammation drives maculopapular drug exanthema in severely ill COVID-19 patients. Allergy 77, 595–608 (2022).
pubmed: 34157151 doi: 10.1111/all.14983
Damond, N. et al. A map of human type 1 diabetes progression by imaging mass cytometry. Cell Metab. 29, 755–768.e5 (2019).
pubmed: 30713109 pmcid: 6821395 doi: 10.1016/j.cmet.2018.11.014
Ferrian, S. et al. Multiplexed imaging reveals an IFN-γ-driven inflammatory state in nivolumab-associated gastritis. Cell Rep. Med. 2, 100419 (2021).
pubmed: 34755133 pmcid: 8561237 doi: 10.1016/j.xcrm.2021.100419
Amezquita, R. A. et al. Orchestrating single-cell analysis with Bioconductor. Nat. Methods 17, 137–145 (2020).
pubmed: 31792435 doi: 10.1038/s41592-019-0654-x
Schapiro, D. et al. histoCAT: analysis of cell phenotypes and interactions in multiplex image cytometry data. Nat. Methods 14, 873–876 (2017).
pubmed: 28783155 pmcid: 5617107 doi: 10.1038/nmeth.4391
Bhate, S. S., Barlow, G. L., Schürch, C. M. & Nolan, G. P. Tissue schematics map the specialization of immune tissue motifs and their appropriation by tumors. Cell Syst. 13, 109–130.e6 (2022).
pubmed: 34653369 doi: 10.1016/j.cels.2021.09.012
napari contributors. napari: a multi-dimensional image viewer for python. https://doi.org/10.5281/zenodo.3555620 (2019).
Berg, S. et al. ilastik: interactive machine learning for (bio)image analysis. Nat. Methods 16, 1226–1232 (2019).
pubmed: 31570887 doi: 10.1038/s41592-019-0582-9
Stirling, D. R. et al. CellProfiler 4: improvements in speed, utility and usability. BMC Bioinforma. 22, 433 (2021).
doi: 10.1186/s12859-021-04344-9
Greenwald, N. F. et al. Whole-cell segmentation of tissue images with human-level performance using large-scale data annotation and deep learning. Nat. Biotechnol. 40, 555–565 (2022).
pubmed: 34795433 doi: 10.1038/s41587-021-01094-0
Chevrier, S. et al. Compensation of signal spillover in suspension and imaging mass cytometry. Cell Syst. 6, 612–620.e5 (2018).
pubmed: 29605184 pmcid: 5981006 doi: 10.1016/j.cels.2018.02.010
Eling, N., Damond, N., Hoch, T. & Bodenmiller, B. cytomapper: an R/bioconductor package for visualisation of highly multiplexed imaging data. Bioinformatics 36, 5706–5708 (2020).
pmcid: 8023672 doi: 10.1093/bioinformatics/btaa1061
Bankhead, P. et al. QuPath: open source software for digital pathology image analysis. Sci. Rep. 7, 16878 (2017).
pubmed: 29203879 pmcid: 5715110 doi: 10.1038/s41598-017-17204-5
Schulz, D. et al. Simultaneous multiplexed imaging of mRNA and proteins with subcellular resolution in breast cancer tissue samples by mass cytometry. Cell Syst. 6, 531 (2018).
pubmed: 29698648 pmcid: 5929910 doi: 10.1016/j.cels.2018.04.004
Righelli, D. et al. SpatialExperiment: infrastructure for spatially resolved transcriptomics data in R using Bioconductor. Bioinformatics 38, 3128–3131 (2022).
pubmed: 35482478 pmcid: 9154247 doi: 10.1093/bioinformatics/btac299
Bunis, D. G., Andrews, J., Fragiadakis, G. K., Burt, T. D. & Sirota, M. dittoSeq: universal user-friendly single-cell and bulk RNA sequencing visualization toolkit. Bioinformatics 36, 5535–5536 (2020).
pmcid: 8016464 doi: 10.1093/bioinformatics/btaa1011
Haghverdi, L., Lun, A. T. L., Morgan, M. D. & Marioni, J. C. Batch effects in single-cell RNA-sequencing data are corrected by matching mutual nearest neighbors. Nat. Biotechnol. 36, 421–427 (2018).
pubmed: 29608177 pmcid: 6152897 doi: 10.1038/nbt.4091
Tan, Y. et al. Single-cell analysis of endometriosis reveals a coordinated transcriptional programme driving immunotolerance and angiogenesis across eutopic and ectopic tissues. Nat. Cell Biol. 24, 1306–1318 (2022).
pubmed: 35864314 pmcid: 9901845 doi: 10.1038/s41556-022-00961-5
Canete, N. P. et al. spicyR: spatial analysis of in situ cytometry data in R. Bioinformatics 38, 3099–3105 (2022).
pubmed: 35438129 pmcid: 9326848 doi: 10.1093/bioinformatics/btac268
Siu, J. H. Y. et al. Two subsets of human marginal zone B cells resolved by global analysis of lymphoid tissues and blood. Sci. Immunol. 7, eabm9060 (2022).
pubmed: 35302862 doi: 10.1126/sciimmunol.abm9060
Singh, N. et al. Development of a 2-dimensional atlas of the human kidney with imaging mass cytometry. JCI Insight 4, e129477 (2019).
pubmed: 31217358 pmcid: 6629112 doi: 10.1172/jci.insight.129477
Lotsberg, M. L. et al. Intrinsic differences in spatiotemporal organization and stromal cell interactions between isogenic lung cancer cells of epithelial and mesenchymal phenotypes revealed by high-dimensional single-cell analysis of heterotypic 3D spheroid models. Front. Oncol. 12, 818437 (2022).
pubmed: 35530312 pmcid: 9076321 doi: 10.3389/fonc.2022.818437
Lohoff, T. et al. Integration of spatial and single-cell transcriptomic data elucidates mouse organogenesis. Nat. Biotechnol. 40, 74–85 (2022).
pubmed: 34489600 doi: 10.1038/s41587-021-01006-2
Virshup, I., Rybakov, S., Theis, F. J., Angerer, P. & Alexander Wolf, F. anndata: annotated data. Preprint at bioRxiv https://doi.org/10.1101/2021.12.16.473007 (2021).
Street, K. et al. Slingshot: cell lineage and pseudotime inference for single-cell transcriptomics. BMC Genomics 19, 477 (2018).
pubmed: 29914354 pmcid: 6007078 doi: 10.1186/s12864-018-4772-0
Robinson, M. D., McCarthy, D. J. & Smyth, G. K. edgeR: a Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics 26, 139–140 (2010).
pubmed: 19910308 doi: 10.1093/bioinformatics/btp616
Stoltzfus, C. R. et al. CytoMAP: a spatial analysis toolbox reveals features of myeloid cell organization in lymphoid tissues. Cell Rep. 31, 107523 (2020).
pubmed: 32320656 pmcid: 7233132 doi: 10.1016/j.celrep.2020.107523
Czech, E., Aksoy, B. A., Aksoy, P. & Hammerbacher, J. Cytokit: a single-cell analysis toolkit for high dimensional fluorescent microscopy imaging. BMC Bioinforma. 20, 448 (2019).
doi: 10.1186/s12859-019-3055-3
Keller, M. S. et al. Vitessce: a framework for integrative visualization of multi-modal and spatially-resolved single-cell data. Preprint at OSF Preprints https://doi.org/10.31219/osf.io/y8thv (2021).
van Maldegem, F. et al. Characterisation of tumour microenvironment remodelling following oncogene inhibition in preclinical studies with imaging mass cytometry. Nat. Commun. 12, 5906 (2021).
pubmed: 34625563 pmcid: 8501076 doi: 10.1038/s41467-021-26214-x
Schmidt, U., Weigert, M., Broaddus, C. & Myers, G. Cell detection with star-convex polygons. MICCAI 2018, 265–273 (2018).
Stringer, C., Wang, T., Michaelos, M. & Pachitariu, M. Cellpose: a generalist algorithm for cellular segmentation. Nat. Methods 18, 100–106 (2021).
pubmed: 33318659 doi: 10.1038/s41592-020-01018-x
Somarakis, A., Van Unen, V., Koning, F., Lelieveldt, B. & Hollt, T. ImaCytE: visual exploration of cellular micro-environments for imaging mass cytometry data. IEEE Trans. Vis. Comput. Graph. 27, 98–110 (2021).
pubmed: 31369380 doi: 10.1109/TVCG.2019.2931299
Gentleman, R. C. et al. Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 5, R80 (2004).
pubmed: 15461798 pmcid: 545600 doi: 10.1186/gb-2004-5-10-r80
Palla, G. et al. Squidpy: a scalable framework for spatial omics analysis. Nat. Methods 19, 171–178 (2022).
pubmed: 35102346 pmcid: 8828470 doi: 10.1038/s41592-021-01358-2
Dries, R. et al. Giotto: a toolbox for integrative analysis and visualization of spatial expression data. Genome Biol. 22, 78 (2021).
pubmed: 33685491 pmcid: 7938609 doi: 10.1186/s13059-021-02286-2
McKinley, E. T. et al. MIRIAM: a machine and deep learning single‐cell segmentation and quantification pipeline for multi‐dimensional tissue images. Cytom. Part A 101, 521–528 (2022).
doi: 10.1002/cyto.a.24541
Eng, J. et al. A framework for multiplex imaging optimization and reproducible analysis. Commun. Biol. 5, 438 (2022).
pubmed: 35545666 pmcid: 9095647 doi: 10.1038/s42003-022-03368-y
Schapiro, D. et al. MCMICRO: a scalable, modular image-processing pipeline for multiplexed tissue imaging. Nat. Methods 19, 311–315 (2022).
pubmed: 34824477 doi: 10.1038/s41592-021-01308-y
Levine, J. H. et al. Data-driven phenotypic dissection of AML reveals progenitor-like cells that correlate with prognosis. Cell 162, 184–197 (2015).
pubmed: 26095251 pmcid: 4508757 doi: 10.1016/j.cell.2015.05.047
Nirmal, A. J. et al. The spatial landscape of progression and immunoediting in primary melanoma at single-cell resolution. Cancer Discov. 12, 1518–1541 (2022).
pubmed: 35404441 pmcid: 9167783 doi: 10.1158/2159-8290.CD-21-1357
Hickey, J. W. et al. Spatial mapping of protein composition and tissue organization: a primer for multiplexed antibody-based imaging. Nat. Methods 19, 284–295 (2022).
pubmed: 34811556 doi: 10.1038/s41592-021-01316-y
Baker, E. A. G., Schapiro, D., Dumitrascu, B., Vickovic, S. & Regev, A. In silico tissue generation and power analysis for spatial omics. Nat. Methods 20, 424–431 (2023).
pubmed: 36864197 pmcid: 9998272 doi: 10.1038/s41592-023-01766-6
Bost, P., Schulz, D., Engler, S., Wasserfall, C. & Bodenmiller, B. Optimizing multiplexed imaging experimental design through tissue spatial segregation estimation. Nat. Methods 20, 418–423 (2023).
pubmed: 36585456 doi: 10.1038/s41592-022-01692-z
McCarthy, D. J., Campbell, K. R., Lun, A. T. L. & Wills, Q. F. Scater: pre-processing, quality control, normalization and visualization of single-cell RNA-seq data in R. Bioinformatics 33, 1179–1186 (2017).
pubmed: 28088763 pmcid: 5408845 doi: 10.1093/bioinformatics/btw777
Lun, A. T. L., McCarthy, D. J. & Marioni, J. C. A step-by-step workflow for low-level analysis of single-cell RNA-seq data with Bioconductor. F1000Res. 5, 2122 (2016).
pubmed: 27909575 pmcid: 5112579
Hong, H., Liechti, R. & Morfouace, M. Yes, IMMUcan! Unraveling the human tumor microenvironment. Immunol. Oncol. Insights 02, 301–309 (2021).
doi: 10.18609/ioi.2021.038
Catena, R., Montuenga, L. M. & Bodenmiller, B. Ruthenium counterstaining for imaging mass cytometry. J. Pathol. 244, 479–484 (2018).
pubmed: 29405336 doi: 10.1002/path.5049
Lu, P. et al. IMC-Denoise: a content aware denoising pipeline to enhance imaging mass cytometry. Nat. Commun. 14, 1601 (2023).
pubmed: 36959190 pmcid: 10036333 doi: 10.1038/s41467-023-37123-6
Muhlich, J. L. et al. Stitching and registering highly multiplexed whole-slide images of tissues and tumors using ASHLAR. Bioinformatics 38, 4613–4621 (2022).
pubmed: 35972352 pmcid: 9525007 doi: 10.1093/bioinformatics/btac544
Keren, L. et al. A structured tumor-immune microenvironment in triple negative breast cancer revealed by multiplexed ion beam imaging. Cell 174, 1373–1387.e19 (2018).
pubmed: 30193111 pmcid: 6132072 doi: 10.1016/j.cell.2018.08.039
Ji, A. L. et al. Multimodal analysis of composition and spatial architecture in human squamous cell carcinoma. Cell 182, 1661–1662 (2020).
pubmed: 32946785 pmcid: 7505493 doi: 10.1016/j.cell.2020.08.043
Selega, A. & Campbell, K. R. Multi-objective Bayesian optimization with heuristic objectives for biomedical and molecular data analysis workflows. Preprint at bioRxiv https://doi.org/10.1101/2022.06.08.495370 (2022).
Baranski, A. et al. MAUI (MBI Analysis User Interface)—an image processing pipeline for multiplexed mass based imaging. PLoS Comput. Biol. 17, e1008887 (2021).
pubmed: 33872301 pmcid: 8084329 doi: 10.1371/journal.pcbi.1008887
Lin, J.-R., Fallahi-Sichani, M., Chen, J.-Y. & Sorger, P. K. Cyclic immunofluorescence (CycIF), a highly multiplexed method for single-cell imaging. Curr. Protoc. Chem. Biol. 8, 251–264 (2016).
pubmed: 27925668 pmcid: 5233430 doi: 10.1002/cpch.14
Crowell H, Zanotelli V, Chevrier S, Robinson M. CATALYST: Cytometry dATa anALYSis Tools. https://github.com/HelenaLC/CATALYST (2023).
Kuett, L. et al. Three-dimensional imaging mass cytometry for highly multiplexed molecular and cellular mapping of tissues and the tumor microenvironment. Nat. Cancer 3, 122–133 (2022).
pubmed: 35121992 doi: 10.1038/s43018-021-00301-w
Korsunsky, I. et al. Fast, sensitive and accurate integration of single-cell data with Harmony. Nat. Methods 16, 1289–1296 (2019).
pubmed: 31740819 pmcid: 6884693 doi: 10.1038/s41592-019-0619-0
Stuart, T. et al. Comprehensive integration of single-cell data. Cell 177, 1888–1902.e21 (2019).
pubmed: 31178118 pmcid: 6687398 doi: 10.1016/j.cell.2019.05.031
Quintelier, K. et al. Analyzing high-dimensional cytometry data using FlowSOM. Nat. Protoc. 16, 3775–3801 (2021).
pubmed: 34172973 doi: 10.1038/s41596-021-00550-0
Blondel, V. D., Guillaume, J.-L., Lambiotte, R. & Lefebvre, E. Fast unfolding of communities in large networks. J. Stat. Mech. Theory Exp. 2008, P10008 (2008).
doi: 10.1088/1742-5468/2008/10/P10008
Patrick, E. et al. Spatial analysis for highly multiplexed imaging data to identify tissue microenvironments. Cytom. A https://doi.org/10.1002/cyto.a.24729 (2023).
Shannon, P. et al. Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res. 13, 2498–2504 (2003).
pubmed: 14597658 pmcid: 403769 doi: 10.1101/gr.1239303

Auteurs

Jonas Windhager (J)

Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland.
Institute for Molecular Health Sciences, ETH Zurich, Zurich, Switzerland.
Life Science Zurich Graduate School, ETH Zurich and University of Zurich, Zurich, Switzerland.
SciLifeLab BioImage Informatics Facility and Department of Information Technology, Uppsala University, Uppsala, Sweden.

Vito Riccardo Tomaso Zanotelli (VRT)

Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland.
Institute for Molecular Health Sciences, ETH Zurich, Zurich, Switzerland.
Division of Metabolism and Children's Research Center, University Children's Hospital Zurich, University of Zurich, Zurich, Switzerland.

Daniel Schulz (D)

Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland.
Institute for Molecular Health Sciences, ETH Zurich, Zurich, Switzerland.

Lasse Meyer (L)

Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland.
Institute for Molecular Health Sciences, ETH Zurich, Zurich, Switzerland.
Life Science Zurich Graduate School, ETH Zurich and University of Zurich, Zurich, Switzerland.

Michelle Daniel (M)

Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland.
Institute for Molecular Health Sciences, ETH Zurich, Zurich, Switzerland.

Bernd Bodenmiller (B)

Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland. bernd.bodenmiller@uzh.ch.
Institute for Molecular Health Sciences, ETH Zurich, Zurich, Switzerland. bernd.bodenmiller@uzh.ch.

Nils Eling (N)

Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland. nils.eling@uzh.ch.
Institute for Molecular Health Sciences, ETH Zurich, Zurich, Switzerland. nils.eling@uzh.ch.

Articles similaires

Selecting optimal software code descriptors-The case of Java.

Yegor Bugayenko, Zamira Kholmatova, Artem Kruglov et al.
1.00
Software Algorithms Programming Languages

Exploring blood-brain barrier passage using atomic weighted vector and machine learning.

Yoan Martínez-López, Paulina Phoobane, Yanaima Jauriga et al.
1.00
Blood-Brain Barrier Machine Learning Humans Support Vector Machine Software
1.00
Humans Magnetic Resonance Imaging Brain Infant, Newborn Infant, Premature
Cephalometry Humans Anatomic Landmarks Software Internet

Classifications MeSH