{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T03:27:31Z","timestamp":1790652451351,"version":"4.1.0"},"reference-count":39,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,9,4]],"date-time":"2023-09-04T00:00:00Z","timestamp":1693785600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Immunol."],"abstract":"<jats:p>In the past decade, high-dimensional single-cell technologies have revolutionized basic and translational immunology research and are now a key element of the toolbox used by scientists to study the immune system. However, analysis of the data generated by these approaches often requires clustering algorithms and dimensionality reduction representation, which are computationally intense and difficult to evaluate and optimize. Here, we present Cytometry Clustering Optimization and Evaluation (Cyclone), an analysis pipeline integrating dimensionality reduction, clustering, evaluation, and optimization of clustering resolution, and downstream visualization tools facilitating the analysis of a wide range of cytometry data. We benchmarked and validated Cyclone on mass cytometry (CyTOF), full-spectrum fluorescence-based cytometry, and multiplexed immunofluorescence (IF) in a variety of biological contexts, including infectious diseases and cancer. In each instance, Cyclone not only recapitulates gold standard immune cell identification but also enables the unsupervised identification of lymphocytes and mononuclear phagocyte subsets that are associated with distinct biological features. Altogether, the Cyclone pipeline is a versatile and accessible pipeline for performing, optimizing, and evaluating clustering on a variety of cytometry datasets, which will further power immunology research and provide a scaffold for biological discovery.<\/jats:p>","DOI":"10.3389\/fimmu.2023.1167241","type":"journal-article","created":{"date-parts":[[2023,9,4]],"date-time":"2023-09-04T09:16:35Z","timestamp":1693818995000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Cyclone: an accessible pipeline to analyze, evaluate, and optimize multiparametric cytometry data"],"prefix":"10.3389","volume":"14","author":[{"given":"Ravi K.","family":"Patel","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rebecca G.","family":"Jaszczak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kwok","family":"Im","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas D.","family":"Carey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tristan","family":"Courau","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel G.","family":"Bunis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bushra","family":"Samad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lia","family":"Avanesyan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nayvin W.","family":"Chew","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Stenske","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jillian M.","family":"Jespersen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jean","family":"Publicover","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Austin W.","family":"Edwards","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad","family":"Naser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arjun A.","family":"Rao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leonard","family":"Lupin-Jimenez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew F.","family":"Krummel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stewart","family":"Cooper","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jody L.","family":"Baron","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexis J.","family":"Combes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriela K.","family":"Fragiadakis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,9,4]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1016\/j.immuni.2022.02.006","article-title":"Single-cell immunology: Past, present, and future","volume":"55","author":"Ginhoux","year":"2022","journal-title":"Immunity"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2019.05.031","article-title":"Comprehensive integration of single-cell data","volume":"177","author":"Stuart","year":"2019","journal-title":"Cell"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1126\/science.1198704","article-title":"Single-cell mass cytometry of differential immune and drug responses across a human hematopoietic continuum","volume":"332","author":"Bendall","year":"2011","journal-title":"Science"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1002\/0471142956.cy0127s63","article-title":"Spectral flow cytometry","volume":"27","author":"Nolan","year":"2013","journal-title":"Curr Protoc Cytom"},{"key":"B5","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1016\/j.cell.2016.12.022","article-title":"Systemic immunity is required for effective cancer immunotherapy","volume":"168","author":"Spitzer","year":"2017","journal-title":"Cell"},{"key":"B6","doi-asserted-by":"publisher","first-page":"255ra131","DOI":"10.1126\/scitranslmed.3009701","article-title":"Clinical recovery from surgery correlates with single-cell immune signatures","volume":"6","author":"Gaudilli\u00e8re","year":"2014","journal-title":"Sci Transl Med"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1172\/JCI137265","article-title":"Landscape of coordinated immune responses to H1N1 challenge in humans","volume":"130","author":"Rahil","year":"2020","journal-title":"J Clin Invest"},{"key":"B8","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1186\/s12916-022-02359-4","article-title":"Deep immunophenotyping reveals endometriosis is marked by dysregulation of the mononuclear phagocytic system in endometrium and peripheral blood","volume":"20","author":"Vallv\u00e9-Juanico","year":"2022","journal-title":"BMC Med"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1038\/s41596-021-00550-0","article-title":"Analyzing high-dimensional cytometry data using FlowSOM","volume":"16","author":"Quintelier","year":"2021","journal-title":"Nat Protoc"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btaa042","article-title":"PARC: ultrafast and accurate clustering of phenotypic data of millions of single cells","volume":"36","author":"Stassen","year":"2020","journal-title":"Bioinformatics"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2015.05.047","article-title":"Data-driven phenotypic dissection of AML reveals progenitor-like cells that correlate with prognosis","volume":"162","author":"Levine","year":"2015","journal-title":"Cell"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.2594","article-title":"viSNE enables visualization of high dimensional single-cell data and reveals phenotypic heterogeneity of leukemia","volume":"31","author":"Amir","year":"2013","journal-title":"Nat Biotechnol"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1038\/nprot.2016.066","article-title":"Visualization and cellular hierarchy inference of single-cell data using SPADE","volume":"11","author":"Anchang","year":"2016","journal-title":"Nat Protoc"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-9454-0_20","article-title":"Supervised machine learning with CITRUS for single cell biomarker discovery","volume":"1989","author":"Polikowsky","year":"2019","journal-title":"Methods Mol Biol"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1259425","DOI":"10.1126\/science.1259425","article-title":"An interactive reference framework for modeling a dynamic immune system","volume":"349","author":"Spitzer","year":"2015","journal-title":"Science"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btaa1011","article-title":"dittoSeq: universal user-friendly single-cell and bulk RNA sequencing visualization toolkit","volume":"36","author":"Bunis","year":"2020","journal-title":"Bioinformatics"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1002\/cyto.a.22271","article-title":"NorMalization of mass cytometry data with bead standards","volume":"83","author":"Finck","year":"2013","journal-title":"Cytometry A"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.2317","article-title":"Multiplexed mass cytometry profiling of cellular states perturbed by small-molecule regulators","volume":"30","author":"Bodenmiller","year":"2012","journal-title":"Nat Biotechnol"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1979.4766909","article-title":"A cluster separation measure","volume":"1","author":"Davies","year":"1979","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"B20","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1186\/s12859-021-03957-4","article-title":"Selecting single cell clustering parameter values using subsampling-based robustness metrics","volume":"22","author":"Patterson-Cross","year":"2021","journal-title":"BMC Bioinf"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1002\/cyto.a.23904","article-title":"Cytonorm: A norMalization algorithm for cytometry data","volume":"97","author":"Van Gassen","year":"2020","journal-title":"Cytometry A"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1698","DOI":"10.1038\/s41467-022-29383-5","article-title":"cyCombine allows for robust integration of single-cell cytometry datasets within and across technologies","volume":"13","author":"Pedersen","year":"2022","journal-title":"Nat Commun"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1002\/cyto.a.23030","article-title":"Comparison of clustering methods for high-dimensional single-cell flow and mass cytometry data","author":"Weber","year":"2016","journal-title":"Cytometry A"},{"key":"B24","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1186\/s13059-019-1917-7","article-title":"A comparison framework and guideline of clustering methods for mass cytometry data","volume":"20","author":"Liu","year":"2019","journal-title":"Genome Biol"},{"key":"B25","doi-asserted-by":"crossref","DOI":"10.1002\/9780470316801","volume-title":"Finding groups in data: an introduction to cluster analysis","author":"Kaufman","year":"1990"},{"key":"B26","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/BF01908075","article-title":"Comparing partitions","volume":"2","author":"Hubert","year":"1985","journal-title":"J Classification"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1983.10478008","article-title":"A method for comparing two hierarchical clusterings","volume":"78","author":"Fowlkes","year":"1983","journal-title":"J Am Stat Assoc"},{"key":"B28","doi-asserted-by":"crossref","DOI":"10.1002\/047174882X","volume-title":"Elements of information theory","author":"Cover","year":"2005"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-019-0654-x","article-title":"Orchestrating single-cell analysis with Bioconductor","volume":"17","author":"Amezquita","year":"2020","journal-title":"Nat Methods"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1016\/S1074-7613(02)00305-9","article-title":"Activation of a nonclassical NKT cell subset in a transgenic mouse model of hepatitis B virus infection","volume":"16","author":"Baron","year":"2002","journal-title":"Immunity"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1038\/s41587-021-01094-0","article-title":"Whole-cell segmentation of tissue images with human-level performance using large-scale data annotation and deep learning","volume":"40","author":"Greenwald","year":"2022","journal-title":"Nat Biotechnol"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1101\/2023.01.21.525036","article-title":"Single-cell and spatial multi-omics identify innate and stromal modules targeted by anti-integrin therapy in ulcerative colitis","author":"Mennillo","year":"2023","journal-title":"BioRxiv"},{"key":"B33","doi-asserted-by":"publisher","first-page":"968","DOI":"10.1016\/j.cell.2018.07.010","article-title":"Deep profiling of mouse splenic architecture with CODEX multiplexed imaging","volume":"174","author":"Goltsev","year":"2018","journal-title":"Cell"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1084\/jem.20100223","article-title":"The XC chemokine receptor 1 is a conserved selective marker of mamMalian cells homologous to mouse CD8alpha+ dendritic cells","volume":"207","author":"Crozat","year":"2010","journal-title":"J Exp Med"},{"key":"B35","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1016\/j.immuni.2020.06.002","article-title":"Transcriptional and functional analysis of cd1c+ human dendritic cells identifies a CD163+ subset priming CD8+CD103+ T cells","volume":"53","author":"Bourdely","year":"2020","journal-title":"Immunity"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1016\/j.immuni.2020.04.014","article-title":"Developmental relationships of four exhausted CD8+ T cell subsets reveals underlying transcriptional and epigenetic landscape control mechanisms","volume":"52","author":"Beltra","year":"2020","journal-title":"Immunity"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-020-0892-6","article-title":"Systemic dysfunction and plasticity of the immune macroenvironment in cancer models","volume":"26","author":"Allen","year":"2020","journal-title":"Nat Med"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.3389\/fimmu.2019.02367","article-title":"Minimizing batch effects in mass cytometry data","volume":"10","author":"Schuyler","year":"2019","journal-title":"Front Immunol"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1128\/jvi.60.3.880-887.1986","article-title":"Expression of hepatitis B virus large envelope polypeptide inhibits hepatitis B surface antigen secretion in transgenic mice","volume":"60","author":"Chisari","year":"1986","journal-title":"J Virol"}],"container-title":["Frontiers in Immunology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fimmu.2023.1167241\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,4]],"date-time":"2023-09-04T09:16:42Z","timestamp":1693819002000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fimmu.2023.1167241\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,4]]},"references-count":39,"alternative-id":["10.3389\/fimmu.2023.1167241"],"URL":"https:\/\/doi.org\/10.3389\/fimmu.2023.1167241","relation":{},"ISSN":["1664-3224"],"issn-type":[{"value":"1664-3224","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,4]]},"article-number":"1167241"}}