{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T05:57:35Z","timestamp":1773122255157,"version":"3.50.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T00:00:00Z","timestamp":1708387200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T00:00:00Z","timestamp":1708387200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>With the increase of the dimensionality in flow cytometry data over the past years, there is a growing need to replace or complement traditional manual analysis (i.e. iterative 2D gating) with automated data analysis pipelines. A crucial part of these pipelines consists of pre-processing and applying quality control filtering to the raw data, in order to use high quality events in the downstream analyses. This part can in turn be split into a number of elementary steps: signal compensation or unmixing, scale transformation, debris, doublets and dead cells removal, batch effect correction, etc. However, assembling and assessing the pre-processing part can be challenging for a number of reasons. First, each of the involved elementary steps can be implemented using various methods and R packages. Second, the order of the steps can have an impact on the downstream analysis results. Finally, each method typically comes with its specific, non standardized diagnostic and visualizations, making objective comparison difficult for the end user.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Here, we present\n                      <jats:italic>CytoPipeline<\/jats:italic>\n                      and\n                      <jats:italic>CytoPipelineGUI<\/jats:italic>\n                      , two\n                      <jats:italic>R<\/jats:italic>\n                      packages to build, compare and assess pre-processing pipelines for flow cytometry data. To exemplify these new tools, we present the steps involved in designing a pre-processing pipeline on a real life dataset and demonstrate different visual assessment use cases. We also set up a benchmarking comparing two pre-processing pipelines differing by their quality control methods, and show how the package visualization utilities can provide crucial user insight into the obtained benchmark metrics.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>\n                      <jats:italic>CytoPipeline<\/jats:italic>\n                      and\n                      <jats:italic>CytoPipelineGUI<\/jats:italic>\n                      are two Bioconductor\n                      <jats:italic>R<\/jats:italic>\n                      packages that help building, visualizing and assessing pre-processing pipelines for flow cytometry data. They increase productivity during pipeline development and testing, and complement benchmarking tools, by providing user intuitive insight into benchmarking results.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12859-024-05691-z","type":"journal-article","created":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T04:03:20Z","timestamp":1708401800000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["CytoPipeline and CytoPipelineGUI: a Bioconductor R package suite for building and visualizing automated pre-processing pipelines for flow cytometry data"],"prefix":"10.1186","volume":"25","author":[{"given":"Philippe","family":"Hauchamps","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Babak","family":"Bayat","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simon","family":"Delandre","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mehdi","family":"Hamrouni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marie","family":"Toussaint","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephane","family":"Temmerman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dan","family":"Lin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laurent","family":"Gatto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,2,20]]},"reference":[{"key":"5691_CR1","doi-asserted-by":"publisher","first-page":"511","DOI":"10.1002\/cpim.40","volume":"120","author":"KM McKinnon","year":"2018","unstructured":"McKinnon KM. Flow cytometry: an overview. Curr Protoc Immunol. 2018;120:511\u20135111.","journal-title":"Curr Protoc Immunol."},{"issue":"7","key":"5691_CR2","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1038\/nri.2016.56","volume":"16","author":"Y Saeys","year":"2016","unstructured":"Saeys Y, Van Gassen S, Lambrecht BN. Computational flow cytometry: helping to make sense of high-dimensional immunology data. Nat Rev Immunol. 2016;16(7):449\u201362.","journal-title":"Nat Rev Immunol"},{"issue":"8","key":"5691_CR3","doi-asserted-by":"publisher","first-page":"3775","DOI":"10.1038\/s41596-021-00550-0","volume":"16","author":"K Quintelier","year":"2021","unstructured":"Quintelier K, Couckuyt A, Emmaneel A, Aerts J, Saeys Y, Van Gassen S. Analyzing high-dimensional cytometry data using FlowSOM. Nat Protoc. 2021;16(8):3775\u2013801.","journal-title":"Nat Protoc"},{"key":"5691_CR4","doi-asserted-by":"publisher","first-page":"748","DOI":"10.12688\/f1000research.11622.1","volume":"6","author":"M Nowicka","year":"2017","unstructured":"Nowicka M, Krieg C, Crowell HL, Weber LM, Hartmann FJ, Guglietta S, et al. CyTOF workflow: differential discovery in high-throughput high-dimensional cytometry datasets. F1000Res. 2017;6:748.","journal-title":"F1000Res."},{"key":"5691_CR5","doi-asserted-by":"publisher","first-page":"3160","DOI":"10.1016\/j.csbj.2021.05.032","volume":"19","author":"P Rybakowska","year":"2021","unstructured":"Rybakowska P, Van Gassen S, Quintelier K, Saeys Y, Alarc\u00f3n-Riquelme ME, Mara\u00f1\u00f3n C. Data processing workflow for large-scale immune monitoring studies by mass cytometry. Comput Struct Biotechnol J. 2021;19:3160\u201375.","journal-title":"Comput Struct Biotechnol J"},{"issue":"3","key":"5691_CR6","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1002\/cyto.a.24350","volume":"101","author":"TM Ashhurst","year":"2022","unstructured":"Ashhurst TM, Marsh-Wakefield F, Putri GH, Spiteri AG, Shinko D, Read MN, et al. Integration, exploration, and analysis of high-dimensional single-cell cytometry data using Spectre. Cytometry A. 2022;101(3):237\u201353.","journal-title":"Cytometry A"},{"issue":"4","key":"5691_CR7","doi-asserted-by":"publisher","DOI":"10.1016\/j.xpro.2022.101697","volume":"3","author":"P Rybakowska","year":"2022","unstructured":"Rybakowska P, Van Gassen S, Martorell Marug\u00e1n J, Quintelier K, Saeys Y, Alarc\u00f3n-Riquelme ME, et al. Protocol for large scale whole blood immune monitoring by mass cytometry and Cyto Quality Pipeline. STAR Protoc. 2022;3(4): 101697.","journal-title":"STAR Protoc."},{"issue":"10","key":"5691_CR8","doi-asserted-by":"publisher","first-page":"1190","DOI":"10.1038\/s41590-021-01006-z","volume":"22","author":"T Liechti","year":"2021","unstructured":"Liechti T, Weber LM, Ashhurst TM, Stanley N, Prlic M, Van Gassen S, et al. An updated guide for the perplexed: cytometry in the high-dimensional era. Nat Immunol. 2021;22(10):1190\u20137.","journal-title":"Nat Immunol"},{"issue":"8","key":"5691_CR9","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1002\/cyto.a.23566","volume":"93","author":"EMC Mazza","year":"2018","unstructured":"Mazza EMC, Brummelman J, Alvisi G, Roberto A, De Paoli F, Zanon V, et al. Background fluorescence and spreading error are major contributors of variability in high-dimensional flow cytometry data visualization by t-distributed stochastic neighboring embedding. Cytometry A. 2018;93(8):785\u201392.","journal-title":"Cytometry A"},{"key":"5691_CR10","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1186\/1471-2105-11-546","volume":"11","author":"G Finak","year":"2010","unstructured":"Finak G, Perez JM, Weng A, Gottardo R. Optimizing transformations for automated, high throughput analysis of flow cytometry data. BMC Bioinform. 2010;11:546.","journal-title":"BMC Bioinform"},{"issue":"4","key":"5691_CR11","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1002\/cyto.a.24501","volume":"101","author":"A Emmaneel","year":"2022","unstructured":"Emmaneel A, Quintelier K, Sichien D, Rybakowska P, Mara\u00f1\u00f3n C, Alarc\u00f3n-Riquelme ME, et al. PeacoQC: peak-based selection of high quality cytometry data. Cytometry A. 2022;101(4):325\u201338.","journal-title":"Cytometry A"},{"key":"5691_CR12","doi-asserted-by":"publisher","DOI":"10.3389\/fimmu.2021.768113","volume":"12","author":"H den Braanker","year":"2021","unstructured":"den Braanker H, Bongenaar M, Lubberts E. How to prepare spectral flow cytometry datasets for high dimensional data analysis: a practical workflow. Front Immunol. 2021;12: 768113.","journal-title":"Front Immunol"},{"issue":"2","key":"5691_CR13","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nmeth.3252","volume":"12","author":"W Huber","year":"2015","unstructured":"Huber W, Carey VJ, Gentleman R, Anders S, Carlson M, Carvalho BS, et al. Orchestrating high-throughput genomic analysis with Bioconductor. Nat Methods. 2015;12(2):115\u201321.","journal-title":"Nat Methods"},{"issue":"16","key":"5691_CR14","doi-asserted-by":"publisher","first-page":"2473","DOI":"10.1093\/bioinformatics\/btw191","volume":"32","author":"G Monaco","year":"2016","unstructured":"Monaco G, Chen H, Poidinger M, Chen J, de Magalh\u00e3es JP, Larbi A. flowAI: automatic and interactive anomaly discerning tools for flow cytometry data. Bioinformatics. 2016;32(16):2473\u201380.","journal-title":"Bioinformatics"},{"issue":"5","key":"5691_CR15","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1002\/cyto.a.22837","volume":"89","author":"K Fletez-Brant","year":"2016","unstructured":"Fletez-Brant K, \u0160pidlen J, Brinkman RR, Roederer M, Chattopadhyay PK. flowClean: automated identification and removal of fluorescence anomalies in flow cytometry data. Cytometry A. 2016;89(5):461\u201371.","journal-title":"Cytometry A"},{"issue":"1","key":"5691_CR16","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1002\/cyto.a.24670","volume":"103","author":"J Meskas","year":"2023","unstructured":"Meskas J, Yokosawa D, Wang S, Segat GC, Brinkman RR. flowCut: an R package for automated removal of outlier events and flagging of files based on time versus fluorescence analysis. Cytometry A. 2023;103(1):71\u201381.","journal-title":"Cytometry A"},{"issue":"1","key":"5691_CR17","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1186\/s13059-019-1917-7","volume":"20","author":"X Liu","year":"2019","unstructured":"Liu X, Song W, Wong BY, Zhang T, Yu S, Lin GN, et al. A comparison framework and guideline of clustering methods for mass cytometry data. Genome Biol. 2019;20(1):297.","journal-title":"Genome Biol"},{"issue":"12","key":"5691_CR18","doi-asserted-by":"publisher","first-page":"1084","DOI":"10.1002\/cyto.a.23030","volume":"89","author":"LM Weber","year":"2016","unstructured":"Weber LM, Robinson MD. Comparison of clustering methods for high-dimensional single-cell flow and mass cytometry data. Cytometry A. 2016;89(12):1084\u201396.","journal-title":"Cytometry A"},{"issue":"6","key":"5691_CR19","doi-asserted-by":"publisher","first-page":"3224","DOI":"10.3390\/ijms23063224","volume":"23","author":"M Cheung","year":"2022","unstructured":"Cheung M, Campbell JJ, Thomas RJ, Braybrook J, Petzing J. Assessment of automated flow cytometry data analysis tools within cell and gene therapy manufacturing. Int J Mol Sci. 2022;23(6):3224.","journal-title":"Int J Mol Sci"},{"issue":"1","key":"5691_CR20","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1002\/cyto.a.22732","volume":"89","author":"N Aghaeepour","year":"2016","unstructured":"Aghaeepour N, Chattopadhyay P, Chikina M, Dhaene T, Van Gassen S, Kursa M, et al. A benchmark for evaluation of algorithms for identification of cellular correlates of clinical outcomes. Cytometry A. 2016;89(1):16\u201321.","journal-title":"Cytometry A"},{"issue":"1","key":"5691_CR21","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1186\/s13059-020-02136-7","volume":"21","author":"PL Germain","year":"2020","unstructured":"Germain PL, Sonrel A, Robinson MD. pipeComp, a general framework for the evaluation of computational pipelines, reveals performant single cell RNA-seq preprocessing tools. Genome Biol. 2020;21(1):227.","journal-title":"Genome Biol"},{"issue":"7","key":"5691_CR22","doi-asserted-by":"publisher","first-page":"2288","DOI":"10.1093\/bioinformatics\/btz889","volume":"36","author":"S Su","year":"2020","unstructured":"Su S, Tian L, Dong X, Hickey PF, Freytag S, Ritchie ME. Cell Bench: R\/Bioconductor software for comparing single-cell RNA-seq analysis methods. Bioinformatics. 2020;36(7):2288\u201390.","journal-title":"Bioinformatics"},{"key":"5691_CR23","doi-asserted-by":"crossref","unstructured":"Selega A, Campbell KR.: Multi-objective Bayesian optimization with heuristic objectives for biomedical and molecular data analysis workflows. Preprint at https:\/\/www.biorxiv.org\/content\/early\/2022\/06\/12\/2022.06.08.495370.","DOI":"10.1101\/2022.06.08.495370"},{"issue":"1","key":"5691_CR24","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1002\/cyto.a.20825","volume":"77","author":"J Spidlen","year":"2010","unstructured":"Spidlen J, Moore W, Parks D, Goldberg M, Bray C, Bierre P, et al. Data file standard for flow cytometry, version FCS 3.1. Cytometry A. 2010;77(1):97\u2013100.","journal-title":"Cytometry A."},{"key":"5691_CR25","doi-asserted-by":"crossref","unstructured":"Pezoa F, Reutter JL, Suarez F, Ugarte M, Vrgo\u010d D. Foundations of JSON schema. In: Proceedings of the 25th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee; 2016. p. 263\u2013273.","DOI":"10.1145\/2872427.2883029"},{"key":"5691_CR26","unstructured":"Morgan M, Wang J, Obenchain V, Lang M, Thompson R, Turaga N.: BiocParallel: Bioconductor facilities for parallel evaluation. R package version 1.34.0. Available from: https:\/\/bioconductor.org\/packages\/BiocParallel."},{"key":"5691_CR27","unstructured":"Shepherd L, Morgan M.: BiocFileCache: Manage Files Across Sessions. R package version 2.8.0. Available from: https:\/\/bioconductor.org\/packages\/BiocFileCache."},{"key":"5691_CR28","unstructured":"Chang W, Cheng J, Allaire J, Sievert C, Schloerke B, Xie Y, et\u00a0al.: shiny: Web Application Framework for R. Available from: https:\/\/shiny.posit.co\/."},{"key":"5691_CR29","unstructured":"Ellis B, Haaland P, Hahne F, Le Meur N, Gopalakrishnan N, Spidlen J, et\u00a0al.: flowCore: Basic structures for flow cytometry data. R package version 2.12.0. Available from: https:\/\/bioconductor.org\/packages\/flowCore."},{"key":"5691_CR30","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1186\/1471-2105-10-145","volume":"10","author":"K Lo","year":"2009","unstructured":"Lo K, Hahne F, Brinkman RR, Gottardo R. flowClust: a Bioconductor package for automated gating of flow cytometry data. BMC Bioinform. 2009;10:145.","journal-title":"BMC Bioinform"},{"issue":"6","key":"5691_CR31","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1002\/cyto.a.20258","volume":"69","author":"DR Parks","year":"2006","unstructured":"Parks DR, Roederer M, Moore WA. A new \u201cLogicle\u2019\u2019 display method avoids deceptive effects of logarithmic scaling for low signals and compensated data. Cytometry A. 2006;69(6):541\u201351.","journal-title":"Cytometry A"},{"issue":"12","key":"5691_CR32","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1002\/cyto.a.23663","volume":"93","author":"G Finak","year":"2018","unstructured":"Finak G, Jiang W, Gottardo R. CytoML for cross-platform cytometry data sharing. Cytometry A. 2018;93(12):1189\u201396.","journal-title":"Cytometry A"},{"key":"5691_CR33","unstructured":"Hauchamps P, Gatto L.: CytoMDS: Low Dimensions projection of cytometry samples. R package version 0.99.8. Available from: https:\/\/uclouvain-cbio.github.io\/CytoMDS."}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-024-05691-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-024-05691-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-024-05691-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T04:04:15Z","timestamp":1708401855000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-024-05691-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,20]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["5691"],"URL":"https:\/\/doi.org\/10.1186\/s12859-024-05691-z","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.10.10.561699","asserted-by":"object"}]},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,20]]},"assertion":[{"value":"10 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"P.H. is a student at the de Duve Institute (UCLouvain) and participates in a post graduate studentship program at GSK; B.B. is employee of the GSK group of companies, reports ownership of GSK shares and is listed as inventor on patent(s) owned by the GSK group of companies; S.D. is employee of the GSK group of companies and reports ownership of GSK shares; M.H. is employee of the GSK group of companies; M.T. is employee of the GSK group of companies, reports ownership of GSK shares and is listed as inventor on patent(s) owned by the GSK group of companies; S.T. is employee of the GSK group of companies, reports ownership of GSK shares and is listed as inventor on patent(s) owned by the GSK group of companies; D.L. is employee of the GSK group of companies and reports ownership of GSK shares; L.G. reports no competing interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"80"}}