{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T14:16:31Z","timestamp":1771078591658,"version":"3.50.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2012,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Effective quality assessment is an important part of any high-throughput flow cytometry data analysis pipeline, especially when considering the complex designs of the typical flow experiments applied in clinical trials. Technical issues like instrument variation, problematic antibody staining, or reagent lot changes can lead to biases in the extracted cell subpopulation statistics. These biases can manifest themselves in non\u2013obvious ways that can be difficult to detect without leveraging information about the study design or other experimental metadata. Consequently, a systematic and integrated approach to quality assessment of flow cytometry data is necessary to effectively identify technical errors that impact multiple samples over time. Gated cell populations and their statistics must be monitored within the context of the experimental run, assay, and the overall study.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We have developed two new packages,<jats:bold>flowWorkspace<\/jats:bold>and<jats:bold>QUAliFiER<\/jats:bold>to construct a pipeline for quality assessment of gated flow cytometry data.<jats:bold>flowWorkspace<\/jats:bold>makes manually gated data accessible to BioConductor\u2019s computational flow tools by importing pre\u2013processed and gated data from the widely used manual gating tool,<jats:bold>FlowJo<\/jats:bold>(Tree Star Inc, Ashland OR). The<jats:bold>QUAliFiER<\/jats:bold>package takes advantage of the manual gates to perform an extensive series of statistical quality assessment checks on the gated cell sub\u2013populations while taking into account the structure of the data and the study design to monitor the consistency of population statistics across staining panels, subject, aliquots, channels, or other experimental variables.<jats:bold>QUAliFiER<\/jats:bold>implements SVG\u2013based interactive visualization methods, allowing investigators to examine quality assessment results across different views of the data, and it has a flexible interface allowing users to tailor quality checks and outlier detection routines to suit their data analysis needs.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>We present a pipeline constructed from two new R packages for importing manually gated flow cytometry data and performing flexible and robust quality assessment checks. The pipeline addresses the increasing demand for tools capable of performing quality checks on large flow data sets generated in typical clinical trials. The<jats:bold>QUAliFiER<\/jats:bold>tool objectively, efficiently, and reproducibly identifies outlier samples in an automated manner by monitoring cell population statistics from gated or ungated flow data conditioned on experiment\u2013level metadata.<\/jats:p><\/jats:sec>","DOI":"10.1186\/1471-2105-13-252","type":"journal-article","created":{"date-parts":[[2012,9,30]],"date-time":"2012-09-30T11:53:35Z","timestamp":1349006015000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["QUAliFiER: An automated pipeline for quality assessment of gated flow cytometry data"],"prefix":"10.1186","volume":"13","author":[{"given":"Greg","family":"Finak","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenxin","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jorge","family":"Pardo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Asare","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raphael","family":"Gottardo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2012,9,28]]},"reference":[{"key":"5444_CR1","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1002\/cyto.a.10101","volume":"58A","author":"RC Braylan","year":"2004","unstructured":"Braylan RC: Impact of flow cytometry on the diagnosis and characterization of lymphomas, chronic lymphoproliferative disorders and plasma cell neoplasias. Cytometry A 2004, 58A: 57\u201361. 10.1002\/cyto.a.10101","journal-title":"Cytometry A"},{"issue":"4","key":"5444_CR2","first-page":"841","volume":"21","author":"RL Hengel","year":"2001","unstructured":"Hengel RL, Nicholson JK: An update on the use of flow cytometry in HIV infection and AIDS. Clin Lab Med 2001, 21(4):841\u2013856.","journal-title":"Clin Lab Med"},{"key":"5444_CR3","doi-asserted-by":"crossref","first-page":"23","DOI":"10.5858\/2004-128-23-CAOFCI","volume":"128","author":"OC Illoh","year":"2004","unstructured":"Illoh OC: Current applications of flow cytometry in the diagnosis of primary immunodeficiency diseases. Arch Pathol Lab Med 2004, 128: 23\u201331.","journal-title":"Arch Pathol Lab Med"},{"issue":"9","key":"5444_CR4","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.5858\/2003-127-1089-GTPAN","volume":"127","author":"FL Kiechle","year":"2003","unstructured":"Kiechle FL, Holland-Staley CA: Genomics, transcriptomics, proteomics, and numbers. Arch Pathol Lab Med 2003, 127(9):1089\u20131097.","journal-title":"Arch Pathol Lab Med"},{"key":"5444_CR5","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1002\/cyto.a.10102","volume":"58A","author":"FF Mandy","year":"2004","unstructured":"Mandy FF: Twenty-five years of clinical flow cytometry: AIDS, accelerated global instrument distribution. Cytometry A 2004, 58A: 55\u201356. 10.1002\/cyto.a.10102","journal-title":"Cytometry A"},{"key":"5444_CR6","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1002\/cyto.a.10104","volume":"58A","author":"A Orfao","year":"2004","unstructured":"Orfao A, Ortuno F, de Santiago M, Lopez A, San Miguel J: Immunophenotyping of acute leukemias and myelodysplastic syndromes. Cytometry A 2004, 58A: 62\u201371. 10.1002\/cyto.a.10104","journal-title":"Cytometry A"},{"key":"5444_CR7","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1002\/cyto.a.90004","volume":"58A","author":"CB Bagwell","year":"2004","unstructured":"Bagwell CB: DNA histogram analysis for node-negative breast cancer. Cytometry A 2004, 58A: 76\u201378. 10.1002\/cyto.a.90004","journal-title":"Cytometry A"},{"key":"5444_CR8","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1002\/cyto.a.10103","volume":"58A","author":"M Keeney","year":"2004","unstructured":"Keeney M, Gratama JW, Sutherland DR: Critical role of flow cytometry in evaluating peripheral blood hematopoietic stem cell grafts. Cytometry A 2004, 58A: 72\u201375. 10.1002\/cyto.a.10103","journal-title":"Cytometry A"},{"key":"5444_CR9","first-page":"2009","volume":"584603","author":"A Bashashati","year":"2009","unstructured":"Bashashati A, Brinkman RR: A survey of flow cytometry data analysis methods. Adv Bioinf 2009, 584603: 2009.","journal-title":"Adv Bioinf"},{"issue":"3","key":"5444_CR10","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1016\/j.clim.2003.11.009","volume":"110","author":"PO Krutzik","year":"2004","unstructured":"Krutzik PO, Irish JM, Nolan GP, Perez OD: Analysis of protein phosphorylation and cellular signaling events by flow cytometry: techniques and clinical applications. Clin Immunol 2004, 110(3):206\u2013221. 10.1016\/j.clim.2003.11.009","journal-title":"Clin Immunol"},{"issue":"3","key":"5444_CR11","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1038\/nri3158","volume":"12","author":"H Maecker","year":"2012","unstructured":"Maecker H, McCoy P, Nussenblatt R: Standardizing Immunophenotyping for the Human Immunology Project. Nat Rev Immunol 2012, 12(3):191\u2013200.","journal-title":"Nat Rev Immunol"},{"key":"5444_CR12","first-page":"301","volume":"281","author":"P Pozarowski","year":"2004","unstructured":"Pozarowski P, Darzynkiewicz Z: Analysis of cell cycle by flow cytometry. Methods Mol Biol 2004, 281: 301\u2013312.","journal-title":"Methods Mol Biol"},{"issue":"1-2","key":"5444_CR13","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/S0022-1759(00)00230-1","volume":"243","author":"P Pala","year":"2000","unstructured":"Pala P, Hussell T, Openshaw PJ: Flow cytometric measurement of intracellular cytokines. J Immunol Methods 2000, 243(1\u20132):107\u2013124. 10.1016\/S0022-1759(00)00230-1","journal-title":"J Immunol Methods"},{"issue":"1-2","key":"5444_CR14","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1016\/S0022-1759(00)00233-7","volume":"243","author":"I Vermes","year":"2000","unstructured":"Vermes I, Haanen C, Reutelingsperger C: Flow cytometry of apoptotic cell death. J Immunol Methods 2000, 243(1\u20132):167\u2013190. 10.1016\/S0022-1759(00)00233-7","journal-title":"J Immunol Methods"},{"issue":"1-2","key":"5444_CR15","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1016\/S0022-1759(00)00237-4","volume":"243","author":"AK Lehmann","year":"2000","unstructured":"Lehmann AK, Sornes S, Halstensen A: Phagocytosis: measurement by flow cytometry. J Immunol Methods 2000, 243(1\u20132):229\u2013242. 10.1016\/S0022-1759(00)00237-4","journal-title":"J Immunol Methods"},{"issue":"9","key":"5444_CR16","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1002\/cyto.a.20600","volume":"73","author":"N Shulman","year":"2008","unstructured":"Shulman N, Bellew M, Snelling G, Carter D, Huang Y, Li H, Self SG, McElrath MJ, De Rosa SC: Development of an automated analysis system for data from flow cytometric intracellular cytokine staining assays from clinical vaccine trials. Cytometry Part A : j Int Soc Anal Cytology 2008, 73(9):847\u2013856.","journal-title":"Cytometry Part A : j Int Soc Anal Cytology"},{"key":"5444_CR17","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1186\/1471-2105-12-71","volume":"12","author":"EK Nelson","year":"2011","unstructured":"Nelson EK, Piehler B, Eckels J, Rauch A, Bellew M, Hussey P, Ramsay S, Nathe C, Lum K, Krouse K, Stearns D, Connolly B, Skillman T, Igra M: LabKey Server: an open source platform for scientific data integration, analysis and collaboration. BMC Bioinf 2011, 12: 71. 10.1186\/1471-2105-12-71","journal-title":"BMC Bioinf"},{"key":"5444_CR18","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1186\/1471-2105-10-106","volume":"10","author":"F Hahne","year":"2009","unstructured":"Hahne F, Le Meur N, Brinkman R, Ellis B, Haaland P, Sarkar D, Spidlen J, Strain E, Gentleman R: flowCore: A Bioconductor software package for high throughput flow cytometry data analysis. BMC Bioinf 2009, 10: 106. 10.1186\/1471-2105-10-106","journal-title":"BMC Bioinf"},{"issue":"10","key":"5444_CR19","doi-asserted-by":"publisher","first-page":"R80","DOI":"10.1186\/gb-2004-5-10-r80","volume":"5","author":"RC Gentleman","year":"2004","unstructured":"Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Yang JYH, Zhang J: Bioconductor: Open software development for computational biology and bioinformatics. Genome Biol 2004, 5(10):R80. 10.1186\/gb-2004-5-10-r80","journal-title":"Genome Biol"},{"key":"5444_CR20","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1002\/cyto.a.20823","volume":"77A","author":"F Hahne","year":"2010","unstructured":"Hahne F, Khodabakhshi A, Bashashati A, Wong CJ, Gascoyne RD, Weng A, Seyfert-Margolis V, Bourcier K, Asare A, Lumley T, Gentleman R, Brinkman R: Per-channel basis normalization methods for flow cytometry data. Cytometry Part A 2010, 77A: 121\u2013131.","journal-title":"Cytometry Part A"},{"issue":"6","key":"5444_CR21","doi-asserted-by":"publisher","first-page":"878","DOI":"10.1093\/bioinformatics\/btn021","volume":"24","author":"D Sarkar","year":"2008","unstructured":"Sarkar D, Le Meur N, Gentleman R: Using flowViz to visualize flow cytometry data. Bioinformatics 2008, 24(6):878\u2013879. 10.1093\/bioinformatics\/btn021","journal-title":"Bioinformatics"},{"key":"5444_CR22","first-page":"2009","volume":"809469","author":"JJ Gosink","year":"2009","unstructured":"Gosink JJ, Means GD, Rees WA, Su C, Rand HA: Bridging the Divide between Manual Gating and Bioinformatics with the Bioconductor Package flowFlowJo. Advances in Bioinformatics 2009, 809469: 2009.","journal-title":"Advances in Bioinformatics"},{"issue":"4","key":"5444_CR23","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1109\/38.56302","volume":"10","author":"R Rew","year":"1990","unstructured":"Rew R, Davis G: NetCDF: an interface for scientific data access. Computer Graphics and Applications, IEEE 1990, 10(4):76\u201382.","journal-title":"Computer Graphics and Applications, IEEE"},{"key":"5444_CR24","unstructured":"Mike Jiang NG Greg Finak: ncdfFlow: ncdfFlow: A package that provides ncdf based storage for flow cytometry data. [http:\/\/bioconductor.org\/packages\/2.10\/bioc\/html\/ncdfFlow.html] []"},{"key":"5444_CR25","volume-title":"Programming with Data: A Guide to the S Language","author":"JM Chambers","year":"2004","unstructured":"Chambers JM: Programming with Data: A Guide to the S Language. 175 Fifth Avenue, NY 10010, USA: Springer\u2013Verlag, New York, Inc.; 2004."},{"key":"5444_CR26","volume-title":"XML: Tools for parsing and generating XML within R and S-Plus","author":"DT Lang","year":"2012,","unstructured":"Lang DT: XML: Tools for parsing and generating XML within R and S-Plus. 2012,. [. [R package version 3.9\u20134] http:\/\/CRAN.R-project.org\/package=XML]"},{"issue":"4","key":"5444_CR27","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1007\/s00778-002-0077-6","volume":"11","author":"C Chan","year":"2002","unstructured":"Chan C, Felber P, Garofalakis M: Efficient filtering of XML documents with XPath expressions. VLDB J\u2014Int J Very Large Data Bases 2002, 11(4):354\u2013379. 10.1007\/s00778-002-0077-6","journal-title":"VLDB J\u2014Int J Very Large Data Bases"},{"key":"5444_CR28","volume-title":"Rmpi: Interface (Wrapper) to MPI (Message-Passing Interface)","author":"H Yu","year":"2010,","unstructured":"Yu H: Rmpi: Interface (Wrapper) to MPI (Message-Passing Interface). 2010,. [. [R package version 0.5\u20139] http:\/\/CRAN.R-project.org\/package=Rmpi]"},{"key":"5444_CR29","volume-title":"snowfall: Easier cluster computing (based on snow)","author":"J Knaus","year":"2010,","unstructured":"Knaus J: snowfall: Easier cluster computing (based on snow). 2010,. [. [R package version 1.84] http:\/\/CRAN.R-project.org\/package=snowfall]"},{"key":"5444_CR30","volume-title":"multicore: Parallel processing of R code on machines with multiple cores or CPUs","author":"S Urbanek","year":"2011,","unstructured":"Urbanek S: multicore: Parallel processing of R code on machines with multiple cores or CPUs. 2011,. [. [R package version 0.1\u20137] http:\/\/CRAN.R-project.org\/package=multicore]"},{"key":"5444_CR31","doi-asserted-by":"crossref","unstructured":"Feng S, Ekong U, Lobritto S: Clinical and histological predictors of operational tolerance in pediatric liver transplant recipients. The 2011 Joint International Congress of ILTS , ELITA , &amp; LICAGE Valencia, June 22\u201325, 2011; Spain Edited by Lake, J R and Roberts, JP 17(suppl 1):S107.","DOI":"10.1002\/lt.22457"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-13-252.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T22:18:53Z","timestamp":1714429133000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-13-252"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,9,28]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,12]]}},"alternative-id":["5444"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-13-252","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,9,28]]},"assertion":[{"value":"12 April 2012","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2012","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 September 2012","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"252"}}