{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,20]],"date-time":"2026-09-20T08:54:04Z","timestamp":1789894444056,"version":"4.0.1"},"reference-count":40,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2015,10,8]],"date-time":"2015-10-08T00:00:00Z","timestamp":1444262400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cytometry Pt A"],"published-print":{"date-parts":[[2016,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The Flow Cytometry: Critical Assessment of Population Identification Methods (FlowCAP) challenges were established to compare the performance of computational methods for identifying cell populations in multidimensional flow cytometry data. Here we report the results of FlowCAP\u2010IV where algorithms from seven different research groups predicted the time to progression to AIDS among a cohort of 384 HIV+ subjects, using antigen\u2010stimulated peripheral blood mononuclear cell (PBMC) samples analyzed with a 14\u2010color staining panel. Two approaches (FlowReMi.1 and flowDensity\u2010flowType\u2010RchyOptimyx) provided statistically significant predictive value in the blinded test set. Manual validation of submitted results indicated that unbiased analysis of single cell phenotypes could reveal unexpected cell types that correlated with outcomes of interest in high dimensional flow cytometry datasets. \u00a9 2015 International Society for Advancement of Cytometry<\/jats:p>","DOI":"10.1002\/cyto.a.22732","type":"journal-article","created":{"date-parts":[[2015,10,8]],"date-time":"2015-10-08T14:49:51Z","timestamp":1444315791000},"page":"16-21","source":"Crossref","is-referenced-by-count":71,"title":["A benchmark for evaluation of algorithms for identification of cellular correlates of clinical outcomes"],"prefix":"10.1002","volume":"89","author":[{"given":"Nima","family":"Aghaeepour","sequence":"first","affiliation":[{"name":"Terry Fox Laboratory, British Columbia Cancer Agency Vancouver British Columbia Canada"},{"name":"Department of Medical Genetics University of British Columbia Vancouver British Columbia Canada"},{"name":"Baxter Laboratory in Stem Cell Biology Stanford University Stanford California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pratip","family":"Chattopadhyay","sequence":"additional","affiliation":[{"name":"ImmunoTechnology Section, Vaccine Research Center National Institutes of Health Washington DC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Chikina","sequence":"additional","affiliation":[{"name":"Department Computational and Systems Biology University of Pittsburgh Pittsburg Pennsylvania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Dhaene","sequence":"additional","affiliation":[{"name":"Department of Information Technology Ghent University\u2014iMinds Ghent Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sofie","family":"Van Gassen","sequence":"additional","affiliation":[{"name":"Department of Information Technology Ghent University\u2014iMinds Ghent Belgium"},{"name":"Inflammation Research Center, VIB Ghent Belgium"},{"name":"Department of Respiratory Medicine Ghent University Hospital Ghent Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miron","family":"Kursa","sequence":"additional","affiliation":[{"name":"Interdisciplinary Centre for Mathematical and Computational Modelling University of Warsaw Warsaw Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bart N.","family":"Lambrecht","sequence":"additional","affiliation":[{"name":"Inflammation Research Center, VIB Ghent Belgium"},{"name":"Department of Respiratory Medicine Ghent University Hospital Ghent Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mehrnoush","family":"Malek","sequence":"additional","affiliation":[{"name":"Terry Fox Laboratory, British Columbia Cancer Agency Vancouver British Columbia Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"G. J.","family":"McLachlan","sequence":"additional","affiliation":[{"name":"Department of Statistics University of Queensland St. Lucia Brisbane Australia 4072"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Qian","sequence":"additional","affiliation":[{"name":"J. Craig Venter Institute La Jolla California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peng","family":"Qiu","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering Georgia Institute of Technology and Emory University Atlanta Georgia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yvan","family":"Saeys","sequence":"additional","affiliation":[{"name":"Inflammation Research Center, VIB Ghent Belgium"},{"name":"Department of Respiratory Medicine Ghent University Hospital Ghent Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rick","family":"Stanton","sequence":"additional","affiliation":[{"name":"J. Craig Venter Institute La Jolla California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"Tong","sequence":"additional","affiliation":[{"name":"The John Van Geest Cancer Research Centre, Nottingham Trent University Nottingham United Kingdom"},{"name":"Centre for Genomic and Experimental Medicine, Institute of Genetics and Molecular Medicine, University of Edinburgh Edinburgh United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Celine","family":"Vens","sequence":"additional","affiliation":[{"name":"Inflammation Research Center, VIB Ghent Belgium"},{"name":"Department of Respiratory Medicine Ghent University Hospital Ghent Belgium"},{"name":"Department of Public Health and Primary Care kU Leuven Kulak Kortrijk Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S\u0142awomir","family":"Walkowiak","sequence":"additional","affiliation":[{"name":"Interdisciplinary Centre for Mathematical and Computational Modelling University of Warsaw Warsaw Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kui","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Mathematics University of Queensland St. Lucia Brisbane Australia"},{"name":"School of Medicine, Shihezi University Xinjiang 832000 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Greg","family":"Finak","sequence":"additional","affiliation":[{"name":"Vaccine and Infectious Disease Division Fred Hutchinson Cancer Research Center, Seattle Washington DC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raphael","family":"Gottardo","sequence":"additional","affiliation":[{"name":"Vaccine and Infectious Disease Division Fred Hutchinson Cancer Research Center, Seattle Washington DC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tim","family":"Mosmann","sequence":"additional","affiliation":[{"name":"David H. Smith Center for Vaccine Biology and Immunology University of Rochester Medical Center Rochester New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Garry P.","family":"Nolan","sequence":"additional","affiliation":[{"name":"Baxter Laboratory in Stem Cell Biology Stanford University Stanford California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard H.","family":"Scheuermann","sequence":"additional","affiliation":[{"name":"J. Craig Venter Institute La Jolla California"},{"name":"Department of Pathology University of California San Diego California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryan R.","family":"Brinkman","sequence":"additional","affiliation":[{"name":"Terry Fox Laboratory, British Columbia Cancer Agency Vancouver British Columbia Canada"},{"name":"Department of Medical Genetics University of British Columbia Vancouver British Columbia Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2015,10,8]]},"reference":[{"key":"e_1_2_7_2_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003365"},{"key":"e_1_2_7_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/nmeth.2365"},{"key":"e_1_2_7_4_1","doi-asserted-by":"publisher","DOI":"10.1097\/QAI.0b013e31817bec05"},{"key":"e_1_2_7_5_1","doi-asserted-by":"publisher","DOI":"10.1086\/649430"},{"key":"e_1_2_7_6_1","unstructured":"MacQueenJ.Some methods for classification and analysis of multivariate observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. Vol 1 no. 14 p281\u2013297."},{"key":"e_1_2_7_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/cyto.a.22030"},{"key":"e_1_2_7_8_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btt770"},{"key":"e_1_2_7_9_1","doi-asserted-by":"publisher","DOI":"10.1002\/cyto.a.22209"},{"key":"e_1_2_7_10_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btu677"},{"key":"e_1_2_7_11_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bts082"},{"key":"e_1_2_7_12_1","first-page":"87AL616","article-title":"gEM\/GANN: A multivariate computational strategy for auto\u2010characterizing relationships between cellular and clinical phenotypes and predicting disease progression time using high\u2010dimensional flow cytometry data","author":"Tong DL","year":"2015","journal-title":"Cytometry Part A"},{"key":"e_1_2_7_13_1","doi-asserted-by":"publisher","DOI":"10.1002\/cyto.a.22734"},{"key":"e_1_2_7_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13042-010-0004-x"},{"key":"e_1_2_7_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2011.06.008"},{"key":"e_1_2_7_16_1","doi-asserted-by":"publisher","DOI":"10.1155\/2009\/193947"},{"key":"e_1_2_7_17_1","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.1991"},{"key":"e_1_2_7_18_1","volume-title":"The EM Algorithm and Extensions","author":"McLachlan G","year":"2007"},{"key":"e_1_2_7_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/cyto.a.20905"},{"key":"e_1_2_7_20_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.0020020"},{"key":"e_1_2_7_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jim.2006.04.007"},{"key":"e_1_2_7_22_1","doi-asserted-by":"publisher","DOI":"10.1182\/blood-2012-01-380121"},{"key":"e_1_2_7_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1440-1711.2005.01394.x"},{"key":"e_1_2_7_24_1","doi-asserted-by":"publisher","DOI":"10.1182\/blood-2010-03-273763"},{"key":"e_1_2_7_25_1","doi-asserted-by":"publisher","DOI":"10.1093\/infdis\/jiq118"},{"key":"e_1_2_7_26_1","doi-asserted-by":"publisher","DOI":"10.1182\/blood-2009-02-204263"},{"key":"e_1_2_7_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/cyto.a.22037"},{"key":"e_1_2_7_28_1","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1002\/cyto.a.20823","article-title":"Per\u2010channel basis normalization methods for flow cytometry data","volume":"77","author":"Hahne F","year":"2010","journal-title":"Cytom A"},{"key":"e_1_2_7_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bts300"},{"key":"e_1_2_7_30_1","doi-asserted-by":"crossref","unstructured":"RoedererM TreisterA MooreW HerzenbergLA.Probability binning comparison: A metric for quantitating univariate distribution differences. Cytometry2001;45:37\u201346.","DOI":"10.1002\/1097-0320(20010901)45:1<37::AID-CYTO1142>3.0.CO;2-E"},{"key":"e_1_2_7_31_1","doi-asserted-by":"crossref","unstructured":"AzadA KhanA RajwaB PyneS PothenA.\u201cClassifying Immunophenotypes With Templates From Flow Cytometry \u201d presented at the International Conference New York New York USA 2007 pp.256\u2013265.","DOI":"10.1145\/2506583.2506627"},{"key":"e_1_2_7_32_1","doi-asserted-by":"crossref","unstructured":"DundarM AkovaF YerebakanHZ RajwaB. A non\u2010parametric Bayesian model with random effects: Joint cell clustering and cluster matching for anomalous sample phenotype identification. BMC Bioinformatics2014;15(1):314.","DOI":"10.1186\/1471-2105-15-314"},{"key":"e_1_2_7_33_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.091062498"},{"key":"e_1_2_7_34_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1408792111"},{"key":"e_1_2_7_35_1","doi-asserted-by":"publisher","DOI":"10.1126\/scitranslmed.3009701"},{"key":"e_1_2_7_36_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2164-14-S1-S14"},{"key":"e_1_2_7_37_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003664"},{"key":"e_1_2_7_38_1","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.2594"},{"key":"e_1_2_7_39_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1321405111"},{"key":"e_1_2_7_40_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003806"},{"key":"e_1_2_7_41_1","doi-asserted-by":"publisher","DOI":"10.1002\/cyto.a.22106"}],"container-title":["Cytometry Part A"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fcyto.a.22732","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fcyto.a.22732","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cyto.a.22732","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,30]],"date-time":"2025-05-30T23:40:35Z","timestamp":1748648435000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cyto.a.22732"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,10,8]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2016,1]]}},"alternative-id":["10.1002\/cyto.a.22732"],"URL":"https:\/\/doi.org\/10.1002\/cyto.a.22732","archive":["Portico"],"relation":{},"ISSN":["1552-4922","1552-4930"],"issn-type":[{"value":"1552-4922","type":"print"},{"value":"1552-4930","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,10,8]]}}}