{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:10:27Z","timestamp":1750219827921,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,9,3]],"date-time":"2023-09-03T00:00:00Z","timestamp":1693699200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,9,3]]},"DOI":"10.1145\/3584371.3613072","type":"proceedings-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T18:52:30Z","timestamp":1696445550000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["An Ensemble Machine Learning Approach for Benchmarking and Selection of scRNA-seq Integration Methods"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0240-540X","authenticated-orcid":false,"given":"Konghao","family":"Zhao","sequence":"first","affiliation":[{"name":"Wake Forest University, Winston Salem, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-4820-9690","authenticated-orcid":false,"given":"Sapan","family":"Bhandari","sequence":"additional","affiliation":[{"name":"Wake Forest University, Winston Salem, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4657-9217","authenticated-orcid":false,"given":"Nathan P","family":"Whitener","sequence":"additional","affiliation":[{"name":"Wake Forest University, Winston Salem, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4524-1601","authenticated-orcid":false,"given":"Jason M","family":"Grayson","sequence":"additional","affiliation":[{"name":"Wake Forest School of Medicine, Winston Salem, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9031-8124","authenticated-orcid":false,"given":"Natalia","family":"Khuri","sequence":"additional","affiliation":[{"name":"Wake Forest University, Winston Salem, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Mart\u00edn Abadi et al. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https:\/\/www.tensorflow.org\/  Mart\u00edn Abadi et al. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https:\/\/www.tensorflow.org\/"},{"key":"e_1_3_2_1_2_1","first-page":"5","article-title":"Single-Cell Map of Diverse Immune Phenotypes in the Breast Tumor Microenvironment","volume":"174","author":"Elham Azizi","year":"2018","unstructured":"Elham Azizi et al. 2018 . Single-Cell Map of Diverse Immune Phenotypes in the Breast Tumor Microenvironment . Cell 174 , 5 (Aug 2018), 1293--1308.e36. Elham Azizi et al. 2018. Single-Cell Map of Diverse Immune Phenotypes in the Breast Tumor Microenvironment. Cell 174, 5 (Aug 2018), 1293--1308.e36.","journal-title":"Cell"},{"volume-title":"Proceedings of the 13th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics","author":"Sapan","key":"e_1_3_2_1_3_1","unstructured":"Sapan Bhandari et al. 2022. Multi-Target Integration and Annotation of Single-Cell RNA-Sequencing Data . In Proceedings of the 13th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics ( Northbrook, Illinois) (BCB '22). Association for Computing Machinery, New York, NY, USA, Article 29, 4 pages. Sapan Bhandari et al. 2022. Multi-Target Integration and Annotation of Single-Cell RNA-Sequencing Data. In Proceedings of the 13th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics (Northbrook, Illinois) (BCB '22). Association for Computing Machinery, New York, NY, USA, Article 29, 4 pages."},{"key":"e_1_3_2_1_4_1","first-page":"55","article-title":"Integrating single-cell transcriptomic data across different conditions, technologies, and species","volume":"36","author":"Andrew Butler","year":"2018","unstructured":"Andrew Butler et al. 2018 . Integrating single-cell transcriptomic data across different conditions, technologies, and species . Nature Biotechnology 36 , 55 (May 2018), 411--420. Andrew Butler et al. 2018. Integrating single-cell transcriptomic data across different conditions, technologies, and species. Nature Biotechnology 36, 55 (May 2018), 411--420.","journal-title":"Nature Biotechnology"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Maren B\u00fcttner et al. 2019. A test metric for assessing single-cell RNA-seq batch correction. Nature methods 16 1 (2019) 43--49.  Maren B\u00fcttner et al. 2019. A test metric for assessing single-cell RNA-seq batch correction. Nature methods 16 1 (2019) 43--49.","DOI":"10.1038\/s41592-018-0254-1"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Ruben Chazarra-Gil etal 2021. Flexible comparison of batch correction methods for single-cell RNA-seq using BatchBench. 49 (Feb 2021) e42.  Ruben Chazarra-Gil et al. 2021. Flexible comparison of batch correction methods for single-cell RNA-seq using BatchBench. 49 (Feb 2021) e42.","DOI":"10.1093\/nar\/gkab004"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41587-020-00748-9"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Xin Chen et al. 2021. A multi-center cross-platform single-cell RNA sequencing reference dataset. Scientific data 8 1 (2021) 1--11.  Xin Chen et al. 2021. A multi-center cross-platform single-cell RNA sequencing reference dataset. Scientific data 8 1 (2021) 1--11.","DOI":"10.1038\/s41597-021-00809-x"},{"key":"e_1_3_2_1_10_1","first-page":"6","article-title":"Systematic comparison of single-cell and single-nucleus RNA-sequencing methods","volume":"38","author":"Jiarui Ding","year":"2020","unstructured":"Jiarui Ding et al. 2020 . Systematic comparison of single-cell and single-nucleus RNA-sequencing methods . Nature Biotechnology 38 , 6 (Jun 2020), 737--746. Jiarui Ding et al. 2020. Systematic comparison of single-cell and single-nucleus RNA-sequencing methods. Nature Biotechnology 38, 6 (Jun 2020), 737--746.","journal-title":"Nature Biotechnology"},{"key":"e_1_3_2_1_11_1","first-page":"2","article-title":"De Novo Prediction of Stem Cell Identity using Single-Cell Transcriptome Data","volume":"19","author":"Dominic Gr\u00fcn","year":"2016","unstructured":"Dominic Gr\u00fcn et al. 2016 . De Novo Prediction of Stem Cell Identity using Single-Cell Transcriptome Data . Cell Stem Cell 19 , 2 (Aug 2016), 266--277. Dominic Gr\u00fcn et al. 2016. De Novo Prediction of Stem Cell Identity using Single-Cell Transcriptome Data. Cell Stem Cell 19, 2 (Aug 2016), 266--277.","journal-title":"Cell Stem Cell"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-019-1874-1"},{"key":"e_1_3_2_1_13_1","first-page":"55","article-title":"Batch effects in single-cell RNA-sequencing data are corrected by matching mutual nearest neighbors","volume":"36","author":"Laleh Haghverdi","year":"2018","unstructured":"Laleh Haghverdi et al. 2018 . Batch effects in single-cell RNA-sequencing data are corrected by matching mutual nearest neighbors . Nature Biotechnology 36 , 55 (May 2018), 421--427. Laleh Haghverdi et al. 2018. Batch effects in single-cell RNA-sequencing data are corrected by matching mutual nearest neighbors. Nature Biotechnology 36, 55 (May 2018), 421--427.","journal-title":"Nature Biotechnology"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1093\/biostatistics\/kxx053"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/ctm2.694"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.4042"},{"key":"e_1_3_2_1_17_1","first-page":"1212","article-title":"Fast, sensitive and accurate integration of single-cell data with Harmony","volume":"16","author":"Ilya Korsunsky","year":"2019","unstructured":"Ilya Korsunsky et al. 2019 . Fast, sensitive and accurate integration of single-cell data with Harmony . Nature Methods 16 , 1212 (Dec 2019), 1289--1296. Ilya Korsunsky et al. 2019. Fast, sensitive and accurate integration of single-cell data with Harmony. Nature Methods 16, 1212 (Dec 2019), 1289--1296.","journal-title":"Nature Methods"},{"key":"e_1_3_2_1_18_1","unstructured":"Ilya Korsunsky et al. 2023. Methods to compute Local Inverse Simpson's Index (LISI). https:\/\/github.com\/immunogenomics\/LISI  Ilya Korsunsky et al. 2023. Methods to compute Local Inverse Simpson's Index (LISI). https:\/\/github.com\/immunogenomics\/LISI"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Malte D Luecken etal 2022. Benchmarking atlas-level data integration in single-cell genomics. Nature methods 19 1 (2022) 41--50.  Malte D Luecken et al. 2022. Benchmarking atlas-level data integration in single-cell genomics. Nature methods 19 1 (2022) 41--50.","DOI":"10.1038\/s41592-021-01336-8"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz592"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2015.05.002"},{"key":"e_1_3_2_1_22_1","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"F. Pedregosa","year":"2011","unstructured":"F. Pedregosa et al. 2011 . Scikit-learn: Machine Learning in Python . Journal of Machine Learning Research 12 (2011), 2825 -- 2830 . F. Pedregosa et al. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825--2830.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_23_1","first-page":"3","article-title":"BBKNN: fast batch alignment of single cell transcriptomes","volume":"36","author":"Krzysztof Pola\u0144ski","year":"2020","unstructured":"Krzysztof Pola\u0144ski et al. 2020 . BBKNN: fast batch alignment of single cell transcriptomes . Bioinformatics 36 , 3 (Feb 2020), 964--965. Krzysztof Pola\u0144ski et al. 2020. BBKNN: fast batch alignment of single cell transcriptomes. Bioinformatics 36, 3 (Feb 2020), 964--965.","journal-title":"Bioinformatics"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Ren Qi et al. 2020. Clustering and classification methods for single-cell RNA-sequencing data. Briefings in bioinformatics 21 4 (2020) 1196--1208.  Ren Qi et al. 2020. Clustering and classification methods for single-cell RNA-sequencing data. Briefings in bioinformatics 21 4 (2020) 1196--1208.","DOI":"10.1093\/bib\/bbz062"},{"key":"e_1_3_2_1_25_1","unstructured":"Aviv Regev et al. 2017. The human cell atlas. elife 6 (2017) e27041.  Aviv Regev et al. 2017. The human cell atlas. elife 6 (2017) e27041."},{"key":"e_1_3_2_1_26_1","unstructured":"Satijalab. 2023. Dataset distribution for Seurat. https:\/\/github.com\/satijalab\/seurat-data  Satijalab. 2023. Dataset distribution for Seurat. https:\/\/github.com\/satijalab\/seurat-data"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1948.tb01338.x"},{"key":"e_1_3_2_1_28_1","first-page":"7","article-title":"Comprehensive Integration of Single-Cell Data","volume":"177","author":"Tim Stuart","year":"2019","unstructured":"Tim Stuart et al. 2019 . Comprehensive Integration of Single-Cell Data . Cell 177 , 7 (Jun 2019), 1888--1902.e21. Tim Stuart et al. 2019. Comprehensive Integration of Single-Cell Data. Cell 177, 7 (Jun 2019), 1888--1902.e21.","journal-title":"Cell"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41576-019-0093-7"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1038\/nprot.2017.149"},{"key":"e_1_3_2_1_31_1","volume-title":"SingleCellNet: a computational tool to classify single cell RNA-Seq data across platforms and across species. Cell systems 9, 2","author":"Tan Yuqi","year":"2019","unstructured":"Yuqi Tan and Patrick Cahan . 2019. SingleCellNet: a computational tool to classify single cell RNA-Seq data across platforms and across species. Cell systems 9, 2 ( 2019 ), 207--213. Yuqi Tan and Patrick Cahan. 2019. SingleCellNet: a computational tool to classify single cell RNA-Seq data across platforms and across species. Cell systems 9, 2 (2019), 207--213."},{"key":"e_1_3_2_1_32_1","volume-title":"CVPR","author":"Torralba Antonio","year":"2011","unstructured":"Antonio Torralba and Alexei A. Efros . 2011. Unbiased look at dataset bias . In CVPR 2011 . 1521--1528. Antonio Torralba and Alexei A. Efros. 2011. Unbiased look at dataset bias. In CVPR 2011. 1521--1528."},{"key":"e_1_3_2_1_33_1","first-page":"1","article-title":"A benchmark of batch-effect correction methods for single-cell RNA sequencing data","volume":"21","author":"Nhu Tran Hoa Thi","year":"2020","unstructured":"Hoa Thi Nhu Tran 2020 . A benchmark of batch-effect correction methods for single-cell RNA sequencing data . Genome Biology 21 , 1 (Jan 2020), 12. Hoa Thi Nhu Tran et al. 2020. A benchmark of batch-effect correction methods for single-cell RNA sequencing data. Genome Biology 21, 1 (Jan 2020), 12.","journal-title":"Genome Biology"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1038\/srep39921"},{"key":"e_1_3_2_1_35_1","volume-title":"Scrnabench: A package for metamorphic benchmarking of scRNA-seq data analysis methods. https:\/\/github.com\/NWhitener\/scrnabench","author":"Whitener Nathan","year":"2023","unstructured":"Nathan Whitener and Konghao Zhao . 2023 . Scrnabench: A package for metamorphic benchmarking of scRNA-seq data analysis methods. https:\/\/github.com\/NWhitener\/scrnabench Nathan Whitener and Konghao Zhao. 2023. Scrnabench: A package for metamorphic benchmarking of scRNA-seq data analysis methods. https:\/\/github.com\/NWhitener\/scrnabench"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-017-1382-0"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.3390\/jpm13020183"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms14049"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Bin Zou et al. 2021. deepMNN: Deep Learning-Based Single-Cell RNA Sequencing Data Batch Correction Using Mutual Nearest Neighbors. Frontiers in Genetics 12 (2021).  Bin Zou et al. 2021. deepMNN: Deep Learning-Based Single-Cell RNA Sequencing Data Batch Correction Using Mutual Nearest Neighbors. Frontiers in Genetics 12 (2021).","DOI":"10.3389\/fgene.2021.708981"}],"event":{"name":"BCB '23: 14th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics","sponsor":["SIGBio ACM Special Interest Group on Bioinformatics"],"location":"Houston TX USA","acronym":"BCB '23"},"container-title":["Proceedings of the 14th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3584371.3613072","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3584371.3613072","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:28Z","timestamp":1750178788000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3584371.3613072"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,3]]},"references-count":39,"alternative-id":["10.1145\/3584371.3613072","10.1145\/3584371"],"URL":"https:\/\/doi.org\/10.1145\/3584371.3613072","relation":{},"subject":[],"published":{"date-parts":[[2023,9,3]]},"assertion":[{"value":"2023-10-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}