{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T23:33:50Z","timestamp":1784331230497,"version":"3.55.0"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2021,8,24]],"date-time":"2021-08-24T00:00:00Z","timestamp":1629763200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,24]],"date-time":"2021-08-24T00:00:00Z","timestamp":1629763200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Slovenian Research Agency Program Grant","award":["P2-0209"],"award-info":[{"award-number":["P2-0209"]}]},{"name":"BioPharm.SI"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2023,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Dimensionality reduction techniques, such as t-SNE, can construct informative visualizations of high-dimensional data. When jointly visualising multiple data sets, a straightforward application of these methods often fails; instead of revealing underlying classes, the resulting visualizations expose dataset-specific clusters. To circumvent these batch effects, we propose an embedding procedure that uses a t-SNE visualization constructed on a reference data set as a scaffold for embedding new data points. Each data instance from a new, unseen, secondary data is embedded independently and does not change the reference embedding. This prevents any interactions between instances in the secondary data and implicitly mitigates batch effects. We demonstrate the utility of this approach by analyzing six recently published single-cell gene expression data sets with up to tens of thousands of cells and thousands of genes. The batch effects in our studies are particularly strong as the data comes from different institutions using different experimental protocols. The visualizations constructed by our proposed approach are clear of batch effects, and the cells from secondary data sets correctly co-cluster with cells of the same type from the primary data. We also show the predictive power of our simple, visual classification approach in t-SNE space matches the accuracy of specialized machine learning techniques that consider the entire compendium of features that profile single cells.<\/jats:p>","DOI":"10.1007\/s10994-021-06043-1","type":"journal-article","created":{"date-parts":[[2021,8,24]],"date-time":"2021-08-24T13:07:14Z","timestamp":1629810434000},"page":"721-740","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Embedding to reference t-SNE space addresses batch effects in single-cell classification"],"prefix":"10.1007","volume":"112","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6462-9372","authenticated-orcid":false,"given":"Pavlin G.","family":"Poli\u010dar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Stra\u017ear","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bla\u017e","family":"Zupan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,8,24]]},"reference":[{"key":"6043_CR1","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/gb-2005-6-2-r21","volume":"6","author":"J Bard","year":"2005","unstructured":"Bard, J., Rhee, S. Y., & Ashburner, M. (2005). An ontology for cell types. Genome Biology, 6, 2.","journal-title":"Genome Biology"},{"issue":"4","key":"6043_CR2","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1016\/j.cels.2016.08.011","volume":"3","author":"M Baron","year":"2016","unstructured":"Baron, M., Veres, A., Wolock, S. L., Faust, A. L., Gaujoux, R., Vetere, A., et al. (2016). A single-cell transcriptomic map of the human and mouse pancreas reveals inter- and intra-cell population structure. Cell Systems, 3(4), 346\u2013360.","journal-title":"Cell Systems"},{"issue":"1","key":"6043_CR3","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1038\/nbt.4314","volume":"37","author":"E Becht","year":"2019","unstructured":"Becht, E., McInnes, L., Healy, J., Dutertre, C. A., Kwok, I. W. H., Ng, L. G., et al. (2019). Dimensionality reduction for visualizing single-cell data using UMAP. Nature Biotechnology, 37(1), 38\u201347.","journal-title":"Nature Biotechnology"},{"issue":"1","key":"6043_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-019-13055-y","volume":"10","author":"AC Belkina","year":"2019","unstructured":"Belkina, A. C., Ciccolella, C. O., Anno, R., Halpert, R., Spidlen, J., & Snyder-Cappione, J. E. (2019). Automated optimized parameters for T-distributed stochastic neighbor embedding improve visualization and analysis of large datasets. Nature Communications, 10(1), 1\u201312.","journal-title":"Nature Communications"},{"key":"6043_CR5","first-page":"2137","volume":"10","author":"S Bickel","year":"2009","unstructured":"Bickel, S., & Br\u00fcckner, M. & Scheffer, T. . (2009). Discriminative learning under covariate shift. Journal of Machine Learning Research, 10, 2137\u20132155.","journal-title":"Journal of Machine Learning Research"},{"issue":"5","key":"6043_CR6","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1038\/nbt.4096","volume":"36","author":"A Butler","year":"2018","unstructured":"Butler, A., Hoffman, P., Smibert, P., Papalexi, E., & Satija, R. (2018). Integrating single-cell transcriptomic data across different conditions, technologies, and species. Nature Biotechnology, 36(5), 411.","journal-title":"Nature Biotechnology"},{"issue":"3","key":"6043_CR7","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/nn.4495","volume":"20","author":"JN Campbell","year":"2017","unstructured":"Campbell, J. N., Macosko, E. Z., Fenselau, H., Pers, T. H., Lyubetskaya, A., Tenen, D., et al. (2017). A molecular census of arcuate hypothalamus and median eminence cell types. Nature Neuroscience, 20(3), 484.","journal-title":"Nature Neuroscience"},{"issue":"13","key":"6043_CR8","doi-asserted-by":"publisher","first-page":"3227","DOI":"10.1016\/j.celrep.2017.03.004","volume":"18","author":"R Chen","year":"2017","unstructured":"Chen, R., Xiaoji, W., Jiang, L., & Zhang, Y. (2017). Single-cell RNA-Seq reveals hypothalamic cell diversity. Cell Reports, 18(13), 3227\u20133241.","journal-title":"Cell Reports"},{"key":"6043_CR9","doi-asserted-by":"crossref","unstructured":"Cox, M. A. A., & Cox, T. F. (2008). Multidimensional scaling. In C. Chen, W. H\u00e4rdle, and A. Unwin (eds.)\u00a0Handbook of data visualization (pp. 315\u2013347). Springer","DOI":"10.1007\/978-3-540-33037-0_14"},{"issue":"10","key":"6043_CR10","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1145\/2347736.2347755","volume":"55","author":"P Domingos","year":"2012","unstructured":"Domingos, P. (2012). A few useful things to know about machine learning. Communications of the ACM, 55(10), 78\u201387.","journal-title":"Communications of the ACM"},{"key":"6043_CR11","doi-asserted-by":"crossref","unstructured":"Gopalan, R., Li, R., & Chellappa, R. (2011). Domain adaptation for object recognition: An unsupervised approach. In 2011 International conference on computer vision (pp. 999\u20131006). IEEE","DOI":"10.1109\/ICCV.2011.6126344"},{"issue":"5","key":"6043_CR12","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1038\/nbt.4091","volume":"36","author":"L Haghverdi","year":"2018","unstructured":"Haghverdi, L., Lun, Aaron T. L. L., Morgan, M. D., & Marioni, J. C. (2018). Batch effects in single-cell RNA-sequencing data are corrected by matching mutual nearest neighbors. Nature Biotechnology, 36(5), 421\u2013427.","journal-title":"Nature Biotechnology"},{"issue":"4","key":"6043_CR13","doi-asserted-by":"publisher","first-page":"562","DOI":"10.1093\/biostatistics\/kxx053","volume":"19","author":"SC Hicks","year":"2018","unstructured":"Hicks, S. C., Townes, F. W., Teng, M., & Irizarry, R. A. (2018). Missing data and technical variability in single-cell RNA-sequencing experiments. Biostatistics, 19(4), 562\u2013578.","journal-title":"Biostatistics"},{"issue":"6","key":"6043_CR14","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1038\/s41587-019-0113-3","volume":"37","author":"B Hie","year":"2019","unstructured":"Hie, B., Bryson, B., & Berger, B. (2019). Efficient integration of heterogeneous single-cell transcriptomes using Scanorama. Nature Biotechnology, 37(6), 685\u2013691.","journal-title":"Nature Biotechnology"},{"issue":"1","key":"6043_CR15","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1038\/s41593-017-0029-5","volume":"21","author":"S Hrvatin","year":"2018","unstructured":"Hrvatin, S., Hochbaum, D. R., Nagy, M. A., Cicconet, M., Robertson, K., Cheadle, L., et al. (2018). Greenberg. Single-cell analysis of experience-dependent transcriptomic states in the mouse visual cortex. Nature Neuroscience, 21(1), 120\u2013129.","journal-title":"Nature Neuroscience"},{"issue":"2","key":"6043_CR16","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1038\/nmeth.2772","volume":"11","author":"S Islam","year":"2014","unstructured":"Islam, S., Zeisel, A., Joost, S., La Manno, G., Zajac, P., Kasper, M., et al. (2014). Quantitative single-cell RNA-seq with unique molecular identifiers. Nature Methods, 11(2), 163.","journal-title":"Nature Methods"},{"issue":"4","key":"6043_CR17","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1016\/0893-6080(88)90003-2","volume":"1","author":"RA Jacobs","year":"1988","unstructured":"Jacobs, R. A. (1988). Increased rates of convergence through learning rate adaptation. Neural Networks, 1(4), 295\u2013307.","journal-title":"Neural Networks"},{"issue":"5","key":"6043_CR18","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1038\/nmeth.4644","volume":"15","author":"VY Kiselev","year":"2018","unstructured":"Kiselev, V. Y., Yiu, A., & Hemberg, M. (2018). Scmap: Projection of single-cell RNA-seq data across data sets. Nature Methods, 15(5), 359\u2013362.","journal-title":"Nature Methods"},{"issue":"1","key":"6043_CR19","doi-asserted-by":"publisher","first-page":"5416","DOI":"10.1038\/s41467-019-13056-x","volume":"10","author":"D Kobak","year":"2019","unstructured":"Kobak, D., & Berens, P. (2019). The art of using t-SNE for single-cell transcriptomics. Nature Communications, 10(1), 5416.","journal-title":"Nature Communications"},{"issue":"2","key":"6043_CR20","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1038\/s41587-020-00809-z","volume":"39","author":"D Kobak","year":"2021","unstructured":"Kobak, D., & Linderman, G. C. (2021). Initialization is critical for preserving global data structure in both t-SNE and UMAP. Nature Biotechnology, 39(2), 156\u2013157.","journal-title":"Nature Biotechnology"},{"issue":"12","key":"6043_CR21","doi-asserted-by":"publisher","first-page":"1289","DOI":"10.1038\/s41592-019-0619-0","volume":"16","author":"I Korsunsky","year":"2019","unstructured":"Korsunsky, I., Millard, N., Fan, J., Slowikowski, K., Zhang, F., Wei, K., et al. (2019). Fast, sensitive and accurate integration of single-cell data with Harmony. Nature Methods, 16(12), 1289\u20131296.","journal-title":"Nature Methods"},{"key":"6043_CR22","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1016\/j.neucom.2014.12.095","volume":"169","author":"JA Lee","year":"2015","unstructured":"Lee, J. A., Peluffo-Ord\u00f3\u00f1ez, D. H., & Verleysen, M. (2015). Multi-scale similarities in stochastic neighbour embedding: Reducing dimensionality while preserving both local and global structure. Neurocomputing, 169, 246\u2013261.","journal-title":"Neurocomputing"},{"key":"6043_CR23","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1038\/s41592-018-0308-4","volume":"16","author":"GC Linderman","year":"2019","unstructured":"Linderman, G.\u00a0C., Rachh, M., Hoskins, J.\u00a0G., Steinerberger, S. & Kluger, Y. (2019). Fast interpolation-based t-SNE for improved visualization of single-cell RNA-seq data. Nature Methods, 16(3),\u00a0243\u2013245","journal-title":"Nature Methods"},{"key":"6043_CR24","doi-asserted-by":"crossref","unstructured":"Liu, J., Huang, Y., Singh, R., Vert, J.-P. & Noble, W. S. (2019) Jointly embedding multiple single-cell omics measurements. The Workshop on Algorithms in Bioinformatics, 143","DOI":"10.1101\/644310"},{"issue":"1","key":"6043_CR25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-019-13993-7","volume":"11","author":"X Li","year":"2020","unstructured":"Li, X., Wang, K., Lyu, Y., Pan, H., Zhang, J., Stambolian, D., et al. (2020). Deep learning enables accurate clustering with batch effect removal in single-cell RNA-seq analysis. Nature Communications, 11(1), 1\u201314.","journal-title":"Nature Communications"},{"issue":"12","key":"6043_CR26","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.1038\/s41592-018-0229-2","volume":"15","author":"R Lopez","year":"2018","unstructured":"Lopez, R., Regier, J., Cole, M. B., Jordan, M. I., & Yosef, N. (2018). Deep generative modeling for single-cell transcriptomics. Nature Methods, 15(12), 1053\u20131058.","journal-title":"Nature Methods"},{"issue":"5","key":"6043_CR27","doi-asserted-by":"publisher","first-page":"1202","DOI":"10.1016\/j.cell.2015.05.002","volume":"161","author":"EZ Macosko","year":"2015","unstructured":"Macosko, E. Z., Basu, A., Satija, R., Nemesh, J., Shekhar, K., Goldman, M., et al. (2015). Highly parallel genome-wide expression profiling of individual cells using nanoliter droplets. Cell, 161(5), 1202\u20131214.","journal-title":"Cell"},{"key":"6043_CR28","doi-asserted-by":"crossref","unstructured":"McInnes, L., & Healy, J. (2018). James Melville. UMAP: Uniform manifold approximation and projection for dimension reduction. arXiv.","DOI":"10.21105\/joss.00861"},{"issue":"3","key":"6043_CR29","doi-asserted-by":"publisher","first-page":"964","DOI":"10.1093\/bioinformatics\/btz625","volume":"36","author":"K Pola\u0144ski","year":"2019","unstructured":"Pola\u0144ski, K., \u00a0Young, M.D., \u00a0Miao, Z., \u00a0Meyer, K.B., Teichmann, S.A., & Park J.E. (2019). BBKNN: fast batch alignment of single cell transcriptomes.\u00a0Bioinformatics, 36(3), 964\u2013965.","journal-title":"Bioinformatics"},{"key":"6043_CR30","doi-asserted-by":"crossref","unstructured":"Poli\u010dar, P. G., Stra\u017ear, M., & Zupan, B. (2019). OpenTSNE: A modular Python library for t-SNE dimensionality reduction and embedding. bioRxiv, 1\u20132","DOI":"10.1101\/731877"},{"key":"6043_CR31","volume-title":"Dataset shift in machine learning","author":"J Quionero-Candela","year":"2009","unstructured":"Quionero-Candela, J., Sugiyama, M., Schwaighofer, A., & Lawrence, N. D. (2009). Dataset shift in machine learning. The MIT Press."},{"issue":"7677","key":"6043_CR32","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1038\/550451a","volume":"550","author":"O Rozenblatt-Rosen","year":"2017","unstructured":"Rozenblatt-Rosen, O., Stubbington, M. J. T., Regev, A., & Teichmann, S. A. (2017). The Human Cell Atlas: From vision to reality. Nature, 550(7677), 451\u2013453.","journal-title":"Nature"},{"issue":"5","key":"6043_CR33","doi-asserted-by":"publisher","first-page":"1308","DOI":"10.1016\/j.cell.2016.07.054","volume":"166","author":"K Shekhar","year":"2016","unstructured":"Shekhar, K., Lapan, S. W., Whitney, I. E., Tran, N. M., Macosko, E. Z., Kowalczyk, M., et al. (2016). Comprehensive classification of retinal bipolar neurons by single-cell transcriptomics. Cell, 166(5), 1308-1323.e30.","journal-title":"Cell"},{"issue":"7","key":"6043_CR34","doi-asserted-by":"publisher","first-page":"1888","DOI":"10.1016\/j.cell.2019.05.031","volume":"177","author":"T Stuart","year":"2019","unstructured":"Stuart, T., Butler, A., Hoffman, P., Hafemeister, C., Papalexi, E., Mauck, W. M., et al. (2019). Comprehensive integration of single-cell data. Cell, 177(7), 1888-1902.e21.","journal-title":"Cell"},{"issue":"7729","key":"6043_CR35","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1038\/s41586-018-0654-5","volume":"563","author":"B Tasic","year":"2018","unstructured":"Tasic, B., Yao, Z., Graybuck, L. T., Smith, K. A., Nguyen, T. N., Bertagnolli, D., et al. (2018). Shared and distinct transcriptomic cell types across neocortical areas. Nature, 563(7729), 72\u201378.","journal-title":"Nature"},{"key":"6043_CR36","doi-asserted-by":"publisher","first-page":"39921","DOI":"10.1038\/srep39921","volume":"7","author":"P-Y Tung","year":"2017","unstructured":"Tung, P.-Y., Blischak, J. D., Hsiao, C. J., Knowles, D. A., Burnett, J. E., Pritchard, J. K., & Gilad, Y. (2017). Batch effects and the effective design of single-cell gene expression studies. Scientific Reports, 7, 39921.","journal-title":"Scientific Reports"},{"issue":"93","key":"6043_CR37","first-page":"3221","volume":"15","author":"L van der Maaten","year":"2014","unstructured":"van der Maaten, L. (2014). Accelerating t-SNE using tree-based algorithms. Journal of Machine Learning Research, 15(93), 3221\u20133245.","journal-title":"Journal of Machine Learning Research"},{"issue":"86","key":"6043_CR38","first-page":"2579","volume":"9","author":"L van der Maaten","year":"2008","unstructured":"van der Maaten, L., & Hinton, G. (2008). Visualizing data using t-SNE. Journal of Machine Learning Research, 9(86), 2579\u20132605.","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"6043_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-016-0043-6","volume":"3","author":"K Weiss","year":"2016","unstructured":"Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016). A survey of transfer learning. Journal of Big Data, 3(1), 1\u201340.","journal-title":"Journal of Big Data"},{"issue":"1\u20133","key":"6043_CR40","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/0169-7439(87)80084-9","volume":"2","author":"S Wold","year":"1987","unstructured":"Wold, S., Esbensen, K., & Geladi, P. (1987). Principal component analysis. Chemometrics and Intelligent Laboratory Systems, 2(1\u20133), 37\u201352.","journal-title":"Chemometrics and Intelligent Laboratory Systems"},{"issue":"1","key":"6043_CR41","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1186\/s13059-017-1382-0","volume":"19","author":"FA Wolf","year":"2018","unstructured":"Wolf, F. A., Angerer, P., & Fabian, J. (2018). Theis. SCANPY: Large-scale single-cell gene expression data analysis. Genome Biology, 19(1), 15.","journal-title":"Genome Biology"},{"issue":"4","key":"6043_CR42","doi-asserted-by":"publisher","first-page":"608","DOI":"10.1016\/j.cmet.2016.08.018","volume":"24","author":"Y Xin","year":"2016","unstructured":"Xin, Y., Kim, J., Okamoto, H., Ni, M., Wei, Y., Adler, C., et al. (2016). RNA sequencing of single human islet cells reveals type 2 diabetes genes. Cell Metabolism, 24(4), 608\u2013615.","journal-title":"Cell Metabolism"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-06043-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-021-06043-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-06043-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T03:07:13Z","timestamp":1692846433000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-021-06043-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,24]]},"references-count":42,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,2]]}},"alternative-id":["6043"],"URL":"https:\/\/doi.org\/10.1007\/s10994-021-06043-1","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/671404","asserted-by":"object"}]},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,24]]},"assertion":[{"value":"14 February 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 June 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 July 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 August 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}