{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T02:20:17Z","timestamp":1775787617409,"version":"3.50.1"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T00:00:00Z","timestamp":1714089600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T00:00:00Z","timestamp":1714089600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100023452","name":"Hanarth Fonds","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100023452","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Numerous transcriptomic-based models have been developed to predict or understand the fundamental mechanisms driving biological phenotypes. However, few models have successfully transitioned into clinical practice due to challenges associated with generalizability and interpretability. To address these issues, researchers have turned to dimensionality reduction methods and have begun implementing transfer learning approaches.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>In this study, we aimed to determine the optimal combination of dimensionality reduction and regularization methods for predictive modeling. We applied seven dimensionality reduction methods to various datasets, including two supervised methods (linear optimal low-rank projection and low-rank canonical correlation analysis), two unsupervised methods [principal component analysis and consensus independent component analysis (c-ICA)], and three methods [autoencoder (AE), adversarial variational autoencoder, and c-ICA] within a transfer learning framework, trained on\u2009&gt;\u2009140,000 transcriptomic profiles. To assess the performance of the different combinations, we used a cross-validation setup encapsulated within a permutation testing framework, analyzing 30 different transcriptomic datasets with binary phenotypes. Furthermore, we included datasets with small sample sizes and phenotypes of varying degrees of predictability, and we employed independent datasets for validation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Our findings revealed that regularized models without dimensionality reduction achieved the highest predictive performance, challenging the necessity of dimensionality reduction when the primary goal is to achieve optimal predictive performance. However, models using AE and c-ICA with transfer learning for dimensionality reduction showed comparable performance, with enhanced interpretability and robustness of predictors, compared to models using non-dimensionality-reduced data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>These findings offer valuable insights into the optimal combination of strategies for enhancing the predictive performance, interpretability, and generalizability of transcriptomic-based models.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12859-024-05795-6","type":"journal-article","created":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T06:02:51Z","timestamp":1714111371000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Exploring combinations of dimensionality reduction, transfer learning, and regularization methods for predicting binary phenotypes with transcriptomic data"],"prefix":"10.1186","volume":"25","author":[{"given":"S. R.","family":"Oshternian","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S.","family":"Loipfinger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Bhattacharya","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"R. S. N.","family":"Fehrmann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,4,26]]},"reference":[{"key":"5795_CR1","doi-asserted-by":"publisher","first-page":"1422","DOI":"10.3390\/ijms22031422","volume":"22","author":"S Supplitt","year":"2021","unstructured":"Supplitt S, Karpinski P, Sasiadek M, et al. Current achievements and applications of transcriptomics in personalized cancer medicine. Int J Mol Sci. 2021;22:1422.","journal-title":"Int J Mol Sci"},{"key":"5795_CR2","doi-asserted-by":"publisher","first-page":"737","DOI":"10.1007\/s40745-019-00209-4","volume":"6","author":"T Sirimongkolkasem","year":"2019","unstructured":"Sirimongkolkasem T, Drikvandi R. On regularisation methods for analysis of high dimensional data. Ann Data Sci. 2019;6:737\u201363.","journal-title":"Ann Data Sci"},{"key":"5795_CR3","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1037\/h0071325","volume":"24","author":"H Hotelling","year":"1933","unstructured":"Hotelling H. Analysis of a complex of statistical variables into principal components. J Educ Psychol. 1933;24:417\u201341.","journal-title":"J Educ Psychol"},{"key":"5795_CR4","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1016\/S0893-6080(00)00026-5","volume":"13","author":"A Hyv\u00e4rinen","year":"2000","unstructured":"Hyv\u00e4rinen A, Oja E. Independent component analysis: algorithms and applications. Neural Netw. 2000;13:411\u201330.","journal-title":"Neural Netw"},{"key":"5795_CR5","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1126\/science.1127647","volume":"313","author":"GE Hinton","year":"2006","unstructured":"Hinton GE, Salakhutdinov RR. Reducing the dimensionality of data with neural networks. Science. 2006;313:504\u20137.","journal-title":"Science"},{"issue":"1","key":"5795_CR6","doi-asserted-by":"publisher","first-page":"2872","DOI":"10.1038\/s41467-021-23102-2","volume":"12","author":"JT Vogelstein","year":"2021","unstructured":"Vogelstein JT, Bridgeford EW, et al. Supervised dimensionality reduction for big data. Nat Commun. 2021;12(1):2872.","journal-title":"Nat Commun"},{"key":"5795_CR7","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1080\/00949650903222343","volume":"81","author":"H Shin","year":"2011","unstructured":"Shin H, Eubank RL. Unit canonical correlations and high-dimensional discriminant analysis. J Stat Comput Simul. 2011;81:167\u201378.","journal-title":"J Stat Comput Simul"},{"key":"5795_CR8","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1186\/s12859-022-04807-7","volume":"23","author":"B Hanczar","year":"2022","unstructured":"Hanczar B, Bourgeais V, Zehraoui F. Assessment of deep learning and transfer learning for cancer prediction based on gene expression data. BMC Bioinform. 2022;23:262.","journal-title":"BMC Bioinform"},{"key":"5795_CR9","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"R Tibshirani","year":"1996","unstructured":"Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc B Stat Methodol. 1996;58:267\u201388.","journal-title":"J R Stat Soc B Stat Methodol"},{"key":"5795_CR10","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1080\/00401706.1970.10488634","volume":"12","author":"AE Hoerl","year":"1970","unstructured":"Hoerl AE, Kennard RW. Ridge regression: biased estimation for nonorthogonal problems. Technometrics. 1970;12:55\u201367.","journal-title":"Technometrics"},{"key":"5795_CR11","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","volume":"67","author":"H Zou","year":"2005","unstructured":"Zou H, Hastie T. Regularization and variable selection via the elastic net. J R Stat Soc B Stat Methodol. 2005;67:301\u201320.","journal-title":"J R Stat Soc B Stat Methodol"},{"key":"5795_CR12","doi-asserted-by":"publisher","first-page":"D991","DOI":"10.1093\/nar\/gks1193","volume":"41","author":"T Barrett","year":"2013","unstructured":"Barrett T, Wilhite SE, Ledoux P, et al. NCBI GEO: archive for functional genomics data sets\u2013update. Nucleic Acids Res. 2013;41:D991-995.","journal-title":"Nucleic Acids Res"},{"key":"5795_CR13","unstructured":"Wright L. Ranger\u2014a synergistic optimizer. GitHub repository; 2019."},{"key":"5795_CR14","first-page":"1","volume":"2020","author":"P Munjal","year":"2020","unstructured":"Munjal P, Paul A, Krishnan N. Implicit discriminator in variational autoencoder. IJCNN. 2020;2020:1\u20138.","journal-title":"IJCNN"},{"key":"5795_CR15","first-page":"80","volume":"23","author":"GP Way","year":"2018","unstructured":"Way GP, Greene CS. Extracting a biologically relevant latent space from cancer transcriptomes with variational autoencoders. Pac Symp Biocomput. 2018;23:80\u201391.","journal-title":"Pac Symp Biocomput"},{"key":"5795_CR16","doi-asserted-by":"crossref","unstructured":"Hershey JR, Olsen PA. Approximating the Kullback Leibler divergence between gaussian mixture models. In: ICASSP'07; 2007. p. IV-317\u201320.","DOI":"10.1109\/ICASSP.2007.366913"},{"key":"5795_CR17","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1038\/s41467-020-14605-5","volume":"11","author":"A Bhattacharya","year":"2020","unstructured":"Bhattacharya A, Bense RD, Urz\u00faa-Traslavi\u00f1a CG, et al. Transcriptional effects of copy number alterations in a large set of human cancers. Nat Commun. 2020;11:715.","journal-title":"Nat Commun"},{"key":"5795_CR18","doi-asserted-by":"publisher","first-page":"1090","DOI":"10.1089\/cmb.2004.11.1090","volume":"11","author":"P Chiappetta","year":"2004","unstructured":"Chiappetta P, Roubaud MC, Torr\u00e9sani B. Blind source separation and the analysis of microarray data. J Comput Biol. 2004;11:1090\u2013109.","journal-title":"J Comput Biol"},{"key":"5795_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v033.i01","volume":"33","author":"JH Friedman","year":"2010","unstructured":"Friedman JH, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. 2010;33:1\u201322.","journal-title":"J Stat Softw"},{"key":"5795_CR20","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/s12864-019-6413-7","volume":"21","author":"D Chicco","year":"2020","unstructured":"Chicco D, Jurman G. The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genomics. 2020;21:6.","journal-title":"BMC Genomics"},{"key":"5795_CR21","unstructured":"Powers DMW. Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation; 2020."},{"key":"5795_CR22","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/BF01908075","volume":"2","author":"L Hubert","year":"1985","unstructured":"Hubert L, Arabie P. Comparing partitions. J Classif. 1985;2:193\u2013218.","journal-title":"J Classif"},{"issue":"1","key":"5795_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1175\/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2","volume":"78","author":"GW Brier","year":"1950","unstructured":"Brier GW. Verification of forecasts expressed in terms of probability. Mon Weather Rev. 1950;78(1):1\u20133.","journal-title":"Mon Weather Rev"},{"key":"5795_CR24","doi-asserted-by":"publisher","first-page":"78368","DOI":"10.1109\/ACCESS.2021.3084050","volume":"9","author":"D Chicco","year":"2021","unstructured":"Chicco D, Warrens MJ, Jurman G. The Matthews correlation coefficient (MCC) is more informative than Cohen\u2019s kappa and Brier score in binary classification assessment. IEEE Access. 2021;9:78368\u201381.","journal-title":"IEEE Access"},{"key":"5795_CR25","doi-asserted-by":"publisher","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","volume":"35","author":"Y Bengio","year":"2013","unstructured":"Bengio Y, Courville A, Vincent P. Representation learning: a review and new perspectives. TPAMl. 2013;35:1798\u2013828.","journal-title":"TPAMl"},{"issue":"3","key":"5795_CR26","doi-asserted-by":"publisher","first-page":"2663","DOI":"10.1007\/s40747-021-00637-x","volume":"8","author":"W Jia","year":"2022","unstructured":"Jia W, Sun M, Lian J, Hou S. Feature dimensionality reduction: a review. Complex Intell Syst. 2022;8(3):2663\u201393.","journal-title":"Complex Intell Syst"},{"key":"5795_CR27","doi-asserted-by":"publisher","first-page":"1464","DOI":"10.1038\/s41467-021-21671-w","volume":"12","author":"CG Urz\u00faa-Traslavi\u00f1a","year":"2021","unstructured":"Urz\u00faa-Traslavi\u00f1a CG, Leeuwenburgh VC, Bhattacharya A, et al. Improving gene function predictions using independent transcriptional components. Nat Commun. 2021;12:1464.","journal-title":"Nat Commun"},{"key":"5795_CR28","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1155\/JBB.2005.147","volume":"2005","author":"D Ghosh","year":"2005","unstructured":"Ghosh D, Chinnaiyan AM. Classification and selection of biomarkers in genomic data using lasso. J Biomed Biotechnol. 2005;2005:147\u201354.","journal-title":"J Biomed Biotechnol"},{"key":"5795_CR29","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1186\/s12859-020-03836-4","volume":"21","author":"B Hanczar","year":"2020","unstructured":"Hanczar B, Zehraoui F, Issa T, et al. Biological interpretation of deep neural network for phenotype prediction based on gene expression. BMC Bioinform. 2020;21:501.","journal-title":"BMC Bioinform"},{"key":"5795_CR30","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1186\/s12859-018-2338-4","volume":"19","author":"W Zhou","year":"2018","unstructured":"Zhou W, Altman RB. Data-driven human transcriptomic modules determined by independent component analysis. BMC Bioinform. 2018;19:327.","journal-title":"BMC Bioinform"},{"key":"5795_CR31","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1186\/1471-2105-11-567","volume":"11","author":"C Bartenhagen","year":"2010","unstructured":"Bartenhagen C, Klein HU, Ruckert C, et al. Comparative study of unsupervised dimension reduction techniques for the visualization of microarray gene expression data. BMC Bioinform. 2010;11:567.","journal-title":"BMC Bioinform"},{"key":"5795_CR32","doi-asserted-by":"publisher","DOI":"10.1016\/j.health.2022.100125","volume":"3","author":"MF Kabir","year":"2023","unstructured":"Kabir MF, Chen T, Ludwig SA. A performance analysis of dimensionality reduction algorithms in machine learning models for cancer prediction. Healthc Anal. 2023;3: 100125.","journal-title":"Healthc Anal"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-024-05795-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-024-05795-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-024-05795-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T06:04:54Z","timestamp":1714111494000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-024-05795-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,26]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["5795"],"URL":"https:\/\/doi.org\/10.1186\/s12859-024-05795-6","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-3398654\/v1","asserted-by":"object"}]},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,26]]},"assertion":[{"value":"29 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 April 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"None of the authors have any conflict of interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"167"}}