{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T12:03:26Z","timestamp":1762344206769,"version":"build-2065373602"},"reference-count":57,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T00:00:00Z","timestamp":1762300800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T00:00:00Z","timestamp":1762300800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BioData Mining"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background and Objective<\/jats:title>\n                    <jats:p>Estimating individualized causal effects plays a vital role in data-driven decision-making, especially in high-risk domains such as public health. However, current causal inference models often lack flexibility and generalizability due to the tight coupling between representation learning and effect estimation. This study aims to develop a modular and adaptive framework to enhance the analysis of individualized causal effects in complex health data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We propose CAUSALRLSTACK, a modular framework designed to separate representation learning from causal effect estimation. In practice, the model uses a memory-augmented Transformer (TITAN) to capture complex, individualized representations. It is further paired with a doubly robust estimator(DRLearner) to improve the treatment effect estimation. A reinforcement learning agent adjusts how much each component contributes by assigning instance-specific weights. This adaptive weighting process improves the model\u2019s ability to generalize across different populations. Input features are derived from causal graphs, automatically chosen between an expert-defined graph and one discovered from data. To evaluate performance, we applied the framework to two publicly available HIV datasets that reflect community-level testing behavior and post-intervention clinical outcomes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>CAUSALRLSTACK outperforms six state-of-the-art causal inference models across both datasets, achieving the highest accuracy (0.861 and 0.855), F1-Score (0.845 and 0.839), and AUC-ROC (0.897 and 0.892). It also achieves the lowest predictive uncertainty (0.093 and 0.092), indicating robust performance in estimating treatment effects.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The proposed framework offers a flexible and effective solution for individualized causal inference. Its modular architecture and reinforcement learning-based weighting strategy enable adaptive, data-driven estimation across diverse populations. Strong experimental results demonstrate the potential of the framework to advance individualized causal inference in health data and provide a practical basis for designing personalized intervention strategies in HIV and broader public health domains.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13040-025-00492-3","type":"journal-article","created":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T11:59:07Z","timestamp":1762343947000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["CAUSALRLSTACK: adaptive balancing of deep representation and causal effect estimation with application to HIV-related health data"],"prefix":"10.1186","volume":"18","author":[{"given":"Dat Thanh","family":"Pham","sequence":"first","affiliation":[]},{"given":"Khai Quang","family":"Tran","sequence":"additional","affiliation":[]},{"given":"Viet Anh","family":"Nguyen","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,11,5]]},"reference":[{"key":"492_CR1","volume-title":"Causal inference: what if","author":"MA Hern\u00e1n","year":"2020","unstructured":"Hern\u00e1n MA, Robins JM. Causal inference: what if. Boca Raton, FL: Chapman & Hall\/CRC; 2020."},{"key":"492_CR2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511803161","volume-title":"Causality: models, reasoning, and inference","author":"J Pearl","year":"2009","unstructured":"Pearl J. Causality: models, reasoning, and inference. 2nd edn. Cambridge, UK: Cambridge University Press; 2009.","edition":"2nd edn"},{"key":"492_CR3","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/B978-0-444-53592-4.00002-1","volume-title":"Handbook of health economics","author":"MA Hern\u00e1n","year":"2011","unstructured":"Hern\u00e1n MA. Causal inference for personalized medicine. In: Pauly MV, McGuire TG, Barros PP, editors. Handbook of health economics. Vol. 2. Amsterdam: Elsevier; 2011. p. 181\u2013206. https:\/\/doi.org\/10.1016\/B978-0-444-53592-4.00002-1."},{"key":"492_CR4","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/B978-0-444-53592-4.00002-1","volume-title":"Handbook of health economics","author":"RH Dehejia","year":"2011","unstructured":"Dehejia RH, Lleras-Muney A. Causal inference for personalized medicine. In: Pauly MV, McGuire TG, Barros PP, editors. Handbook of health economics. Vol. 2. Amsterdam: Elsevier; 2011. p. 181\u2013206. https:\/\/doi.org\/10.1016\/B978-0-444-53592-4.00002-1."},{"issue":"1","key":"492_CR5","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1097\/QAD.0b013e3283324283","volume":"24","author":"H-C Collaboration","year":"2010","unstructured":"Collaboration H-C. The effect of combined antiretroviral therapy on the overall mortality of hiv-infected individuals. AIDS. 2010;24(1):123\u201337. https:\/\/doi.org\/10.1097\/QAD.0b013e3283324283.","journal-title":"AIDS"},{"issue":"1","key":"492_CR6","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1093\/aje\/kwad097","volume":"193","author":"A Sewak","year":"2024","unstructured":"Sewak A, Lodi S, Li X, Shu D, Wen L, Mayer KH, Krakower D, Young J, Marcus JL. Causal effects of stochastic prep interventions on hiv incidence among men who have sex with men. Am J Epidemiol. 2024;193(1):6\u201316. https:\/\/doi.org\/10.1093\/aje\/kwad097.","journal-title":"Am J Epidemiol"},{"key":"492_CR7","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/j.drugalcdep.2014.09.516","volume":"146","author":"B Nosyk","year":"2015","unstructured":"Nosyk B, Min JE, Colley G, Lima VD. The causal effect of opioid substitution treatment on highly active antiretroviral treatment adherence. Drug Alcohol Depen. 2015;146:53\u201354. https:\/\/doi.org\/10.1016\/j.drugalcdep.2014.09.516.","journal-title":"Drug Alcohol Depen"},{"key":"492_CR8","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal inference for statistics, social, and biomedical sciences","author":"GW Imbens","year":"2015","unstructured":"Imbens GW, Rubin DB. Causal inference for statistics, social, and biomedical sciences. Cambridge, UK: Cambridge University Press; 2015. https:\/\/doi.org\/10.1017\/CBO9781139025751."},{"issue":"5","key":"492_CR9","doi-asserted-by":"publisher","first-page":"612","DOI":"10.1109\/JPROC.2021.3058954","volume":"109","author":"B Sch\u00f6lkopf","year":"2021","unstructured":"Sch\u00f6lkopf B, Locatello F, Bauer S, Ke NR, Kalchbrenner N, Goyal A, Bengio Y. Toward causal representation learning. Proc IEEE. 2021;109(5):612\u201334. https:\/\/doi.org\/10.1109\/JPROC.2021.3058954.","journal-title":"Proc IEEE"},{"key":"492_CR10","volume-title":"Elements of causal inference: foundations and learning algorithms","author":"J Peters","year":"2017","unstructured":"Peters J, Janzing D, Sch\u00f6lkopf B. Elements of causal inference: foundations and learning algorithms. Cambridge, MA: MIT Press; 2017."},{"issue":"1","key":"492_CR11","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1093\/aje\/kwad097","volume":"193","author":"A Sewak","year":"2024","unstructured":"Sewak A, Lodi S, Li X, Shu D, Wen L, Mayer KH, Krakower DS, Young JG, Marcus JL. Causal effects of stochastic prep interventions on hiv incidence among men who have sex with men. Am J Epidemiol. 2024;193(1):6\u201316. https:\/\/doi.org\/10.1093\/aje\/kwad097.","journal-title":"Am J Epidemiol"},{"issue":"3","key":"492_CR12","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1177\/09622802221146311","volume":"32","author":"L Wen","year":"2023","unstructured":"Wen L, Marcus JL, Young JG. Intervention treatment distributions that depend on the observed treatment process and model double robustness in causal survival analysis. Stat Methods Med Res. 2023;32(3):509\u201323. https:\/\/doi.org\/10.1177\/09622802221146311.","journal-title":"Stat Methods Med Res"},{"key":"492_CR13","doi-asserted-by":"publisher","first-page":"107161","DOI":"10.1016\/j.cmpb.2022.107161","volume":"226","author":"M Z\u00eddek","year":"2022","unstructured":"Z\u00eddek M, Titman AC, Witte JS, Peto J, Keogh. R.H.: causalcmprsk: an r package for nonparametric and cox-based estimation of average treatment effects in competing risks data. Comput Met Programs Biomed. 2022;226:107161. https:\/\/doi.org\/10.1016\/j.cmpb.2022.107161.","journal-title":"Comput Met Programs Biomed"},{"issue":"9","key":"492_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3528008","volume":"55","author":"L Yao","year":"2022","unstructured":"Yao L, Chu Z, Li S, Li Y, Gao J, Zhang A. A survey on causal inference. ACM Comput Surv. 2022;55(9):1\u201338. https:\/\/doi.org\/10.1145\/3528008.","journal-title":"ACM Comput Surv"},{"issue":"46","key":"492_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.34133\/research.0467","volume":"2024","author":"L Jiao","year":"2024","unstructured":"Jiao L, et al. Causal inference meets deep learning: a comprehensive survey. Research. 2024;2024(46):1\u201330. https:\/\/doi.org\/10.34133\/research.0467.","journal-title":"Research"},{"key":"492_CR16","doi-asserted-by":"publisher","first-page":"108810","DOI":"10.1016\/j.cmpb.2025.108810","volume":"268","author":"M Jantscher","year":"2025","unstructured":"Jantscher M, Gunzer F, Reishofer G, Kern R. Causal insights from clinical information in radiology: enhancing future multimodal ai development. Comput Met Programs Biomed. 2025;268:108810. https:\/\/doi.org\/10.1016\/j.cmpb.2025.108810.","journal-title":"Comput Met Programs Biomed"},{"key":"492_CR17","doi-asserted-by":"publisher","first-page":"107175","DOI":"10.1016\/j.cmpb.2022.107175","volume":"226","author":"J Chu","year":"2022","unstructured":"Chu J, Zhang Y, Huang F, Si L, Huang S, Huang Z. Disentangled representation for sequential treatment effect estimation. Comput Met Programs Biomed. 2022;226:107175. https:\/\/doi.org\/10.1016\/j.cmpb.2022.107175.","journal-title":"Comput Met Programs Biomed"},{"issue":"1","key":"492_CR18","doi-asserted-by":"publisher","first-page":"70011","DOI":"10.1002\/mpr.70011","volume":"34","author":"R Susukida","year":"2025","unstructured":"Susukida R, Amin-Esmaeili M, Badillo-Goicoechea E, Nguyen TQ, Stuart EA, Rosenblum M, Dunn KE, Mojtabai R. Application of causal forest model to examine treatment effect heterogeneity in substance use disorder psychosocial treatments. Int J Methods In Psychiatric Res. 2025;34(1):70011. https:\/\/doi.org\/10.1002\/mpr.70011.","journal-title":"Int J Methods In Psychiatric Res"},{"issue":"1","key":"492_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/ectj.12097","volume":"21","author":"V Chernozhukov","year":"2018","unstructured":"Chernozhukov V, Chetverikov D, Demirer M, Duflo E, Hansen C, Newey W, Robins J. Double\/Debiased machine learning for treatment and causal parameters. Econom J. 2018;21(1):1\u201368. https:\/\/doi.org\/10.1111\/ectj.12097.","journal-title":"Econom J"},{"key":"492_CR20","unstructured":"Oprescu M, Syrgkanis V, Wu ZS. In: Chaudhuri K, Salakhutdinov R, editors. Amortized inference for heterogeneous treatment effects. Proceedings of the 36th International Conference on Machine Learning. Proceedings of Machine Learning Research. Long Beach, California, USA: PMLR; 2019, pp. 4932\u201341, vol. 97."},{"issue":"10","key":"492_CR21","doi-asserted-by":"publisher","first-page":"4156","DOI":"10.1073\/pnas.1804597116","volume":"116","author":"SR K\u00fcnzel","year":"2019","unstructured":"K\u00fcnzel SR, Sekhon JS, Bickel PJ, Yu B. Meta-learners for estimating heterogeneous treatment effects using machine learning. Proc Natl Acad Sci, India, Sect B Biol Sci. 2019;116(10):4156\u201365. https:\/\/doi.org\/10.1073\/pnas.1804597116.","journal-title":"Proc Natl Acad Sci, India, Sect B Biol Sci"},{"issue":"3","key":"492_CR22","doi-asserted-by":"publisher","first-page":"005010","DOI":"10.1161\/CIRCOUTCOMES.118.005010","volume":"12","author":"T Duan","year":"2019","unstructured":"Duan T, Rajpurkar P, Liao D, Natarajan AY, Basu S. Clinical value of predicting individual treatment effects for intensive blood pressure therapy: a machine learning experiment to estimate treatment effects from randomized trial data. Circ Cardiovasc Qual Outcomes. 2019;12(3):005010. https:\/\/doi.org\/10.1161\/CIRCOUTCOMES.118.005010.","journal-title":"Circ Cardiovasc Qual Outcomes"},{"key":"492_CR23","doi-asserted-by":"publisher","first-page":"6446","DOI":"10.5555\/3295222.3295391","volume-title":"Advances in neural information processing systems (NeurIPS)","author":"C Louizos","year":"2017","unstructured":"Louizos C, Shalit U, Mooij JM, Sontag D, Zemel R, Welling M. Causal effect inference with deep latent-variable models. In: Advances in neural information processing systems (NeurIPS). Vol. 30. Long Beach, California, USA: Curran Associates, Inc; 2017. p. 6446\u201356. https:\/\/doi.org\/10.5555\/3295222.3295391."},{"key":"492_CR24","doi-asserted-by":"publisher","unstructured":"Wang R, Liu Y, Cao Y, Yao L. Causality-aware transformer networks for robotic navigation. arXiv preprint arXiv:2409.02669 (2024). https:\/\/doi.org\/10.48550\/arXiv.2409.02669.","DOI":"10.48550\/arXiv.2409.02669"},{"issue":"2","key":"492_CR25","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1097\/COH.0000000000000345","volume":"12","author":"N Haber","year":"2017","unstructured":"Haber N, Pillay D, Porter K, B\u00e4rnighausen T. Cascade of hiv diagnosis and care in sub-saharan africa: a systematic review. Curr Opin HIV AIDS. 2017;12(2):111\u201319. https:\/\/doi.org\/10.1097\/COH.0000000000000345.","journal-title":"Curr Opin HIV AIDS"},{"key":"492_CR26","doi-asserted-by":"publisher","unstructured":"Cheng D, Li J, Liu L, Liu J, Le TD. Data-driven causal effect estimation based on graphical causal modelling: a survey. ACM Comput Surv. 2024;57. https:\/\/doi.org\/10.1145\/3636423.","DOI":"10.1145\/3636423"},{"key":"492_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TNNLS.2021.3133337","volume":"99","author":"D Cheng","year":"2022","unstructured":"Cheng D, Li J, Liu L, Yu K, Le TD, Liu J. Toward unique and unbiased causal effect estimation from data with hidden variables. IEEE Trans on Neural Networks and Learn Syst. 2022;99:1\u201313. https:\/\/doi.org\/10.1109\/TNNLS.2021.3133337.","journal-title":"IEEE Trans On Neural Networks And Learn Syst"},{"key":"492_CR28","unstructured":"Xu Z, Cheng D, Li J, Liu J, Liu L, Yu K. Causal inference with conditional front-door adjustment and identifiable variational autoencoder. International Conference on Learning Representations (ICLR). 2024."},{"key":"492_CR29","doi-asserted-by":"publisher","unstructured":"Xu Z, Cheng D, Li J, Liu J, Liu L, Wang K. Disentangled representation for causal mediation analysis. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37:10666\u201374. https:\/\/doi.org\/10.1609\/aaai.v37i9.26266.","DOI":"10.1609\/aaai.v37i9.26266"},{"key":"492_CR30","doi-asserted-by":"publisher","unstructured":"Renero J, Ochoa I, Maestre R. Rex: causal discovery based on machine learning and explainability techniques. arXiv preprint arXiv:2501.12706 2025. https:\/\/doi.org\/10.48550\/arXiv.2501.12706.","DOI":"10.48550\/arXiv.2501.12706"},{"issue":"2","key":"492_CR31","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1093\/ije\/dyaa213","volume":"50","author":"PWG Tennant","year":"2021","unstructured":"Tennant PWG, Murray EJ, Arnold KF, Berrie L, Fox MP, Gadd SC, Kaplun IA, Keogh RH, Lawn RBMorris TP, et al. Use of directed acyclic graphs (dags) to identify confounders in applied health research: review and recommendations. Int J Epidemiol. 2021;50(2):620\u201332. https:\/\/doi.org\/10.1093\/ije\/dyaa213.","journal-title":"Int J Epidemiol"},{"issue":"6","key":"492_CR32","doi-asserted-by":"publisher","first-page":"1887","DOI":"10.1093\/ije\/dyw341","volume":"45","author":"J Textor","year":"2016","unstructured":"Textor J, Zander B, Gilthorpe MS, Liskiewicz M, Ellison GTH. Robust causal inference using directed acyclic graphs: there package dagitty. Int J Epidemiol. 2016;45(6):1887\u201394. https:\/\/doi.org\/10.1093\/ije\/dyw341.","journal-title":"Int J Epidemiol"},{"issue":"1","key":"492_CR33","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1097\/00001648-199901000-00008","volume":"10","author":"S Greenland","year":"1999","unstructured":"Greenland S, Pearl J, Robins JM. Causal diagrams for epidemiologic research. Epidemiology. 1999;10(1):37\u201348. https:\/\/doi.org\/10.1097\/00001648-199901000-00008.","journal-title":"Epidemiology"},{"key":"492_CR34","doi-asserted-by":"publisher","unstructured":"Behrouz A, Zhong P, Mirrokni V. Titans: learning to memorize at test time. arXiv preprint arXiv:2501.00663 2024. https:\/\/doi.org\/10.48550\/arXiv.2501.00663.","DOI":"10.48550\/arXiv.2501.00663"},{"issue":"2","key":"492_CR35","doi-asserted-by":"publisher","first-page":"3008","DOI":"10.1214\/23-EJS2157","volume":"17","author":"EH Kennedy","year":"2023","unstructured":"Kennedy EH. Towards optimal doubly robust estimation of heterogeneous causal effects. Electron J Stat. 2023;17(2):3008\u201349. https:\/\/doi.org\/10.1214\/23-EJS2157.","journal-title":"Electron J Stat"},{"key":"492_CR36","doi-asserted-by":"publisher","unstructured":"Song H, Chen Q, Jiang T, Li Y, Li X, Xi W, Huang S. Applying ensemble models based on graph neural network and reinforcement learning for wind power forecasting. arXiv preprint arXiv:2501.16591 2025. https:\/\/doi.org\/10.48550\/arXiv.2501.16591.","DOI":"10.48550\/arXiv.2501.16591"},{"key":"492_CR37","unstructured":"Mesafint D. EDHS HIV\/AIDS dataset. 2022. https:\/\/www.kaggle.com\/datasets\/danielmesafint1985\/edhs-HIVAIDS-dataset. Accessed: 2025-05-07."},{"key":"492_CR38","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/978-981-16-2934-1_7","volume-title":"Data management, analytics and innovation. Lecture notes on data engineering and communications technologies","author":"DM Belete","year":"2021","unstructured":"Belete DM, Huchaiah MD. Performance evaluation of classification models for HIV\/AIDS dataset. In: Data management, analytics and innovation. Lecture notes on data engineering and communications technologies. Vol. 70. Pune, India: Springer; 2021. p. 109\u201325. https:\/\/doi.org\/10.1007\/978-981-16-2934-1_7."},{"issue":"7","key":"492_CR39","doi-asserted-by":"publisher","first-page":"368","DOI":"10.14569\/IJACSA.2021.0120745","volume":"12","author":"DM Belete","year":"2021","unstructured":"Belete DM, Huchaiah MD. Wrapper based feature selection techniques on EDHS-HIV\/AIDS dataset. Int J Multiling Adv Comput Sci Appl (IJACSA). 2021;12(7):368\u201374. https:\/\/doi.org\/10.14569\/IJACSA.2021.0120745.","journal-title":"Int J Multiling Adv Comput Sci Appl (IJACSA)"},{"key":"492_CR40","unstructured":"Velu A. AIDS virus infection prediction. 2022;2025\u201305\u201307. Accessed: https:\/\/www.kaggle.com\/datasets\/aadarshvelu\/AIDS-virus-infection-prediction."},{"issue":"15","key":"492_CR41","doi-asserted-by":"publisher","first-page":"1081","DOI":"10.1056\/NEJM199610103351501","volume":"335","author":"SM Hammer","year":"1996","unstructured":"Hammer SM, Katzenstein DA, Hughes MD, Gundacker H, Schooley RT, Haubrich R, Henry WK, Lederman MM, Phair JP, Niu M, Hirsch MS, Merigan. T.C. A trial comparing nucleoside monotherapy with combination therapy in hiv-infected adults with cd4 cell counts from 200 to 500 per cubic millimeter. NEJM Evid. 1996;335(15):1081\u201390. https:\/\/doi.org\/10.1056\/NEJM199610103351501.","journal-title":"NEJM Evid"},{"key":"492_CR42","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","volume":"16","author":"NV Chawla","year":"2002","unstructured":"Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. Smote: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321\u201357. https:\/\/doi.org\/10.1613\/jair.953.","journal-title":"J Artif Intell Res"},{"key":"492_CR43","doi-asserted-by":"publisher","unstructured":"Lundberg SM, Lee. S.-I.: a unified approach to interpreting model predictions. Adv Neural Inf Process Syst. 2017;30. https:\/\/doi.org\/10.5555\/3295222.3295230.","DOI":"10.5555\/3295222.3295230"},{"issue":"32","key":"492_CR44","first-page":"1","volume":"17","author":"JM Mooij","year":"2016","unstructured":"Mooij JM, Peters J, Janzing D, Zscheischler J, Sch\u00f6lkopf B:. Distinguishing cause from effect using observational data: methods and benchmarks. J Mach Learn Res. 2016;17(32):1\u2013102.","journal-title":"J Mach Learn Res"},{"key":"492_CR45","doi-asserted-by":"publisher","first-page":"5998","DOI":"10.5555\/3295222.3295349","volume":"30","author":"A Vaswani","year":"2017","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I. Attention is all you need. Adv Neural Inf Process Syst. 2017;30:5998\u20136008. https:\/\/doi.org\/10.5555\/3295222.3295349.","journal-title":"Adv Neural Inf Process Syst"},{"key":"492_CR46","unstructured":"Mao A, Mohri M, Zhong Y. Cross-entropy loss functions: theoretical analysis and applications. Proceedings of the 40th International Conference on Machine Learning (ICML). Proceedings of Machine Learning Research. Honolulu, Hawaii, USA: PMLR; 2023, pp. 23803\u201328, vol. 202."},{"key":"492_CR47","unstructured":"Shalit U, Johansson FD, Sontag D. Estimating individual treatment effect: generalization bounds and algorithms. International Conference on Machine Learning. PMLR; 2017, pp. 3076\u201385."},{"key":"492_CR48","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"2018","unstructured":"Sutton RS, Barto AG. Reinforcement learning: an introduction. 2nd edn. Cambridge, Massachusetts, USA: MIT Press; 2018.","edition":"2nd edn"},{"key":"492_CR49","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316887","volume-title":"Markov decision processes: discrete stochastic dynamic programming","author":"ML Puterman","year":"1994","unstructured":"Puterman ML. Markov decision processes: discrete stochastic dynamic programming. New York: John Wiley & Sons; 1994."},{"key":"492_CR50","first-page":"1008","volume":"12","author":"VR Konda","year":"1999","unstructured":"Konda VR, Tsitsiklis JN. Actor-critic algorithms. Adv Neural Inf Process Syst. 1999;12:1008\u201314.","journal-title":"Adv Neural Inf Process Syst"},{"issue":"7540","key":"492_CR51","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G, Petersen S, Beattie C, Sadik A, Antonoglou I, King H, Kumaran D, Wierstra D, Legg S, Hassabis D. Human-level control through deep reinforcement learning. Nature. 2015;518(7540):529\u201333. https:\/\/doi.org\/10.1038\/nature14236.","journal-title":"Nature"},{"key":"492_CR52","unstructured":"Fujimoto S, Hoof H, Meger D. Addressing function approximation error in actor-critic methods. Proceedings of the 35th International Conference on Machine Learning. PMLR; 2018, pp. 1582\u201391."},{"key":"492_CR53","unstructured":"Zhang S, Yao H, Whiteson S. Breaking the deadly triad with a target network. International Conference on Machine Learning. PMLR; 2021, pp. 12492\u2013502."},{"key":"492_CR54","doi-asserted-by":"publisher","unstructured":"Gal Y, Ghahramani Z. Dropout as a bayesian approximation: representing model uncertainty in deep learning. International Conference on Machine Learning. 2016, pp. 1050\u201359. https:\/\/doi.org\/10.48550\/arXiv.1506.02142. PMLR.","DOI":"10.48550\/arXiv.1506.02142"},{"key":"492_CR55","unstructured":"Kendall A, Gal Y. What uncertainties do we need in bayesian deep learning for computer vision? Advances in neural information processing systems. 2017;30."},{"issue":"4","key":"492_CR56","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2523813","volume":"46","author":"J Gama","year":"2014","unstructured":"Gama J, \u017dliobait\u0117 I, Bifet A, Pechenizkiy M, Bouchachia. A.: a survey on concept drift adaptation. ACM Comput Surv (CSUR). 2014;46(4):1\u201337.","journal-title":"ACM Comput Surv (CSUR)"},{"key":"492_CR57","doi-asserted-by":"publisher","first-page":"6446","DOI":"10.5555\/3295222.3295391","volume-title":"Advances in neural information processing systems","author":"C Louizos","year":"2017","unstructured":"Louizos C, Shalit U, Mooij JM, Sontag D, Zemel R, Welling M. Causal effect inference with deep latent-variable models. In: Advances in neural information processing systems. Vol. 30. Curran Associates, Inc; 2017. p. 6446\u201356. https:\/\/doi.org\/10.5555\/3295222.3295391."}],"container-title":["BioData Mining"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13040-025-00492-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13040-025-00492-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13040-025-00492-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T11:59:17Z","timestamp":1762343957000},"score":1,"resource":{"primary":{"URL":"https:\/\/biodatamining.biomedcentral.com\/articles\/10.1186\/s13040-025-00492-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,5]]},"references-count":57,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["492"],"URL":"https:\/\/doi.org\/10.1186\/s13040-025-00492-3","relation":{},"ISSN":["1756-0381"],"issn-type":[{"type":"electronic","value":"1756-0381"}],"subject":[],"published":{"date-parts":[[2025,11,5]]},"assertion":[{"value":"24 August 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 October 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 November 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"This study does not require ethical approval, as all data used are publicly available and fully anonymized. Specifically, we used the following datasets from the Kaggle platform: 1. EDHS HIV\/AIDS Dataset by Daniel Mesafint (\n                      \n                      ). 2. AIDS Virus Infection Prediction Dataset by Aadarsh Velu (\n                      \n                      ). These datasets contain no personally identifiable information. The use of these publicly available and anonymized datasets is in accordance with the data use policies of the Kaggle platform.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"77"}}