{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T03:04:01Z","timestamp":1772507041998,"version":"3.50.1"},"reference-count":99,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,4,27]],"date-time":"2023-04-27T00:00:00Z","timestamp":1682553600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["21-11-00116"],"award-info":[{"award-number":["21-11-00116"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>A new method for estimating the conditional average treatment effect is proposed in this paper. It is called TNW-CATE (the Trainable Nadaraya\u2013Watson regression for CATE) and based on the assumption that the number of controls is rather large and the number of treatments is small. TNW-CATE uses the Nadaraya\u2013Watson regression for predicting outcomes of patients from control and treatment groups. The main idea behind TNW-CATE is to train kernels of the Nadaraya\u2013Watson regression by using a weight sharing neural network of a specific form. The network is trained on controls, and it replaces standard kernels with a set of neural subnetworks with shared parameters such that every subnetwork implements the trainable kernel, but the whole network implements the Nadaraya\u2013Watson estimator. The network memorizes how the feature vectors are located in the feature space. The proposed approach is similar to transfer learning when domains of source and target data are similar, but the tasks are different. Various numerical simulation experiments illustrate TNW-CATE and compare it with the well-known T-learner, S-learner, and X-learner for several types of control and treatment outcome functions. The code of proposed algorithms implementing TNW-CATE is publicly available.<\/jats:p>","DOI":"10.3390\/a16050226","type":"journal-article","created":{"date-parts":[[2023,4,28]],"date-time":"2023-04-28T01:33:40Z","timestamp":1682645620000},"page":"226","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Heterogeneous Treatment Effect with Trained Kernels of the Nadaraya\u2013Watson Regression"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1542-6480","authenticated-orcid":false,"given":"Andrei","family":"Konstantinov","sequence":"first","affiliation":[{"name":"Institute of Computer Science and Technology, Peter the Great St. Petersburg Polytechnic University, Polytechnicheskaya, 29, 195251 St. Petersburg, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2275-1473","authenticated-orcid":false,"given":"Stanislav","family":"Kirpichenko","sequence":"additional","affiliation":[{"name":"Institute of Computer Science and Technology, Peter the Great St. Petersburg Polytechnic University, Polytechnicheskaya, 29, 195251 St. Petersburg, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5637-1420","authenticated-orcid":false,"given":"Lev","family":"Utkin","sequence":"additional","affiliation":[{"name":"Institute of Computer Science and Technology, Peter the Great St. Petersburg Polytechnic University, Polytechnicheskaya, 29, 195251 St. Petersburg, Russia"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lu, M., Sadiq, S., Feaster, D., and Ishwaran, H. (2017). Estimating Individual Treatment Effect in Observational Data Using Random Forest Methods. arXiv.","DOI":"10.1080\/10618600.2017.1356325"},{"key":"ref_2","unstructured":"Shalit, U., Johansson, F., and Sontag, D. (2017, January 6\u201311). Estimating individual treatment effect: Generalization bounds and algorithms. Proceedings of the 34th International Conference on Machine Learning (ICML 2017), Sydney, Australia."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1177\/0081175012452652","article-title":"Estimating Heterogeneous Treatment Effects with Observational Data","volume":"42","author":"Xie","year":"2012","journal-title":"Sociol. Methodol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1111\/rssa.12824","article-title":"Estimating Individual Treatment Effects using Non-Parametric Regression Models: A Review","volume":"185","author":"Caron","year":"2022","journal-title":"J. R. Stat. Soc. Ser. A Stat. Soc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1177\/0081175019862593","article-title":"Heterogeneous Treatment Effects in the Presence of Self-Selection: A Propensity Score Perspective","volume":"50","author":"Zhou","year":"2020","journal-title":"Sociol. Methodol."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Fan, Y., Lv, J., and Wang, J. (2018). DNN: A Two-Scale Distributional Tale of Heterogeneous Treatment Effect Inference. arXiv.","DOI":"10.2139\/ssrn.3238897"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1093\/poq\/nfs036","article-title":"Modeling heterogeneous treatment effects in survey experiments with Bayesian additive regression trees","volume":"76","author":"Green","year":"2012","journal-title":"Public Opin. Q."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1198\/jcgs.2010.08162","article-title":"Bayesian nonparametric modeling for causal inference","volume":"20","author":"Hill","year":"2011","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_9","unstructured":"Kallus, N. (2016). Learning to personalize from observational data. arXiv."},{"key":"ref_10","unstructured":"Wager, S., and Athey, S. (2017). Estimation and inference of heterogeneous treatment effects using random forests. arXiv."},{"key":"ref_11","unstructured":"Aoki, R., and Ester, M. (2022). Causal Inference from Small High-dimensional Datasets. arXiv."},{"key":"ref_12","unstructured":"Alaa, A., and van der Schaar, M. (2018, January 10\u201315). Limits of Estimating Heterogeneous Treatment Effects: Guidelines for Practical Algorithm Design. Proceedings of the International Conference on Machine Learning, PMLR, Stockholm, Sweden."},{"key":"ref_13","unstructured":"Kunzel, S., Stadie, B., Vemuri, N., Ramakrishnan, V., Sekhon, J., and Abbeel, P. (2018). Transfer Learning for Estimating Causal Effects using Neural Networks. arXiv."},{"key":"ref_14","first-page":"1","article-title":"Adapting Neural Networks for the Estimation of Treatment Effects","volume":"Volume 32","author":"Shi","year":"2019","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3309","DOI":"10.1002\/sim.7820","article-title":"Comparing methods for estimation of heterogeneous treatment effects using observational data from health care databases","volume":"37","author":"Wendling","year":"2018","journal-title":"Stat. Med."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Dorie, V., Perrett, G., Hill, J., and Goodrich, B. (2022). Stan and BART for Causal Inference: Estimating Heterogeneous Treatment Effects Using the Power of Stan and the Flexibility of Machine Learning. Entropy, 24.","DOI":"10.3390\/e24121782"},{"key":"ref_17","unstructured":"Acharki, N., Garnier, J., Bertoncello, A., and Lugo, R. (2022). Heterogeneous Treatment Effects Estimation: When Machine Learning meets multiple treatment regime. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"7353","DOI":"10.1073\/pnas.1510489113","article-title":"Recursive partitioning for heterogeneous causal effects","volume":"113","author":"Athey","year":"2016","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_19","unstructured":"Deng, A., Zhang, P., Chen, S., Kim, D., and Lu, J. (2016). Concise Summarization of Heterogeneous Treatment Effect Using Total Variation Regularized Regression. arXiv."},{"key":"ref_20","first-page":"1","article-title":"Causal Classification: Treatment Effect Estimation vs. Outcome Prediction","volume":"23","author":"Provost","year":"2022","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1287\/ijds.2021.0006","article-title":"Causal Decision Making and Causal Effect Estimation Are Not the Same\u2026and Why It Matters","volume":"1","author":"Provost","year":"2022","journal-title":"INFORMS J. Data Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1433","DOI":"10.1002\/psp4.12715","article-title":"Heterogeneous treatment effect analysis based on machine-learning methodology","volume":"10","author":"Gong","year":"2021","journal-title":"CPT Pharmacomet. Syst. Pharmacol."},{"key":"ref_23","unstructured":"Hatt, T., Berrevoets, J., Curth, A., Feuerriegel, S., and van der Schaar, M. (2016). Combining Observational and Randomized Data for Estimating Heterogeneous Treatment Effects. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jiang, H., Qi, P., Zhou, J., Zhou, J., and Rao, S. (2021, January 15\u201318). A Short Survey on Forest Based Heterogeneous Treatment Effect Estimation Methods: Meta-learners and Specific Models. Proceedings of the 2021 IEEE International Conference on Big Data (Big Data), Orlando, FL, USA.","DOI":"10.1109\/BigData52589.2021.9671439"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4156","DOI":"10.1073\/pnas.1804597116","article-title":"Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learning","volume":"116","author":"Kunzel","year":"2019","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2050005","DOI":"10.1142\/S0218213020500050","article-title":"Estimation of Personalized Heterogeneous Treatment Effects Using Concatenation and Augmentation of Feature Vectors","volume":"29","author":"Utkin","year":"2020","journal-title":"Int. J. Artif. Intell. Tools"},{"key":"ref_27","unstructured":"Wu, L., and Yang, S. (2022, January 11\u201313). Integrative learner of heterogeneous treatment effects combining experimental and observational studies. Proceedings of the First Conference on Causal Learning and Reasoning (CLeaR 2022), Eureka, CA, USA."},{"key":"ref_28","unstructured":"Yadlowsky, S., Fleming, S., Shah, N., Brunskill, E., and Wager, S. (2021). Evaluating Treatment Prioritization Rules via Rank-Weighted Average Treatment Effects. arXiv."},{"key":"ref_29","first-page":"1","article-title":"A Unified Survey of Treatment Effect Heterogeneity Modelling and Uplift Modelling","volume":"54","author":"Zhang","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1106","DOI":"10.1080\/01621459.2012.695674","article-title":"Estimating Individualized Treatment Rules Using Outcome Weighted Learning","volume":"107","author":"Zhao","year":"2012","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_31","unstructured":"Bica, I., Jordon, J., and van der Schaar, M. (2020, January 6\u201312). Estimating the effects of continuous-valued interventions using generative adversarial networks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Virtual."},{"key":"ref_32","unstructured":"Curth, A., and van der Schaar, M. (2021, January 13\u201315). Nonparametric Estimation of Heterogeneous Treatment Effects: From Theory to Learning Algorithms. Proceedings of the International Conference on Artificial Intelligence and Statistics, PMLR, Virtual."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1007\/978-3-030-88013-2_43","article-title":"CETransformer: Casual Effect Estimation via Transformer Based Representation Learning","volume":"Volume 13022","author":"Guo","year":"2021","journal-title":"Proceedings of the Pattern Recognition and Computer Vision"},{"key":"ref_34","unstructured":"Melnychuk, V., Frauen, D., and Feuerriegel, S. (2022). Causal Transformer for Estimating Counterfactual Outcomes. arXiv."},{"key":"ref_35","unstructured":"Zhang, Y.F., Zhang, H., Lipton, Z., Li, L.E., and Xing, E.P. (2022). Can Transformers be Strong Treatment Effect Estimators?. arXiv."},{"key":"ref_36","unstructured":"Zhang, Y.F., Zhang, H., Lipton, Z., Li, L.E., and Xing, E.P. (2023, April 19). Exploring Transformer Backbones for Heterogeneous Treatment Effect Estimation. Available online: https:\/\/openreview.net\/forum?id=NkJ60ZZkcrW."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1137\/1109020","article-title":"On estimating regression","volume":"9","author":"Nadaraya","year":"1964","journal-title":"Theory Probab. Its Appl."},{"key":"ref_38","unstructured":"Watson, G. (1964). Smooth regression analysis. Sankhya Indian J. Stat. Ser. A, 359\u2013372."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1017\/S0962492921000027","article-title":"Deep learning: A statistical viewpoint","volume":"30","author":"Bartlett","year":"2021","journal-title":"Acta Numer."},{"key":"ref_40","first-page":"21751","article-title":"Minimax optimal nonparametric estimation of heterogeneous treatment effects","volume":"33","author":"Gao","year":"2020","journal-title":"Proc. Adv. Neural Inf. Process. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1080\/07350015.2020.1800479","article-title":"Counterfactual treatment effects: Estimation and inference","volume":"40","author":"Hsu","year":"2022","journal-title":"J. Bus. Econ. Stat."},{"key":"ref_42","unstructured":"Padilla, O., and Yu, Y. (2022). Dynamic and heterogeneous treatment effects with abrupt changes. arXiv."},{"key":"ref_43","unstructured":"Sun, X. (2022). Estimation of Heterogeneous Treatment Effects Using a Conditional Moment Based Approach. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.knosys.2015.01.010","article-title":"Transfer learning using computational intelligence: A survey","volume":"80","author":"Lu","year":"2015","journal-title":"Knowl.-Based Syst."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2010","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-016-0043-6","article-title":"A survey of transfer learning","volume":"3","author":"Weiss","year":"2016","journal-title":"J. Big Data"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Powers, S., Qian, J., Jung, K., Schuler, A., Shah, N., Hastie, T., and Tibshirani, R. (2017). Some methods for heterogeneous treatment effect estimation in high-dimensions Some methods for heterogeneous treatment effect estimation in high-dimensions. arXiv.","DOI":"10.1002\/sim.7623"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2074","DOI":"10.1214\/18-EJS1439","article-title":"High-dimensional inference for personalized treatment decision","volume":"12","author":"Jeng","year":"2018","journal-title":"Electron. J. Stat."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/01621459.2015.1093947","article-title":"Residual Weighted Learning for Estimating Individualized Treatment Rules","volume":"112","author":"Zhou","year":"2017","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_50","unstructured":"Athey, S., Tibshirani, J., and Wager, S. (2017). Solving heterogeneous estimating equations with gradient forests. arXiv."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Athey, S., Tibshirani, J., and Wager, S. (2019). Generalized random forests. arXiv.","DOI":"10.1214\/18-AOS1709"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"2372","DOI":"10.1093\/bioinformatics\/btx174","article-title":"Mining heterogeneous causal effects for personalized cancer treatment","volume":"33","author":"Zhang","year":"2017","journal-title":"Bioinformatics"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Xie, Y., Chen, N., and Shi, X. (2018). False Discovery Rate Controlled Heterogeneous Treatment Effect Detection for Online Controlled Experiments. arXiv.","DOI":"10.1145\/3219819.3219860"},{"key":"ref_54","unstructured":"Oprescu, M., Syrgkanis, V., and Wu, Z. (2019). Orthogonal Random Forest for Heterogeneous Treatment Effect Estimation. arXiv."},{"key":"ref_55","unstructured":"III, E.M., Somanchi, S., and Neill, D. (2018). Efficient Discovery of Heterogeneous Treatment Effects in Randomized Experiments via Anomalous Pattern Detection. arXiv."},{"key":"ref_56","unstructured":"Chen, R., and Liu, H. (2018). Heterogeneous Treatment Effect Estimation through Deep Learning. arXiv."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1017\/pan.2017.15","article-title":"Estimating Heterogeneous Treatment Effects and the Effects of Heterogeneous Treatments with Ensemble Methods","volume":"25","author":"Grimmer","year":"2017","journal-title":"Polit. Anal."},{"key":"ref_58","unstructured":"Kallus, N., Puli, A., and Shalit, U. (2018). Removing Hidden Confounding by Experimental Grounding. arXiv."},{"key":"ref_59","unstructured":"Kallus, N., and Zhou, A. (2018). Confounding-Robust Policy Improvement. arXiv."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Knaus, M., Lechner, M., and Strittmatter, A. (2018). Machine Learning Estimation of Heterogeneous Causal Effects: Empirical Monte Carlo Evidence. arXiv.","DOI":"10.2139\/ssrn.3318814"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Kunzel, S., Walter, S., and Sekhon, J. (2019). Causaltoolbox\u2014Estimator Stability for Heterogeneous Treatment Effects. arXiv.","DOI":"10.1353\/obs.2019.0005"},{"key":"ref_62","unstructured":"Levy, J., van der Laan, M., Hubbard, A., and Pirracchio, R. (2018). A Fundamental Measure of Treatment Effect Heterogeneity. arXiv."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1177\/0193841X10372890","article-title":"Heterogeneous Treatment Effects: What Does a Regression Estimate?","volume":"34","author":"Rhodes","year":"2010","journal-title":"Eval. Rev."},{"key":"ref_64","unstructured":"Yao, L., Lo, C., Nir, I., Tan, S., Evnine, A., Lerer, A., and Peysakhovich, A. (2022). Efficient Heterogeneous Treatment Effect Estimation with Multiple Experiments and Multiple Outcomes. arXiv."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Wang, Y., Wu, P., Liu, Y., Weng, C., and Zeng, D. (2016, January 4\u20137). Learning Optimal Individualized Treatment Rules from Electronic Health Record Data. Proceedings of the IEEE International Conference on Healthcare Informatics (ICHI), Chicago, IL, USA.","DOI":"10.1109\/ICHI.2016.13"},{"key":"ref_66","unstructured":"Curth, A., and van der Schaar, M. (2021, January 6\u201314). On Inductive Biases for Heterogeneous Treatment Effect Estimation. Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Virtual."},{"key":"ref_67","unstructured":"Du, X., Fan, Y., Lv, J., Sun, T., and Vossler, P. (2021). Dimension-Free Average Treatment Effect Inference with Deep Neural Networks. arXiv."},{"key":"ref_68","unstructured":"Nair, N., Gurumoorthy, K., and Mandalapu, D. (2022). Individual Treatment Effect Estimation Through Controlled Neural Network Training in Two Stages. arXiv."},{"key":"ref_69","unstructured":"Nie, L., Ye, M., Liu, Q., and Nicolae, D. (2021, January 3\u20137). Vcnet and functional targeted regularization for learning causal effects of continuous treatments. Proceedings of the International Conference on Learning Representations (ICLR 2021), Virtual."},{"key":"ref_70","unstructured":"Parbhoo, S., Bauer, S., and Schwab, P. (2021). Ncore: Neural counterfactual representation learning for combinations of treatments. arXiv."},{"key":"ref_71","unstructured":"Qin, T., Wang, T.Z., and Zhou, Z.H. (2021, January 18\u201324). Budgeted Heterogeneous Treatment Effect Estimation. Proceedings of the 38th International Conference on Machine Learning, PMLR, Virtual."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Schwab, P., Linhardt, L., Bauer, S., Buhmann, J., and Karlen, W. (2020, January 7\u201312). Learning counterfactual representations for estimating individual dose-response curves. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i04.6014"},{"key":"ref_73","unstructured":"Veitch, V., Wang, Y., and Blei, D. (2019, January 8\u201314). Using Embeddings to Correct for Unobserved Confounding in Networks. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, BC, Canada."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Chaudhari, S., Mithal, V., Polatkan, G., and Ramanath, R. (2021). An attentive survey of attention models. arXiv.","DOI":"10.1145\/3465055"},{"key":"ref_75","unstructured":"Guo, W., Wang, S., Ding, P., Wang, Y., and Jordan, M. (2021). Multi-Source Causal Inference Using Control Variates. arXiv."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1162\/003465304323023651","article-title":"Nonparametric estimation of average treatment effects under exogeneity: A review","volume":"86","author":"Imbens","year":"2004","journal-title":"Rev. Econ. Stat."},{"key":"ref_77","unstructured":"Park, J., Shalit, U., Scholkopf, B., and Muandet, K. (2021, January 18\u201324). Conditional Distributional Treatment Effect with Kernel Conditional Mean Embeddings and U-Statistic Regression. Proceedings of the 38th International Conference on Machine Learning, PMLR, Virtual."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.ins.2016.02.020","article-title":"The mean shift algorithm and its relation to kernel regression","volume":"348","author":"Ghassabeh","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_79","first-page":"2050004-1","article-title":"Bayesian kernel regression for noisy inputs based on Nadaraya\u2013Watson estimator constructed from noiseless training data","volume":"12","author":"Hanafusa","year":"2020","journal-title":"Adv. Data Sci. Adapt. Anal."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Konstantinov, A., Utkin, L., and Kirpichenko, S. (2022, January 27\u201329). AGBoost: Attention-based Modification of Gradient Boosting Machine. Proceedings of the 31st Conference of Open Innovations Association (FRUCT), Helsinki, Finland.","DOI":"10.23919\/FRUCT54823.2022.9770928"},{"key":"ref_81","first-page":"1","article-title":"Learning Data-adaptive Non-parametric Kernels","volume":"21","author":"Liu","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Shapiai, M., Ibrahim, Z., Khalid, M., Jau, L.W., and Pavlovich, V. (2010, January 28\u201330). A Non-linear Function Approximation from Small Samples Based on Nadaraya-Watson Kernel Regression. Proceedings of the 2010 2nd International Conference on Computational Intelligence, Communication Systems and Networks, Liverpool, UK.","DOI":"10.1109\/CICSyN.2010.10"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"2621","DOI":"10.1007\/s00521-017-3218-y","article-title":"Nonparametric kernel smoother on topology learning neural networks for incremental and ensemble regression","volume":"31","author":"Xiao","year":"2019","journal-title":"Neural Comput. Appl."},{"key":"ref_84","first-page":"88","article-title":"Bandwidth Selection for Nadaraya-Watson Kernel Estimator Using Cross-Validation Based on Different Penalty Functions","volume":"Volume 481","author":"Zhang","year":"2014","journal-title":"Proceedings of the International Conference on Machine Learning and Cybernetics (ICMLC 2014)"},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"599","DOI":"10.3150\/08-BEJ160","article-title":"L2 boosting in kernel regression","volume":"15","author":"Park","year":"2009","journal-title":"Bernoulli"},{"key":"ref_86","unstructured":"Noh, Y.K., Sugiyama, M., Kim, K.E., Park, F., and Lee, D. (2017, January 4\u20139). Generative Local Metric Learning for Kernel Regression. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1111\/sjos.12370","article-title":"An oracle property of the Nadaraya-Watson kernel estimator for high-dimensional nonparametric regression","volume":"46","author":"Conn","year":"2019","journal-title":"Scand. J. Stat."},{"key":"ref_88","first-page":"1955","article-title":"Kernel Regression in the Presence of Correlated Errors","volume":"12","author":"Suykens","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1007\/s11548-020-02170-7","article-title":"Learning from irregularly sampled data for endomicroscopy super-resolution: A comparative study of sparse and dense approaches","volume":"15","author":"Szczotka","year":"2020","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"27","DOI":"10.35833\/MPCE.2019.000581","article-title":"Data-driven Transient Stability Assessment Based on Kernel Regression and Distance Metric Learning","volume":"9","author":"Liu","year":"2021","journal-title":"J. Mod. Power Syst. Clean Energy"},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Ito, T., Hamada, N., Ohori, K., and Higuchi, H. (2020, January 14\u201315). A Fast Approximation of the Nadaraya-Watson Regression with the k-Nearest Neighbor Crossover Kernel. Proceedings of the 2020 7th International Conference on Soft Computing & Machine Intelligence (ISCMI), Stockholm, Sweden.","DOI":"10.1109\/ISCMI51676.2020.9311579"},{"key":"ref_92","unstructured":"Ghalebikesabi, S., Ter-Minassian, L., Diaz-Ordaz, K., and Holmes, C. (2021, January 6\u201314). On Locality of Local Explanation Models. Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Virtual."},{"key":"ref_93","unstructured":"Zhang, A., Lipton, Z., Li, M., and Smola, A. (2021). Dive into Deep Learning. arXiv."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1198\/016214504000001880","article-title":"Causal inference using potential outcomes: Design, modeling, decisions","volume":"100","author":"Rubin","year":"2005","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1093\/biomet\/70.1.41","article-title":"The central role of the propensity score in observational studies for causal effects","volume":"70","author":"Rosenbaum","year":"1983","journal-title":"Biometrika"},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"4820","DOI":"10.1021\/acs.jcim.2c01034","article-title":"Identifying SNARE Proteins Using an Alignment-Free Method Based on Multiscan Convolutional Neural Network and PSSM Profiles","volume":"62","author":"Kha","year":"2022","journal-title":"J. Chem. Inf. Model."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"1950005","DOI":"10.1142\/S0219720019500057","article-title":"Using two-dimensional convolutional neural networks for identifying GTP binding sites in Rab proteins","volume":"17","author":"Le","year":"2019","journal-title":"J. Bioinform. Comput. Biol."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/S0167-9473(01)00065-2","article-title":"Stochastic gradient boosting","volume":"38","author":"Friedman","year":"2002","journal-title":"Comput. Stat. Data Anal."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/5\/226\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:24:31Z","timestamp":1760124271000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/5\/226"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,27]]},"references-count":99,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["a16050226"],"URL":"https:\/\/doi.org\/10.3390\/a16050226","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,27]]}}}