{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T21:47:48Z","timestamp":1778276868791,"version":"3.51.4"},"reference-count":66,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T00:00:00Z","timestamp":1771891200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["25-11-00021"],"award-info":[{"award-number":["25-11-00021"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Regression analysis with interval-valued outcomes presents a fundamental challenge in modeling data where uncertainty is inherent rather than incidental. Such data, arising naturally in fields ranging from meteorology to finance, require methods that preserve information about both central tendency and dispersion. We introduce a novel class of attention-based regression models that reformulates interval-valued regression as a multiclass classification task. The key idea behind the model is in partitioning the outcome domain into basic intervals derived from training data intersections and representing each interval-valued observation as a set of feasible discrete probability distributions over these intervals. This imprecise probabilistic representation allows us to train a classification-style model by minimizing the expected log-likelihood over all consistent distributions. We propose two training algorithms: a Monte Carlo sampling approach and a more efficient joint optimization method that simultaneously updates both the constrained probability distributions and model parameters. The model incorporates a kernel-based aggregation mechanism using trainable dot-product attention, where attention weights are computed from input features but applied to the probability distributions over basic intervals. Numerical experiments with real datasets illustrate the approach. By introducing the class of attention-based models for interval-valued regression, this work offers a novel perspective on applying machine learning to uncertain data. Codes implementing the proposed models are publicly available.<\/jats:p>","DOI":"10.3390\/a19030166","type":"journal-article","created":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T16:58:18Z","timestamp":1771952298000},"page":"166","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Regression Analysis Under Interval-Valued Targets as an Imprecise Classification Problem"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5637-1420","authenticated-orcid":false,"given":"Lev","family":"Utkin","sequence":"first","affiliation":[{"name":"Higher School of Artificial Intelligence Technologies, Peter the Great St. Petersburg Polytechnic University, 195251 St. Petersburg, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stanislav","family":"Kogan","sequence":"additional","affiliation":[{"name":"Higher School of Artificial Intelligence Technologies, Peter the Great St. Petersburg Polytechnic University, 195251 St. Petersburg, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1542-6480","authenticated-orcid":false,"given":"Andrei","family":"Konstantinov","sequence":"additional","affiliation":[{"name":"Higher School of Artificial Intelligence Technologies, Peter the Great St. Petersburg Polytechnic University, 195251 St. Petersburg, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3583-7324","authenticated-orcid":false,"given":"Vladimir","family":"Muliukha","sequence":"additional","affiliation":[{"name":"Higher School of Artificial Intelligence Technologies, Peter the Great St. Petersburg Polytechnic University, 195251 St. Petersburg, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,2,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bentkowska, U. (2019). Interval-Valued Methods in Classifications and Decisions, Springer.","DOI":"10.1007\/978-3-030-12927-9"},{"key":"ref_2","unstructured":"Billard, L., and Diday, E. (2012). Symbolic Data Analysis: Conceptual Statistics and Data Mining, John Wiley & Sons."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1007\/s10462-023-10562-9","article-title":"A survey of uncertainty in deep neural networks","volume":"56","author":"Gawlikowski","year":"2023","journal-title":"Artif. Intell. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Guo, Z., Wan, Z., Zhang, Q., Zhao, X., Chen, F., Cho, J.H., Zhang, Q., Kaplan, L.M., Jeong, D.H., and J\u00f8sang, A. (2022). A survey on uncertainty reasoning and quantification for decision making: Belief theory meets deep learning. arXiv.","DOI":"10.2139\/ssrn.4469570"},{"key":"ref_5","unstructured":"Rodriguez, O. (2024). Shrinkage linear regression for symbolic interval-valued variables. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/s44379-024-00011-x","article-title":"A survey on machine learning approaches for uncertainty quantification of engineering systems","volume":"1","author":"Shi","year":"2025","journal-title":"Mach. Learn. Comput. Sci. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Walley, P. (1991). Statistical Reasoning with Imprecise Probabilities, Chapman and Hall.","DOI":"10.1007\/978-1-4899-3472-7"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1214\/aoms\/1177698950","article-title":"Upper and lower probabilities induced by a multi-valued mapping","volume":"38","author":"Dempster","year":"1967","journal-title":"Ann. Math. Stat."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Shafer, G. (1976). A Mathematical Theory of Evidence, Princeton University Press.","DOI":"10.1515\/9780691214696"},{"key":"ref_10","unstructured":"Alefeld, G., and Herzberger, J. (1983). Introduction to Interval Computations, Academic Press."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Konstantinov, A., Utkin, L., Efremenko, V., Muliukha, V., Lukashin, A., and Verbova, N. (2025). Survival Analysis as Imprecise Classification with Trainable Kernels. Mathematics, 13.","DOI":"10.3390\/math13183040"},{"key":"ref_12","unstructured":"Kroese, D., Taimre, T., and Botev, Z. (2013). Handbook of Monte Carlo Methods, John Wiley & Sons."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1137\/1109020","article-title":"On estimating regression","volume":"9","author":"Nadaraya","year":"1964","journal-title":"Theory Probab. Its Appl."},{"key":"ref_14","first-page":"359","article-title":"Smooth regression analysis","volume":"26","author":"Watson","year":"1964","journal-title":"Sankhya Indian J. Stat. Ser. A"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Luong, T., Pham, H., and Manning, C. (2015). Effective approaches to attention-based neural machine translation. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.","DOI":"10.18653\/v1\/D15-1166"},{"key":"ref_16","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1002\/sam.11150","article-title":"A resampling approach for interval-valued data regression","volume":"5","author":"Ahn","year":"2012","journal-title":"Stat. Anal. Data Min. Asa Data Sci. J."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.csda.2009.08.010","article-title":"Constrained linear regression models for symbolic interval-valued variables","volume":"54","author":"Neto","year":"2010","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_19","unstructured":"Cozman, F., Den\u0153ux, T., Destercke, S., and Seidenfeld, T. (2013). On sharp identification regions for regression under interval data. ISIPTA\u201913: Proceedings of the Eighth International Symposium on Imprecise Probability: Theories and Applications, SIPTA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Billard, L., and Diday, E. (2000). Regression analysis for interval-valued data. Data Analysis, Classification and Related Methods: Proceedings of the Seventh Conference of the International Federation of Classification Societies, Springer.","DOI":"10.1007\/978-3-642-59789-3_58"},{"key":"ref_21","unstructured":"Yeh, C.C., Sun, Y., and Cutler, A. (2022). Tree-based regression for interval-valued data. arXiv."},{"key":"ref_22","first-page":"4821","article-title":"Random forests regression for soft interval data","volume":"54","author":"Yeh","year":"2024","journal-title":"Commun. Stat.-Simul. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"9606","DOI":"10.1109\/TNNLS.2024.3421657","article-title":"Multiview classification through learning from interval-valued data","volume":"36","author":"Ma","year":"2025","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3107","DOI":"10.1109\/TFUZZ.2024.3367460","article-title":"Domain adaptation with interval-valued observations: Theory and algorithms","volume":"32","author":"Ma","year":"2024","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1500","DOI":"10.1016\/j.csda.2007.04.014","article-title":"Centre and range method for fitting a linear regression model to symbolic interval data","volume":"52","author":"Neto","year":"2008","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1016\/j.neucom.2018.11.063","article-title":"Interval-valued data prediction via regularized artificial neural network","volume":"331","author":"Yang","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.neucom.2013.08.029","article-title":"Interval kernel regression","volume":"128","author":"Fagundes","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/j.jkss.2015.12.003","article-title":"Interval-valued data regression using nonparametric additive models","volume":"45","author":"Lim","year":"2016","journal-title":"J. Korean Stat. Soc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2413","DOI":"10.1007\/s10614-023-10519-8","article-title":"Panel interval-valued data nonlinear regression models and applications","volume":"64","author":"Ji","year":"2024","journal-title":"Comput. Econ."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1007\/s10044-016-0538-y","article-title":"Nonlinear regression applied to interval-valued data","volume":"20","year":"2017","journal-title":"Pattern Anal. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1806","DOI":"10.1002\/for.3271","article-title":"Deep Learning Quantile Regression for Interval-Valued Data Prediction","volume":"44","author":"Wang","year":"2025","journal-title":"J. Forecast."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"122277","DOI":"10.1016\/j.eswa.2023.122277","article-title":"Ordinal classification for interval-valued data and interval-valued functional data","volume":"238","author":"Alcacer","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"116561","DOI":"10.1016\/j.eswa.2022.116561","article-title":"Exploratory spatial analysis for interval data: A new autocorrelation index with COVID-19 and rent price applications","volume":"195","author":"Freitas","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1545","DOI":"10.1007\/s10489-023-05051-z","article-title":"Regression applied to symbolic interval-spatial data","volume":"54","author":"Freitas","year":"2024","journal-title":"Appl. Intell."},{"key":"ref_35","first-page":"114","article-title":"Interval-valued linear model","volume":"8","author":"Wang","year":"2015","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"109920","DOI":"10.1016\/j.patcog.2023.109920","article-title":"A novel interval dual convolutional neural network method for interval-valued stock price prediction","volume":"145","author":"Jiang","year":"2024","journal-title":"Pattern Recognit."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1080\/07350015.2023.2208183","article-title":"Neural networks for partially linear quantile regression","volume":"42","author":"Zhong","year":"2024","journal-title":"J. Bus. Econ. Stat."},{"key":"ref_38","unstructured":"Molchanov, I. (2005). Theory of Random Sets, Springer."},{"key":"ref_39","first-page":"1","article-title":"Nonparametric regression analysis of uncertain and imprecise data using belief functions","volume":"35","author":"Denoeux","year":"2004","journal-title":"Int. J. Approx. Reason."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Li, F., Li, S., Tang, N., and Den\u0153ux, T. (2017, January 10\u201313). Constrained interval-valued linear regression model. Proceedings of the 2017 20th International Conference on Information Fusion, Xi\u2019an, China.","DOI":"10.23919\/ICIF.2017.8009676"},{"key":"ref_41","first-page":"40","article-title":"Uncertainty Quantification in Regression Neural Networks Using Likelihood-Based","volume":"Volume 14909","author":"Denoeux","year":"2024","journal-title":"Proceedings of the Belief Functions: Theory and Applications: 8th International Conference, BELIEF 2024"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"122754","DOI":"10.1109\/ACCESS.2021.3109013","article-title":"Feature selection for interval-valued data based on DS evidence theory","volume":"9","author":"Peng","year":"2021","journal-title":"IEEE Access"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"5579","DOI":"10.1007\/s00500-017-2521-y","article-title":"Uncertain regression analysis: An approach for imprecise observations","volume":"22","author":"Yao","year":"2018","journal-title":"Soft Comput."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1142\/S0218488525500102","article-title":"v-SVR with Imprecise Observations","volume":"33","author":"Zhang","year":"2025","journal-title":"Int. J. Uncertain. Fuzziness -Knowl.-Based Syst."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.ijar.2022.01.011","article-title":"Belief functions and rough sets: Survey and new insights","volume":"143","author":"Campagner","year":"2022","journal-title":"Int. J. Approx. Reason."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"101904","DOI":"10.1016\/j.jksuci.2023.101904","article-title":"Representing uncertainty and imprecision in machine learning: A survey on belief functions","volume":"36","author":"Liu","year":"2024","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_47","unstructured":"Coolen, F., de Cooman, G., Fetz, T., and Oberguggenberger, M. (2011). Interval-valued regression and classification models in the framework of machine learning. Proceedings of the Seventh International Symposium on Imprecise Probabilities: Theories and Applications; ISIPTA\u201911, SIPTA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.neunet.2015.05.004","article-title":"A new robust model of one-class classification by interval-valued training data using the triangular kernel","volume":"69","author":"Utkin","year":"2015","journal-title":"Neural Netw."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/978-3-319-08979-9_9","article-title":"A robust one-class classification model with interval-valued data based on belief functions and minimax strategy","volume":"Volume 8556","author":"Perner","year":"2014","journal-title":"Proceedings of the Machine Learning and Data Mining in Pattern Recognition"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.knosys.2016.12.022","article-title":"An one-class classification support vector machine model by interval-valued training data","volume":"120","author":"Utkin","year":"2017","journal-title":"Knowl.-Based Syst."},{"key":"ref_51","unstructured":"Cheng, X., Cao, Y., Li, X., An, B., and Feng, L. (2023, January 23\u201329). Weakly supervised regression with interval targets. Proceedings of the International Conference on Machine Learning. PMLR, Honolulu, HI, USA."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Nguyen, T., and Hocking, T. (2025). Interval Regression: A Comparative Study with Proposed Models. arXiv.","DOI":"10.21203\/rs.3.rs-6885298\/v1"},{"key":"ref_53","unstructured":"Pukdee, R., Ke, Z., and Gupta, C. (2025). Learning from Interval Targets. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1016\/j.neunet.2023.02.005","article-title":"Neural network model for imprecise regression with interval dependent variables","volume":"161","author":"Tretiak","year":"2023","journal-title":"Neural Netw."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"3279","DOI":"10.1109\/TKDE.2021.3126456","article-title":"A general survey on attention mechanisms in deep learning","volume":"35","author":"Brauwers","year":"2021","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1145\/3465055","article-title":"An attentive survey of attention models","volume":"12","author":"Chaudhari","year":"2021","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"6037","DOI":"10.1007\/s10462-022-10148-x","article-title":"Attention, please! A survey of neural attention models in deep learning","volume":"55","author":"Correia","year":"2022","journal-title":"Artif. Intell. Rev."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"102417","DOI":"10.1016\/j.inffus.2024.102417","article-title":"Visual attention methods in deep learning: An in-depth survey","volume":"108","author":"Hassanin","year":"2024","journal-title":"Inf. Fusion"},{"key":"ref_59","unstructured":"Lin, T., Wang, Y., Liu, X., and Qiu, X. (2021). A Survey of Transformers. arXiv."},{"key":"ref_60","unstructured":"Liu, F., Huang, X., Chen, Y., and Suykens, J. (2021). Random Features for Kernel Approximation: A Survey on Algorithms, Theory, and Beyond. arXiv."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.neucom.2021.03.091","article-title":"A review on the attention mechanism of deep learning","volume":"452","author":"Niu","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3530811","article-title":"Efficient transformers: A survey","volume":"55","author":"Tay","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_63","unstructured":"Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Rubinstein, R., and Kroese, D. (2008). Simulation and the Monte Carlo Method, Wiley. [2nd ed.].","DOI":"10.1002\/9780470230381"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Akiba, T., Sano, S., Yanase, T., Ohta, T., and Koyama, M. (2019, January 4\u20138). Optuna: A next-generation hyperparameter optimization framework. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330701"},{"key":"ref_66","unstructured":"Kelly, M., Longjohn, R., and Nottingham, K. (2026, January 28). The UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/19\/3\/166\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T12:54:34Z","timestamp":1772456074000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/19\/3\/166"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,24]]},"references-count":66,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["a19030166"],"URL":"https:\/\/doi.org\/10.3390\/a19030166","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,24]]}}}