{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:25:11Z","timestamp":1740122711710,"version":"3.37.3"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T00:00:00Z","timestamp":1709251200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,26]],"date-time":"2024-03-26T00:00:00Z","timestamp":1711411200000},"content-version":"vor","delay-in-days":25,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["FPU18\/05989","PID2020-119478GB-I00"],"award-info":[{"award-number":["FPU18\/05989","PID2020-119478GB-I00"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011011","name":"Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["A-TIC-434-UGR20"],"award-info":[{"award-number":["A-TIC-434-UGR20"]}],"id":[{"id":"10.13039\/501100011011","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006393","name":"Universidad de Granada","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006393","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2024,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper presents, for the first time, a distance metric learning algorithm for monotonic classification. Monotonic datasets arise in many real-world applications, where there exist order relations in the input and output variables, and the outputs corresponding to ordered pairs of inputs are also expected to be ordered. Monotonic classification can be addressed through several distance-based classifiers that are able to respect the monotonicity constraints of the data. The performance of distance-based classifiers can be improved with the use of distance metric learning algorithms, which are able to find the distances that best represent the similarities among each pair of data samples. However, learning a distance for monotonic data has an additional drawback: the learned distance may negatively impact the monotonic constraints of the data. In our work, we propose a new model for learning distances that does not corrupt these constraints. This methodology will also be useful in identifying and discarding non-monotonic pairs of samples that may be present in the data due to noise. The experimental analysis conducted, supported by a Bayesian statistical testing, demonstrates that the distances obtained by the proposed method can enhance the performance of several distance-based classifiers in monotonic problems.<\/jats:p>","DOI":"10.1007\/s10489-024-05371-8","type":"journal-article","created":{"date-parts":[[2024,3,26]],"date-time":"2024-03-26T13:02:42Z","timestamp":1711458162000},"page":"4443-4466","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Metric learning for monotonic classification: turning the space up to the limits of monotonicity"],"prefix":"10.1007","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8587-4345","authenticated-orcid":false,"given":"Juan Luis","family":"Su\u00e1rez","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7881-2023","authenticated-orcid":false,"given":"Germ\u00e1n","family":"Gonz\u00e1lez-Almagro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4494-7565","authenticated-orcid":false,"given":"Salvador","family":"Garc\u00eda","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7283-312X","authenticated-orcid":false,"given":"Francisco","family":"Herrera","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,3,26]]},"reference":[{"key":"5371_CR1","doi-asserted-by":"crossref","unstructured":"Ben-David A (1992) Automatic generation of symbolic multiattribute ordinal knowledge-based dsss: methodology and applications. Decis Sci 23(6):1357\u20131372","DOI":"10.1111\/j.1540-5915.1992.tb00453.x"},{"issue":"1","key":"5371_CR2","first-page":"2653","volume":"18","author":"A Benavoli","year":"2017","unstructured":"Benavoli A, Corani G, Dem\u0161ar J, Zaffalon M (2017) Time for a change: a tutorial for comparing multiple classifiers through bayesian analysis. J Mach Learn Res 18(1):2653\u20132688","journal-title":"J Mach Learn Res"},{"key":"5371_CR3","unstructured":"Benavoli A, Corani G, Mangili F, Zaffalon M, Ruggeri F (2014) A bayesian wilcoxon signed-rank test based on the dirichlet process. In: International conference on machine learning, pp 1026\u20131034"},{"key":"5371_CR4","doi-asserted-by":"crossref","unstructured":"Berman A, Plemmons RJ (1994) Nonnegative matrices in the mathematical sciences. SIAM","DOI":"10.1137\/1.9781611971262"},{"key":"5371_CR5","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/j.engappai.2017.02.006","volume":"60","author":"JR Cano","year":"2017","unstructured":"Cano JR, Aljohani NR, Abbasi RA, Alowidbi JS, Garcia S (2017) Prototype selection to improve monotonic nearest neighbor. Eng Appl Artif Intell 60:128\u2013135","journal-title":"Eng Appl Artif Intell"},{"key":"5371_CR6","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1016\/j.neucom.2019.02.024","volume":"341","author":"JR Cano","year":"2019","unstructured":"Cano JR, Guti\u00e9rrez PA, Krawczyk B, Wo\u017aniak M, Garc\u00eda S (2019) Monotonic classification: an overview on algorithms, performance measures and data sets. Neurocomputing 341:168\u2013182","journal-title":"Neurocomputing"},{"key":"5371_CR7","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2020.100665","volume":"54","author":"J Carrasco","year":"2020","unstructured":"Carrasco J, Garc\u00eda S, Rueda M, Das S, Herrera F (2020) Recent trends in the use of statistical tests for comparing swarm and evolutionary computing algorithms: practical guidelines and a critical review. Swarm Evol Comput 54:100665","journal-title":"Swarm Evol Comput"},{"issue":"16","key":"5371_CR8","doi-asserted-by":"publisher","first-page":"7235","DOI":"10.1016\/j.eswa.2014.05.035","volume":"41","author":"CC Chen","year":"2014","unstructured":"Chen CC, Li ST (2014) Credit rating with a monotonicity-constrained support vector machine model. Expert Syst Appl 41(16):7235\u20137247","journal-title":"Expert Syst Appl"},{"key":"5371_CR9","doi-asserted-by":"crossref","unstructured":"Chen D, Ye W (2022) Monotonic neural additive models: pursuing regulated machine learning models for credit scoring. In: Proceedings of the third ACM international conference on AI in finance, pp 70\u201378","DOI":"10.1145\/3533271.3561691"},{"key":"5371_CR10","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1016\/j.neunet.2022.02.004","volume":"149","author":"H Chen","year":"2022","unstructured":"Chen H, Jia Y, Ge J, Gu B (2022) Incremental learning algorithm for large-scale semi-supervised ordinal regression. Neural Netw 149:124\u2013136","journal-title":"Neural Netw"},{"issue":"1","key":"5371_CR11","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","volume":"13","author":"TM Cover","year":"1967","unstructured":"Cover TM, Hart PE et al (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21\u201327","journal-title":"IEEE Trans Inf Theory"},{"issue":"1","key":"5371_CR12","first-page":"2859","volume":"16","author":"JP Cunningham","year":"2015","unstructured":"Cunningham JP, Ghahramani Z (2015) Linear dimensionality reduction: survey, insights, and generalizations. J Mach Learn Res 16(1):2859\u20132900","journal-title":"J Mach Learn Res"},{"key":"5371_CR13","doi-asserted-by":"crossref","unstructured":"Duivesteijn W, Feelders A (2008) Nearest neighbour classification with monotonicity constraints. In: Joint European conference on machine learning and knowledge discovery in databases. Springer, pp 301\u2013316","DOI":"10.1007\/978-3-540-87479-9_38"},{"key":"5371_CR14","unstructured":"Goldberger J, Hinton GE, Roweis ST, Salakhutdinov RR (2005) Neighbourhood components analysis. In: Advances in neural information processing systems, pp 513\u2013520"},{"issue":"4","key":"5371_CR15","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1093\/biomet\/92.4.965","volume":"92","author":"M G\u00f6nen","year":"2005","unstructured":"G\u00f6nen M, Heller G (2005) Concordance probability and discriminatory power in proportional hazards regression. Biometrika 92(4):965\u2013970","journal-title":"Biometrika"},{"key":"5371_CR16","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1016\/j.neucom.2019.12.152","volume":"439","author":"S Gonz\u00e1lez","year":"2021","unstructured":"Gonz\u00e1lez S, Garc\u00eda S, Li ST, John R, Herrera F (2021) Fuzzy k-nearest neighbors with monotonicity constraints: moving towards the robustness of monotonic noise. Neurocomputing 439:106\u2013121","journal-title":"Neurocomputing"},{"issue":"1","key":"5371_CR17","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1109\/TKDE.2015.2457911","volume":"28","author":"PA Guti\u00e9rrez","year":"2015","unstructured":"Guti\u00e9rrez PA, Perez-Ortiz M, Sanchez-Monedero J, Fernandez-Navarro F, Hervas-Martinez C (2015) Ordinal regression methods: survey and experimental study. IEEE Trans Knowl Data Eng 28(1):127\u2013146","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"5371_CR18","doi-asserted-by":"crossref","unstructured":"Keller JM, Gray MR, Givens JA (1985) A fuzzy k-nearest neighbor algorithm. IEEE Trans Syst Man Cybern (4):580\u2013585","DOI":"10.1109\/TSMC.1985.6313426"},{"key":"5371_CR19","unstructured":"Kot\u0142owski W, S\u0142owi\u0144ski R (2008) Statistical approach to ordinal classification with monotonicity constraints. In: Preference learning ECML\/PKDD 2008 workshop"},{"key":"5371_CR20","unstructured":"Leslie D (2019) Understanding artificial intelligence ethics and safety. arXiv preprint arXiv:1906.05684"},{"issue":"2","key":"5371_CR21","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1109\/TPAMI.2018.2794976","volume":"41","author":"W Liu","year":"2018","unstructured":"Liu W, Xu D, Tsang IW, Zhang W (2018) Metric learning for multi-output tasks. IEEE Trans Pattern Anal Mach Intell 41(2):408\u2013422","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"5371_CR22","doi-asserted-by":"publisher","first-page":"1121","DOI":"10.1016\/j.neucom.2017.09.057","volume":"275","author":"Z Ma","year":"2018","unstructured":"Ma Z, Chen S (2018) Multi-dimensional classification via a metric approach. Neurocomputing 275:1121\u20131131","journal-title":"Neurocomputing"},{"key":"5371_CR23","unstructured":"Marques-Silva J, Gerspacher T, Cooper MC, Ignatiev A, Narodytska N (2021) Explanations for monotonic classifiers. In: International conference on machine learning. PMLR, pp 7469\u20137479"},{"key":"5371_CR24","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.patcog.2016.11.010","volume":"64","author":"B Nguyen","year":"2017","unstructured":"Nguyen B, Morell C, De Baets B (2017) Supervised distance metric learning through maximization of the jeffrey divergence. Pattern Recogn 64:215\u2013225","journal-title":"Pattern Recogn"},{"key":"5371_CR25","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.knosys.2017.11.022","volume":"142","author":"B Nguyen","year":"2018","unstructured":"Nguyen B, Morell C, De Baets B (2018) Distance metric learning for ordinal classification based on triplet constraints. Knowl-Based Syst 142:17\u201328","journal-title":"Knowl-Based Syst"},{"issue":"15","key":"5371_CR26","first-page":"510","volume":"7","author":"KB Petersen","year":"2008","unstructured":"Petersen KB, Pedersen MS et al (2008) The matrix cookbook. Technical University of Denmark 7(15):510","journal-title":"Technical University of Denmark"},{"issue":"10","key":"5371_CR27","doi-asserted-by":"publisher","first-page":"2717","DOI":"10.1109\/TKDE.2015.2429133","volume":"27","author":"Y Qian","year":"2015","unstructured":"Qian Y, Xu H, Liang J, Liu B, Wang J (2015) Fusing monotonic decision trees. IEEE Trans Knowl Data Eng 27(10):2717\u20132728","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"12","key":"5371_CR28","doi-asserted-by":"publisher","first-page":"5181","DOI":"10.1109\/TFUZZ.2022.3169625","volume":"30","author":"B Sang","year":"2022","unstructured":"Sang B, Chen H, Yang L, Wan J, Li T, Xu W (2022) Feature selection considering multiple correlations based on soft fuzzy dominance rough sets for monotonic classification. IEEE Trans Fuzzy Syst 30(12):5181\u20135195","journal-title":"IEEE Trans Fuzzy Syst"},{"key":"5371_CR29","doi-asserted-by":"crossref","unstructured":"Schoeffer J, Kuehl N, Machowski Y (2022) \u201cthere is not enough information\u201d: on the effects of explanations on perceptions of informational fairness and trustworthiness in automated decision-making. In: 2022 ACM Conference on fairness, accountability, and transparency, pp 1616\u20131628","DOI":"10.1145\/3531146.3533218"},{"key":"5371_CR30","doi-asserted-by":"crossref","unstructured":"Schoeffer J, Kuehl N, Valera I (2021) A ranking approach to fair classification. In: ACM SIGCAS conference on computing and sustainable societies, pp 115\u2013125","DOI":"10.1145\/3460112.3471950"},{"issue":"96","key":"5371_CR31","first-page":"1","volume":"21","author":"JL Su\u00e1rez","year":"2020","unstructured":"Su\u00e1rez JL, Garc\u00eda S, Herrera F (2020) pydml: a python library for distance metric learning. J Mach Learn Res 21(96):1\u20137","journal-title":"J Mach Learn Res"},{"issue":"10","key":"5371_CR32","doi-asserted-by":"publisher","first-page":"2729","DOI":"10.1007\/s10994-021-06010-w","volume":"110","author":"JL Su\u00e1rez","year":"2021","unstructured":"Su\u00e1rez JL, Garc\u00eda S, Herrera F (2021) Ordinal regression with explainable distance metric learning based on ordered sequences. Mach Learn 110(10):2729\u20132762","journal-title":"Mach Learn"},{"key":"5371_CR33","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1016\/j.neucom.2020.08.017","volume":"425","author":"JL Su\u00e1rez","year":"2021","unstructured":"Su\u00e1rez JL, Garc\u00eda S, Herrera F (2021) A tutorial on distance metric learning: mathematical foundations, algorithms, experimental analysis, prospects and challenges. Neurocomputing 425:300\u2013322","journal-title":"Neurocomputing"},{"key":"5371_CR34","doi-asserted-by":"crossref","unstructured":"Su\u00e1rez JL, Gonz\u00e1lez-Almagro G, Garc\u00eda S, Herrera F (2022) A preliminary approach for using metric learning in monotonic classification. In: Advances and trends in artificial intelligence. Theory and practices in artificial intelligence: 35th International conference on industrial, engineering and other applications of applied intelligent systems, IEA\/AIE 2022, Kitakyushu, Japan, July 19\u201322, 2022, Proceedings. Springer, pp 773\u2013784","DOI":"10.1007\/978-3-031-08530-7_65"},{"key":"5371_CR35","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/j.inffus.2019.10.011","volume":"56","author":"M Tang","year":"2020","unstructured":"Tang M, P\u00e9rez-Fern\u00e1ndez R, De Baets B (2020) Fusing absolute and relative information for augmenting the method of nearest neighbors for ordinal classification. Inf Fusion 56:128\u2013140","journal-title":"Inf Fusion"},{"key":"5371_CR36","doi-asserted-by":"crossref","unstructured":"Torresani L, Lee Kc (2007) Large margin component analysis. Adv Neural Inf Process Syst 19:1385","DOI":"10.7551\/mitpress\/7503.003.0178"},{"key":"5371_CR37","doi-asserted-by":"crossref","unstructured":"Triguero I, Gonz\u00e1lez S, Moyano JM, Garc\u00eda\u00a0L\u00f3pez S, Alcal\u00e1\u00a0Fern\u00e1ndez J, Luengo\u00a0Mart\u00edn J, Fern\u00e1ndez\u00a0Hilario A, D\u00edaz J, S\u00e1nchez L, Herrera F et\u00a0al (2017) Keel 3.0: an open source software for multi-stage analysis in data mining. In: International journal of computational intelligence systems. Atlantis Press, pp 1238\u20131249","DOI":"10.2991\/ijcis.10.1.82"},{"issue":"6","key":"5371_CR38","doi-asserted-by":"publisher","first-page":"6106","DOI":"10.1007\/s10489-021-02520-1","volume":"52","author":"T Truong","year":"2022","unstructured":"Truong T, Duong H, Le B, Fournier-Viger P, Yun U (2022) Frequent high minimum average utility sequence mining with constraints in dynamic databases using efficient pruning strategies. Appl Intell 52(6):6106\u20136128","journal-title":"Appl Intell"},{"key":"5371_CR39","doi-asserted-by":"crossref","unstructured":"Vargas VM, Guti\u00e9rrez PA, Barbero-G\u00f3mez J, Herv\u00e1s-Mart\u00ednez C (2023) Soft labelling based on triangular distributions for ordinal classification. Inf Fusion","DOI":"10.1016\/j.inffus.2023.01.003"},{"key":"5371_CR40","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2021.108310","volume":"122","author":"VM Vargas","year":"2022","unstructured":"Vargas VM, Guti\u00e9rrez PA, Herv\u00e1s-Mart\u00ednez C (2022) Unimodal regularisation based on beta distribution for deep ordinal regression. Pattern Recogn 122:108310","journal-title":"Pattern Recogn"},{"key":"5371_CR41","doi-asserted-by":"crossref","unstructured":"Wang F, Zhang C (2007) Feature extraction by maximizing the average neighborhood margin. In: 2007 IEEE conference on computer vision and pattern recognition. IEEE, pp 1\u20138","DOI":"10.1109\/CVPR.2007.383124"},{"issue":"5","key":"5371_CR42","doi-asserted-by":"publisher","first-page":"887","DOI":"10.1109\/TFUZZ.2019.2953024","volume":"28","author":"J Wang","year":"2019","unstructured":"Wang J, Qian Y, Li F, Liang J, Ding W (2019) Fusing fuzzy monotonic decision trees. IEEE Trans Fuzzy Syst 28(5):887\u2013900","journal-title":"IEEE Trans Fuzzy Syst"},{"key":"5371_CR43","unstructured":"Weinberger KQ, Saul LK (2009) Distance metric learning for large margin nearest neighbor classification. Journal of Machine Learning Research 10(Feb):207\u2013244"},{"key":"5371_CR44","doi-asserted-by":"crossref","unstructured":"Zhang X, Jiang Z, Xu W (2022) Feature selection using a weighted method in interval-valued decision information systems. Appl Intell, pp 1\u201320","DOI":"10.1007\/s10489-022-03987-2"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-024-05371-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-024-05371-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-024-05371-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T13:42:54Z","timestamp":1714398174000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-024-05371-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3]]},"references-count":44,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,3]]}},"alternative-id":["5371"],"URL":"https:\/\/doi.org\/10.1007\/s10489-024-05371-8","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"type":"print","value":"0924-669X"},{"type":"electronic","value":"1573-7497"}],"subject":[],"published":{"date-parts":[[2024,3]]},"assertion":[{"value":"4 March 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 March 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interest"}},{"value":"The study was conducted in compliance with ethical standards, including obtaining informed consent from all participants and ensuring the confidentiality and anonymity of their data.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The data used in this study were publicly available datasets. No ethical approval was required for the use of these datasets. We adhered to best practices for data management, including ensuring the quality and reliability of the data and properly citing the source of the data.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical and informed consent for data used"}}]}}