{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T22:58:32Z","timestamp":1778281112985,"version":"3.51.4"},"reference-count":54,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,26]],"date-time":"2023-01-26T00:00:00Z","timestamp":1674691200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"FCT\u2014Portuguese Foundation for Science and Technology","award":["UIDB\/05256\/2020"],"award-info":[{"award-number":["UIDB\/05256\/2020"]}]},{"name":"FCT\u2014Portuguese Foundation for Science and Technology","award":["UIDP\/05256\/2020"],"award-info":[{"award-number":["UIDP\/05256\/2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Mathematics"],"abstract":"<jats:p>The Analytic Hierarchy Process (AHP) multicriteria method can be cognitively demanding for large-scale decision problems due to the requirement for the decision maker to make pairwise evaluations of all alternatives. To address this issue, this paper presents an interactive method that uses online learning to provide scalability for AHP. The proposed method involves a machine learning algorithm that learns the decision maker\u2019s preferences through evaluations of small subsets of solutions, and guides the search for the optimal solution. The methodology was tested on four optimization problems with different surfaces to validate the results. We conducted a one factor at a time experimentation of each hyperparameter implemented, such as the number of alternatives to query the decision maker, the learner method, and the strategies for solution selection and recommendation. The results demonstrate that the model is able to learn the utility function that characterizes the decision maker in approximately 15 iterations with only a few comparisons, resulting in significant time and cognitive effort savings. The initial subset of solutions can be chosen randomly or from a cluster. The subsequent ones are recommended during the iterative process, with the best selection strategy depending on the problem type. Recommendation based solely on the smallest Euclidean or Cosine distances reveals better results on linear problems. The proposed methodology can also easily incorporate new parameters and multicriteria methods based on pairwise comparisons.<\/jats:p>","DOI":"10.3390\/math11030627","type":"journal-article","created":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T02:30:38Z","timestamp":1674786638000},"page":"627","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Machine Learning-Driven Approach for Large Scale Decision Making with the Analytic Hierarchy Process"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6934-6745","authenticated-orcid":false,"given":"Marcos Antonio","family":"Alves","sequence":"first","affiliation":[{"name":"Graduate Program in Electrical Engineering, Universidade Federal de Minas Gerais, Av. Antonio Carlos 6627, Belo Horizonte 31270-901, MG, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2572-4924","authenticated-orcid":false,"given":"Ivan Reinaldo","family":"Meneghini","sequence":"additional","affiliation":[{"name":"Federal Institute of Education Science and Technology of Minas Gerais (IFMG), Campus Ibirit\u00e9, Ibirit\u00e9 32407-190, MG, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7777-7625","authenticated-orcid":false,"given":"Ant\u00f3nio","family":"Gaspar-Cunha","sequence":"additional","affiliation":[{"name":"Institute of Polymers and Composites, University of Minho (Uminho), Campus Azur\u00e9m, 4800-058 Guimar\u00e3es, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9238-8839","authenticated-orcid":false,"given":"Frederico Gadelha","family":"Guimar\u00e3es","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Universidade Federal de Minas Gerais, Belo Horizonte 31270-000, MG, Brazil"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,26]]},"reference":[{"key":"ref_1","unstructured":"Schwartz, B. (2004). The Paradox of Choice: Why More Is Less, Harper Collins Publishers."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"116488","DOI":"10.1016\/j.eswa.2021.116488","article-title":"On solving large data matrix problems in Fuzzy AHP","volume":"194","author":"Sakhardande","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kuo, T. (2021). An Ordinal Consistency Indicator for Pairwise Comparison Matrix. Symmetry, 13.","DOI":"10.3390\/sym13112183"},{"key":"ref_4","unstructured":"Saaty, T.L. (1988). Mathematical Models for Decision Support, Springer."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.ejor.2007.01.004","article-title":"Integrated analytic hierarchy process and its applications\u2014A literature review","volume":"186","author":"Ho","year":"2008","journal-title":"Eur. J. Oper. Res."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bas\u00edlio, M.P., Pereira, V., Costa, H.G., Santos, M., and Ghosh, A. (2022). A Systematic Review of the Applications of Multi-Criteria Decision Aid Methods (1977\u20132022). Electronics, 11.","DOI":"10.3390\/electronics11111720"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Madz\u00edk, P., and Fal\u00e1t, L. (2022). State-of-the-art on analytic hierarchy process in the last 40 years: Literature review based on Latent Dirichlet Allocation topic modelling. PLoS ONE, 17.","DOI":"10.1371\/journal.pone.0268777"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Melnik-Leroy, G.A., and Dzemyda, G. (2021). How to influence the results of MCDM?\u2014Evidence of the impact of cognitive biases. Mathematics, 9.","DOI":"10.3390\/math9020121"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Dang, T.T., Nguyen, N.A.T., Nguyen, V.T.T., and Dang, L.T.H. (2022). A Two-Stage Multi-Criteria Supplier Selection Model for Sustainable Automotive Supply Chain under Uncertainty. Axioms, 11.","DOI":"10.3390\/axioms11050228"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Huang, J.J. (2021). Analytic Hierarchy Process with the Correlation Effect via WordNet. Mathematics, 9.","DOI":"10.3390\/math9080872"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Munier, N., and Hontoria, E. (2021). Uses and Limitations of the AHP Method, Springer.","DOI":"10.1007\/978-3-030-60392-2"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tuljak-Suban, D., and Bajec, P. (2020). Integration of AHP and GTMA to make a reliable decision in complex decision-making problems: Application of the logistics provider selection problem as a case study. Symmetry, 12.","DOI":"10.3390\/sym12050766"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Aliyev, R., Temizkan, H., and Aliyev, R. (2020). Fuzzy analytic hierarchy process-based multi-criteria decision making for universities ranking. Symmetry, 12.","DOI":"10.3390\/sym12081351"},{"key":"ref_14","unstructured":"Pedro, L.R., and Takahashi, R.H. (2009, January 25\u201328). Modelling the Decision-Maker Utility Function through Artificial Neural Networks. Proceedings of the Anais do IX Congresso Brasileiro de Redes Neurais\/Intelig\u00eancia Computacional (IX CBRN), Ouro Preto, Brazil."},{"key":"ref_15","unstructured":"Filho, C.J.A.B., Siqueira, H.V., Ferreira, D.D., Bertol, D.W., and ao de Oliveira, R.C.L. (2021, January 30). Learning Pairwise Comparisons with Machine Learning for Large-Scale Multi-Criteria Decision Making Problems. Proceedings of the Anais do 15 Congresso Brasileiro de Intelig\u00eancia Computacional: Joinville, Brazil."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1077","DOI":"10.1016\/S0895-7177(02)00072-9","article-title":"Note on consistency ratio","volume":"35","author":"Chu","year":"2002","journal-title":"Math. Comput. Model."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1016\/0022-2496(77)90033-5","article-title":"A scaling method for priorities in hierarchical structures","volume":"15","author":"Saaty","year":"1977","journal-title":"J. Math. Psychol."},{"key":"ref_18","unstructured":"Pedro, L.R., Takahashi, R.H.C., and Gaspar-Cunha, A. (April, January 29). A Model for a Human Decision-Maker in a Polymer Extrusion Process. Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization, Guimar\u00e3es, Portugal."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"165","DOI":"10.3846\/20294913.2014.892037","article-title":"State of art surveys of overviews on MCDM\/MADM methods","volume":"20","author":"Zavadskas","year":"2014","journal-title":"Technol. Econ. Dev. Econ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"149383","DOI":"10.1109\/ACCESS.2021.3124529","article-title":"Evaluation of Operational Risk in Power Substations and Its Rational Reduction on the Basis of Multicriteria Allocating Resources","volume":"9","author":"Maia","year":"2021","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zolfani, S.H., Bazrafshan, R., Ecer, F., and Karama\u015fa, \u00c7. (2022). The suitability-feasibility-acceptability strategy integrated with Bayesian BWM-MARCOS methods to determine the optimal lithium battery plant located in South America. Mathematics, 10.","DOI":"10.3390\/math10142401"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zolfani, S.H., Nemati, A., Reyes-Norambuena, P.J., and Monardes-Concha, C.A. (2022). A Novel MCDM Approach Based on OPA-WINGS for Policy Making in Undergraduate Elective Courses. Mathematics, 10.","DOI":"10.3390\/math10224211"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Milo\u0161evi\u0107, M.R., Milo\u0161evi\u0107, D.M., Stanojevi\u0107, A.D., Stevi\u0107, D.M., and Simjanovi\u0107, D.J. (2021). Fuzzy and interval AHP approaches in sustainable management for the architectural heritage in smart cities. Mathematics, 9.","DOI":"10.3390\/math9040304"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/j.eswa.2016.06.030","article-title":"Designing an integrated AHP based decision support system for supplier selection in automotive industry","volume":"62","author":"Dweiri","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1016\/j.procs.2015.07.081","article-title":"Criteria in AHP: A systematic review of literature","volume":"55","author":"Russo","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_26","first-page":"42","article-title":"A new fuzzy multi-criteria decision-making method based on proximity index value","volume":"39","author":"Mufazzal","year":"2022","journal-title":"J. Ind. Prod. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"106139","DOI":"10.1016\/j.asoc.2020.106139","article-title":"Scalable and customizable benchmark problems for many-objective optimization","volume":"90","author":"Meneghini","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1093\/biomet\/30.1-2.81","article-title":"A New Measure of Rank Correlation","volume":"30","author":"Kendall","year":"1938","journal-title":"Biometrika"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.ins.2013.12.045","article-title":"INSPM: An interactive evolutionary multi-objective algorithm with preference model","volume":"268","author":"Pedro","year":"2014","journal-title":"Inf. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/S0167-9236(02)00141-0","article-title":"An interactive neural network-based approach for solving multiple criteria decision-making problems","volume":"36","author":"Chen","year":"2003","journal-title":"Decis. Support Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"113527","DOI":"10.1016\/j.eswa.2020.113527","article-title":"Multi-attribute decision making applied to financial portfolio optimization problem","volume":"158","author":"Ferreira","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"354","DOI":"10.3182\/20100712-3-FR-2020.00060","article-title":"The Large Scale System of Multiple Criteria Decision Making; Pre-processing","volume":"43","author":"Mosavi","year":"2010","journal-title":"IFAC Proc. Vol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"106078","DOI":"10.1016\/j.asoc.2020.106078","article-title":"An easy-to-use real-world multi-objective optimization problem suite","volume":"89","author":"Tanabe","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_34","unstructured":"Saaty, T.L. (1996). Decision Making with Dependence and Feedback: The Analytic Network Process, RWS Publication."},{"key":"ref_35","unstructured":"Brans, J.P., and Mareschal, B. (1990). Readings in Multiple Criteria Decision Aid, Springer."},{"key":"ref_36","first-page":"57","article-title":"Classement et choix en pr\u00e9sence de points de vue multiples","volume":"2","author":"Roy","year":"1968","journal-title":"Rev. Fran\u00e7aise D\u2019informatique Et De Rech. Op\u00e9rationnelle"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2125740","DOI":"10.1155\/2019\/2125740","article-title":"Exploring Multicriteria Elicitation Model Based on Pairwise Comparisons: Building an Interactive Preference Adjustment Algorithm","volume":"2019","author":"Vasconcelos","year":"2019","journal-title":"Math. Probl. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, C.N., Yang, F.C., Nguyen, V.T.T., and Vo, N.T. (2022). CFD analysis and optimum design for a centrifugal pump using an effectively artificial intelligent algorithm. Micromachines, 13.","DOI":"10.3390\/mi13081208"},{"key":"ref_39","first-page":"547","article-title":"Concept selection with hesitant fuzzy ANP-PROMETHEE II","volume":"38","author":"Samanlioglu","year":"2021","journal-title":"J. Ind. Prod. Eng."},{"key":"ref_40","unstructured":"Saaty, T.L. (2014). Wiley statsRef: Statistics Reference Online, Wiley."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Pant, S., Kumar, A., Ram, M., Klochkov, Y., and Sharma, H.K. (2022). Consistency Indices in Analytic Hierarchy Process: A Review. Mathematics, 10.","DOI":"10.3390\/math10081206"},{"key":"ref_42","unstructured":"Meneghini, I.R., Guimar\u00e3es, F.G., Gaspar-Cunha, A., and Cohen, M.W. (2021). Advances in Evolutionary and Deterministic Methods for Design, Optimization and Control in Engineering and Sciences, Springer."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"100748","DOI":"10.1016\/j.mex.2019.11.021","article-title":"AHP-express: A simplified version of the analytical hierarchy process method","volume":"7","author":"Leal","year":"2020","journal-title":"MethodsX"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Sammut, C., and Webb, G.I. (2010). Encyclopedia of Machine Learning, Springer.","DOI":"10.1007\/978-0-387-30164-8"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"F\u00fcrnkranz, J., and H\u00fcllermeier, E. (2010). Preference Learning, Springer.","DOI":"10.1007\/978-3-642-14125-6"},{"key":"ref_46","unstructured":"Salvatore, D. (2003). Microeconomics: Theory and Applications, Oxford University Press."},{"key":"ref_47","unstructured":"Settles, B. (2009). Active Learning Literature Survey, Computer Sciences Technical Report 1648; University of Wisconsin\u2013Madison."},{"key":"ref_48","first-page":"107","article-title":"Online learning and online convex optimization","volume":"4","year":"2012","journal-title":"Found. Trends\u00ae Mach. Learn."},{"key":"ref_49","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1109\/TSMCC.2003.819703","article-title":"A neural network approach-decision neural network (DNN) for preference assessment","volume":"34","author":"Chen","year":"2004","journal-title":"IEEE Trans. Syst. Man, Cybern. Part C Appl. Rev."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Pedro, L.R., and Takahashi, R.H. (2011, January 5\u20138). Modeling decision-maker preferences through utility function level sets. Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization, Ouro Preto, Brazil.","DOI":"10.1007\/978-3-642-19893-9_38"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","article-title":"SciPy 1.0: Fundamental algorithms for scientific computing in Python","volume":"17","author":"Virtanen","year":"2020","journal-title":"Nat. Methods"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1145\/2347736.2347755","article-title":"A few useful things to know about machine learning","volume":"55","author":"Domingos","year":"2012","journal-title":"Commun. ACM"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1002\/mcda.1610","article-title":"Methodology to select solutions for multiobjective optimization problems: Weighted stress function method","volume":"24","author":"Ferreira","year":"2017","journal-title":"J. Multi-Criteria Decis. Anal."}],"container-title":["Mathematics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-7390\/11\/3\/627\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:16:35Z","timestamp":1760120195000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-7390\/11\/3\/627"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,26]]},"references-count":54,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["math11030627"],"URL":"https:\/\/doi.org\/10.3390\/math11030627","relation":{},"ISSN":["2227-7390"],"issn-type":[{"value":"2227-7390","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,26]]}}}