{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T17:20:19Z","timestamp":1774891219823,"version":"3.50.1"},"reference-count":75,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,6,6]],"date-time":"2024-06-06T00:00:00Z","timestamp":1717632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Australian Research Council Discovery Early Career Researcher Award","award":["DE23010006"],"award-info":[{"award-number":["DE23010006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>A key component of multi-criteria decision analysis is the estimation of criteria weights, reflecting the preference strength of different stakeholder groups related to different objectives. One common method is the Analytic Hierarchy Process (AHP). A key challenge with the AHP is the potential for inconsistency in responses, resulting in potentially unreliable preference weights. In small groups, interactions between analysts and respondents can compensate for this through reassessment of inconsistent responses. In many cases, however, stakeholders may be geographically dispersed, with online surveys being a more cost-effective means to elicit these preferences, making renegotiating with inconsistent respondents impossible. Further, the potentially large number of bivariate comparisons required using the AHP may adversely affect response rates. In this study, we test a new \u201cmodified\u201d AHP (MAHP). The MAHP was designed to retain the key desirable features of the AHP but be more amenable to online surveys, reduce the problem of inconsistencies, and require substantially fewer comparisons. The MAHP is tested using three groups of university students through an online survey platform, along with a \u201ctraditional\u201d AHP approach. The results indicate that the MAHP can provide statistically equivalent outcomes to the AHP but without problems arising due to inconsistencies.<\/jats:p>","DOI":"10.3390\/a17060245","type":"journal-article","created":{"date-parts":[[2024,6,6]],"date-time":"2024-06-06T06:40:26Z","timestamp":1717656026000},"page":"245","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Modified Analytic Hierarchy Process Suitable for Online Survey Preference Elicitation"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6581-2649","authenticated-orcid":false,"given":"Sean","family":"Pascoe","sequence":"first","affiliation":[{"name":"CSIRO Environment, Queensland Biosciences Precinct, 306 Carmody Road, St Lucia, Bribie Island, QLD 4067, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8938-0040","authenticated-orcid":false,"given":"Anna","family":"Farmery","sequence":"additional","affiliation":[{"name":"Australian National Centre for Ocean Resources and Security (ANCORS), Faculty of Business and Law, University of Wollongong, Wollongong, NSW 2522, Australia"}]},{"given":"Rachel","family":"Nichols","sequence":"additional","affiliation":[{"name":"Australian National Centre for Ocean Resources and Security (ANCORS), Faculty of Business and Law, University of Wollongong, Wollongong, NSW 2522, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1178-7067","authenticated-orcid":false,"given":"Sarah","family":"Lothian","sequence":"additional","affiliation":[{"name":"Australian National Centre for Ocean Resources and Security (ANCORS), Faculty of Business and Law, University of Wollongong, Wollongong, NSW 2522, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0789-4492","authenticated-orcid":false,"given":"Kamal","family":"Azmi","sequence":"additional","affiliation":[{"name":"Australian National Centre for Ocean Resources and Security (ANCORS), Faculty of Business and Law, University of Wollongong, Wollongong, NSW 2522, Australia"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1016\/j.ecolind.2017.05.068","article-title":"When to use what: Methods for weighting and aggregating sustainability indicators","volume":"81","author":"Gan","year":"2017","journal-title":"Ecol. Indic."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1002\/mcda.320","article-title":"Weight approximations in multi-attribute decision models","volume":"11","author":"Roberts","year":"2002","journal-title":"J. Multi-Criteria Decis. Anal."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1016\/S0305-0483(01)00044-5","article-title":"A comparison of three weight elicitation methods: Good, better, and best","volume":"29","author":"Bottomley","year":"2001","journal-title":"Omega"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1509\/jmkr.37.4.508.18794","article-title":"Testing the reliability of weight elicitation methods: Direct rating versus point allocation","volume":"37","author":"Bottomley","year":"2000","journal-title":"J. Mark. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2263","DOI":"10.1016\/j.rser.2009.06.021","article-title":"Review on multi-criteria decision analysis aid in sustainable energy decision-making","volume":"13","author":"Wang","year":"2009","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"486","DOI":"10.1016\/S0377-2217(99)00249-0","article-title":"Multicriteria analysis for agricultural resource management: A critical survey and future perspectives","volume":"122","author":"Hayashi","year":"2000","journal-title":"Eur. J. Oper. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1006\/obhd.1997.2694","article-title":"Judging Relative Importance: Direct Rating and Point Allocation Are Not Equivalent","volume":"70","author":"Doyle","year":"1997","journal-title":"Organ. Behav. Hum. Decis. Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1016\/j.ejor.2020.06.014","article-title":"Reducing inconsistency measured by the geometric consistency index in the analytic hierarchy process","volume":"288","author":"Escobar","year":"2021","journal-title":"Eur. J. Oper. Res."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"102261","DOI":"10.1016\/j.omega.2020.102261","article-title":"How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy","volume":"96","author":"Cinelli","year":"2020","journal-title":"Omega"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1016\/S0377-2217(99)00467-1","article-title":"On the convergence of multiattribute weighting methods","volume":"129","year":"2001","journal-title":"Eur. J. Oper. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1016\/j.jbusres.2007.04.001","article-title":"The validity of attribute-importance measurement: A review","volume":"60","author":"Pennings","year":"2007","journal-title":"J. Bus. Res."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Saaty, T.L. (1980). The Analytic Hierarchy Process, McGraw-Hill.","DOI":"10.21236\/ADA214804"},{"key":"ref_13","unstructured":"Saaty, T.L. (1982). Decision-Making for Leaders, Wadsworth."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Canco, I., Kruja, D., and Iancu, T. (2021). AHP, a reliable method for quality decision making: A case study in business. Sustainability, 13.","DOI":"10.3390\/su132413932"},{"key":"ref_15","first-page":"502","article-title":"AHP-based support tools for initial screening of manufacturing reshoring decisions","volume":"14","author":"Sequeira","year":"2021","journal-title":"J. Glob. Oper. Strateg. Sourc."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Rivero Guti\u00e9rrez, L., De Vicente Oliva, M.A., and Romero-Ania, A. (2021). Managing Sustainable Urban Public Transport Systems: An AHP Multicriteria Decision Model. Sustainability, 13.","DOI":"10.3390\/su13094614"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1177\/0272989X211019040","article-title":"The Application of Multicriteria Decision Analysis Methods in Health Care: A Literature Review","volume":"42","author":"Khan","year":"2022","journal-title":"Med. Decis. Mak."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1016\/S0160-7383(01)00068-8","article-title":"Evaluating natural attractions for tourism","volume":"29","author":"Deng","year":"2002","journal-title":"Ann. Tour. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1553","DOI":"10.1007\/s11269-006-9112-5","article-title":"A Review of Multiple Criteria Analysis for Water Resource Planning and Management","volume":"21","author":"Hajkowicz","year":"2007","journal-title":"Water Resour. Manag."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3578","DOI":"10.1016\/j.scitotenv.2011.06.022","article-title":"Multi-criteria decision analysis in environmental sciences: Ten years of applications and trends","volume":"409","author":"Huang","year":"2011","journal-title":"Sci. Total Environ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.fishres.2005.08.002","article-title":"Stakeholder preferences for Danish fisheries management of sand eel and Norway pout","volume":"77","author":"Nielsen","year":"2006","journal-title":"Fish. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/S0308-597X(02)00050-7","article-title":"How to involve stakeholders in fisheries management\u2014A country case study in Trinidad and Tobago","volume":"27","author":"Soma","year":"2003","journal-title":"Mar. Policy"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.jenvman.2005.03.006","article-title":"Stakeholder preferences towards conservation versus development for a wetland in Sri Lanka","volume":"77","author":"Wattage","year":"2005","journal-title":"J. Environ. Manag."},{"key":"ref_24","first-page":"218","article-title":"AHP Modeling for Multicriteria Decision-Making and to Optimise Strategies for Protecting Coastal Landscape Resources","volume":"4","author":"Baby","year":"2013","journal-title":"Int. J. Innov. Manag. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1007\/s10479-022-04986-9","article-title":"Multi-criteria classification, sorting, and clustering: A bibliometric review and research agenda","volume":"325","author":"Amor","year":"2023","journal-title":"Ann. Oper. Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1108\/14630011211261687","article-title":"Introduction of AHP Satisfaction Index for workplace environments","volume":"14","author":"Thadsin","year":"2012","journal-title":"J. Corp. Real Estate"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1487","DOI":"10.1016\/S0305-0548(02)00188-0","article-title":"On teaching the analytic hierarchy process","volume":"30","author":"Bodin","year":"2003","journal-title":"Comput. Oper. Res."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1016\/S0305-0548(03)00022-4","article-title":"Inconsistent and contradictory judgements in pairwise comparison method in the AHP","volume":"31","author":"Kwiesielewicz","year":"2004","journal-title":"Comput. Oper. Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/S0377-2217(01)00071-6","article-title":"Robust estimation of priorities in the AHP","volume":"137","author":"Lipovetsky","year":"2002","journal-title":"Eur. J. Oper. Res."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1007\/s40271-016-0179-7","article-title":"How Well Can Analytic Hierarchy Process be Used to Elicit Individual Preferences? Insights from a Survey in Patients Suffering from Age-Related Macular Degeneration","volume":"9","author":"Danner","year":"2016","journal-title":"Patient-Patient-Cent. Outcomes Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1007\/s10479-021-04431-3","article-title":"Inconsistency indices in pairwise comparisons: An improvement of the Consistency Index","volume":"326","author":"Sato","year":"2023","journal-title":"Ann. Oper. Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e1821","DOI":"10.1002\/mcda.1821","article-title":"Improving consistency classification: An innovative benchmark-based approach for the AHP","volume":"31","author":"Bose","year":"2024","journal-title":"J. Multi-Criteria Decis. Anal."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"106936","DOI":"10.1016\/j.asoc.2020.106936","article-title":"Towards minimization of overall inconsistency involved in criteria weights for improved decision making","volume":"100","author":"Mufazzal","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/S0160-2896(99)00024-0","article-title":"Theory Testing and Measurement Error","volume":"27","author":"Schmidt","year":"1999","journal-title":"Intelligence"},{"key":"ref_35","first-page":"14336","article-title":"Review of the main developments in the analytic hierarchy process","volume":"38","author":"Ishizaka","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3518","DOI":"10.3168\/jds.S0022-0302(02)74441-X","article-title":"Producer Breeding Objectives and Optimal Sire Selection","volume":"85","author":"Tozer","year":"2002","journal-title":"J. Dairy Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1007\/s40258-013-0051-z","article-title":"Preferences for Colorectal Cancer Screening Techniques and Intention to Attend: A Multi-Criteria Decision Analysis","volume":"11","author":"Hummel","year":"2013","journal-title":"Appl. Health Econ. Health Policy"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.marpol.2012.02.016","article-title":"Management objectives of Queensland fisheries: Putting the horse before the cart","volume":"37","author":"Pascoe","year":"2013","journal-title":"Mar. Policy"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1111\/j.1475-3995.2004.00443.x","article-title":"An expert module to improve the consistency of AHP matrices","volume":"11","author":"Ishizaka","year":"2004","journal-title":"Int. Trans. Oper. Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"102277","DOI":"10.1016\/j.mex.2023.102277","article-title":"A web-based software for group decision with analytic hierarchy process","volume":"11","author":"Junior","year":"2023","journal-title":"MethodsX"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.autcon.2011.09.004","article-title":"Automatic repair of inconsistent pairwise weighting matrices in analytic hierarchy process","volume":"22","author":"Yang","year":"2012","journal-title":"Autom. Constr."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.autcon.2007.03.004","article-title":"Improving AHP for construction with an adaptive AHP approach (A3)","volume":"17","author":"Lin","year":"2008","journal-title":"Autom. Constr."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.amc.2016.01.008","article-title":"Reconstruction methods for AHP pairwise matrices: How reliable are they?","volume":"279","author":"Karanik","year":"2016","journal-title":"Appl. Math. Comput."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"4449","DOI":"10.1016\/j.apm.2011.03.013","article-title":"Achieving matrix consistency in AHP through linearization","volume":"35","author":"Izquierdo","year":"2011","journal-title":"Appl. Math. Model."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"3968","DOI":"10.1016\/j.apm.2014.01.007","article-title":"A simple formula to find the closest consistent matrix to a reciprocal matrix","volume":"38","author":"Izquierdo","year":"2014","journal-title":"Appl. Math. Model."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.ejor.2013.11.035","article-title":"Enhancing data consistency in decision matrix: Adapting Hadamard model to mitigate judgment contradiction","volume":"236","author":"Kou","year":"2014","journal-title":"Eur. J. Oper. Res."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Pascoe, S. (2022). A Simplified Algorithm for Dealing with Inconsistencies Using the Analytic Hierarchy Process. Algorithms, 15.","DOI":"10.3390\/a15120442"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1007\/s10479-014-1750-z","article-title":"Nonlinear programming applied to the reduction of inconsistency in the AHP method","volume":"229","author":"Pereira","year":"2015","journal-title":"Ann. Oper. Res."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1016\/j.dss.2007.11.002","article-title":"Modifying inconsistent comparison matrix in analytic hierarchy process: A heuristic approach","volume":"44","author":"Cao","year":"2008","journal-title":"Decis. Support Syst."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Pascoe, S., Cannard, T., Dowling, N.A., Dichmont, C.M., Breen, S., Roberts, T., Pears, R.J., and Leigh, G.M. (2019). Developing Harvest Strategies to Achieve Ecological, Economic and Social Sustainability in Multi-Sector Fisheries. Sustainability, 11.","DOI":"10.3390\/su11030644"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"68002","DOI":"10.1209\/0295-5075\/100\/68002","article-title":"Anchoring bias in online voting","volume":"100","author":"Yang","year":"2012","journal-title":"Europhys. Lett."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1037\/apl0000444","article-title":"Selecting response anchors with equal intervals for summated rating scales","volume":"105","author":"Casper","year":"2020","journal-title":"J. Appl. Psychol."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/0022-2496(85)90002-1","article-title":"A note on the analysis of subjective judgment matrices","volume":"29","author":"Crawford","year":"1985","journal-title":"J. Math. Psychol."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/S0377-2217(99)00204-0","article-title":"Local stability intervals in the analytic hierarchy process","volume":"125","year":"2000","journal-title":"Eur. J. Oper. Res."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/0270-0255(87)90489-1","article-title":"The geometric mean procedure for estimating the scale of a judgement matrix","volume":"9","author":"Crawford","year":"1987","journal-title":"Math. Model."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/S0377-2217(02)00255-2","article-title":"The geometric consistency index: Approximated thresholds","volume":"147","year":"2003","journal-title":"Eur. J. Oper. Res."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"118689","DOI":"10.1016\/j.eswa.2022.118689","article-title":"Genetic algorithm optimised Hadamard product method for inconsistency judgement matrix adjustment in AHP and automatic analysis system development","volume":"211","author":"Zhang","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1007\/s12597-020-00450-z","article-title":"Using genetic algorithm to improve consistency and retain authenticity in the analytic hierarchy process","volume":"57","author":"Bose","year":"2020","journal-title":"Opsearch"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"4669","DOI":"10.3233\/JIFS-212041","article-title":"Remarks on the inconsistency measure of the Analytic Hierarchy Process","volume":"43","author":"Dhurkari","year":"2022","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/j.ejor.2004.05.031","article-title":"User acceptance of multi-criteria decision support systems: The impact of preference elicitation techniques","volume":"169","author":"Aloysius","year":"2006","journal-title":"Eur. J. Oper. Res."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1080\/713676575","article-title":"An Evaluation of Multiple Objective Decision Support Weighting Techniques in Natural Resource Management","volume":"43","author":"Hajkowicz","year":"2000","journal-title":"J. Environ. Plan. Manag."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.eswa.2019.02.036","article-title":"A new parsimonious AHP methodology: Assigning priorities to many objects by comparing pairwise few reference objects","volume":"127","author":"Abastante","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1080\/01605682.2020.1824553","article-title":"Introduction and comparative analysis of the multi-level parsimonious AHP methodology in a public transport development decision problem","volume":"73","author":"Duleba","year":"2022","journal-title":"J. Oper. Res. Soc."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1080\/21568316.2023.2276222","article-title":"Prioritizing Influential Factors on Tourist Decision-Making for Choosing Destinations Using Parsimonious Analytical Hierarchy Process (PAHP)","volume":"21","year":"2024","journal-title":"Tour. Plan. Dev."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Stanco, M., Lerro, M., and Marotta, G. (2020). Consumers\u2019 Preferences for Wine Attributes: A Best-Worst Scaling Analysis. Sustainability, 12.","DOI":"10.3390\/su12072819"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.omega.2014.11.009","article-title":"Best-worst multi-criteria decision-making method","volume":"53","author":"Rezaei","year":"2015","journal-title":"Omega"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.omega.2015.12.001","article-title":"Best-worst multi-criteria decision-making method: Some properties and a linear model","volume":"64","author":"Rezaei","year":"2016","journal-title":"Omega"},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"107168","DOI":"10.1016\/j.asoc.2021.107168","article-title":"A weighting model based on best\u2013worst method and its application for environmental performance evaluation","volume":"103","author":"Liu","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.trpro.2018.10.039","article-title":"Eliciting preferences for \u2018gamified\u2019 travel surveys: A best-worst approach","volume":"32","author":"Verzosa","year":"2018","journal-title":"Transp. Res. Procedia"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"757310","DOI":"10.3389\/fpubh.2021.757310","article-title":"Investigating Medical Student\u2019s Preferences for Internet-Based Healthcare Services: A Best-Worst Scaling Survey","volume":"9","author":"Xu","year":"2021","journal-title":"Front. Public Health"},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"100466","DOI":"10.1016\/j.jocm.2023.100466","article-title":"The rise of best-worst scaling for prioritization: A transdisciplinary literature review","volume":"50","author":"Schuster","year":"2024","journal-title":"J. Choice Model."},{"key":"ref_72","first-page":"396","article-title":"Likert Scale: Explored and Explained","volume":"7","author":"Joshi","year":"2015","journal-title":"Curr. J. Appl. Sci. Technol."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"625","DOI":"10.12973\/ijem.8.4.625","article-title":"Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review","volume":"8","author":"Kusmaryono","year":"2022","journal-title":"Int. J. Educ. Methodol."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1080\/01488376.2017.1329775","article-title":"Can Likert Scales be Treated as Interval Scales?\u2014A Simulation Study","volume":"43","author":"Wu","year":"2017","journal-title":"J. Soc. Serv. Res."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1002\/mcda.1479","article-title":"A Comprehensive Literature Review of the Rank Reversal Phenomenon in the Analytic Hierarchy Process","volume":"20","author":"Maleki","year":"2013","journal-title":"J. Multi-Criteria Decis. Anal."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/6\/245\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:54:33Z","timestamp":1760108073000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/6\/245"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,6]]},"references-count":75,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["a17060245"],"URL":"https:\/\/doi.org\/10.3390\/a17060245","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,6]]}}}