{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T22:25:52Z","timestamp":1769120752528,"version":"3.49.0"},"reference-count":61,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T00:00:00Z","timestamp":1768867200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004281","name":"National Science Centre","doi-asserted-by":"publisher","award":["2021\/41\/B\/HS4\/03475"],"award-info":[{"award-number":["2021\/41\/B\/HS4\/03475"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"publisher"}]},{"name":"AGH University of Krakow","award":["14982"],"award-info":[{"award-number":["14982"]}]},{"name":"Polish Ministry of Science and Higher Education and AGH University of Krakow","award":["11.11.420.004"],"award-info":[{"award-number":["11.11.420.004"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Axioms"],"abstract":"<jats:p>Group decision-making sometimes involves evaluating the decision-makers themselves, e.g., selecting the best expert or assigning rewards within a team. In such cases, all participants should be involved, but their influence should reflect their competence or contribution. This article proposes two new opinion aggregation models in which a person\u2019s assessment weight depends on their ranking, preventing low-performing members from exerting the same influence and promoting respected experts. The proposed aggregation methods uphold the principle of distributive justice by ensuring that individual contributions are proportional to the rewards they receive. In addition to formulating new methods for aggregating results, we presented several of their formal properties and indicated practical ways to calculate the results. For one of the methods, which is more challenging to compute, we conducted a Monte Carlo experiment demonstrating the practical feasibility of computing the aggregated weight vector.<\/jats:p>","DOI":"10.3390\/axioms15010071","type":"journal-article","created":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T14:57:58Z","timestamp":1768921078000},"page":"71","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Assessment-Driven Judgment Aggregation Within a Group of Peers"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2857-0916","authenticated-orcid":false,"given":"Konrad","family":"Ku\u0142akowski","sequence":"first","affiliation":[{"name":"Faculty of Electrical Engineering, Automatics, Computer Science and Biomedical Engineering, AGH University of Krakow, al. Mickiewicza 30, 30-059 Krak\u00f3w, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4182-0454","authenticated-orcid":false,"given":"Jacek","family":"Szybowski","sequence":"additional","affiliation":[{"name":"Faculty of Applied Mathematics, AGH University of Krakow, al. Mickiewicza 30, 30-059 Krak\u00f3w, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1016\/0022-2496(77)90033-5","article-title":"A scaling method for priorities in hierarchical structures","volume":"15","author":"Saaty","year":"1977","journal-title":"J. Math. Psychol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/0022-2496(83)90028-7","article-title":"Procedures for synthesizing ratio judgements","volume":"27","author":"Saaty","year":"1983","journal-title":"J. Math. Psychol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/S0893-9659(98)00068-8","article-title":"Ranking by eigenvector versus other methods in the analytic hierarchy process","volume":"11","author":"Saaty","year":"1998","journal-title":"Appl. Math. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/S0377-2217(97)00244-0","article-title":"Aggregating individual judgments and priorities with the analytic hierarchy process","volume":"108","author":"Forman","year":"1998","journal-title":"Eur. J. Oper. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/0377-2217(94)90356-5","article-title":"Group preference aggregation methods employed in AHP: An evaluation and an intrinsic process for deriving members\u2019 weightages","volume":"79","author":"Ramanathan","year":"1994","journal-title":"Eur. J. Oper. Res."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ku\u0142akowski, K. (2020). Understanding the Analytic Hierarchy Process, Chapman and Hall\/CRC Press.","DOI":"10.1201\/9781315392226"},{"key":"ref_7","first-page":"57","article-title":"AHP rank reversal, normalization and aggregation rules","volume":"32","author":"Barzilai","year":"1994","journal-title":"INFOR-Inf. Syst. Oper. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.ins.2015.10.033","article-title":"Heuristic aggregation of individual judgments in AHP group decision making using simulated annealing algorithm","volume":"330","author":"Blagojevic","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.dss.2010.03.003","article-title":"Consensus models for AHP group decision making under row geometric mean prioritization method","volume":"49","author":"Dong","year":"2010","journal-title":"Decis. Support Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/j.ejor.2006.07.025","article-title":"A Bayesian priorization procedure for AHP-group decision making","volume":"182","author":"Altuzarra","year":"2007","journal-title":"Eur. J. Oper. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1007\/s10726-006-9050-x","article-title":"Aggregation of Individual Preference Structures in AHP-Group Decision Making","volume":"16","author":"Escobar","year":"2007","journal-title":"Group Decis. Negot."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/s10479-020-03572-1","article-title":"Aggregation of the nearest consistency matrices with the acceptable consensus in AHP-GDM","volume":"316","author":"Lin","year":"2022","journal-title":"Ann. Oper. Res."},{"key":"ref_13","first-page":"143","article-title":"Estimating Priorities in Group AHP Using Interval Comparison Matrices","volume":"8","author":"Zadnik","year":"2013","journal-title":"Mult. Criteria Decis. Mak."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Karczmarek, P., Pedrycz, W., and Kiersztyn, A. (2021). Fuzzy Analytic Hierarchy Process in a Graphical Approach. Group Decision and Negotiation, Springer.","DOI":"10.1007\/s10726-020-09719-6"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1007\/s10726-014-9401-y","article-title":"A Group Decision-Making Methodology with Incomplete Individual Beliefs Applied to e-Democracy","volume":"24","author":"Mateos","year":"2015","journal-title":"Group Decis. Negot."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"119979","DOI":"10.1016\/j.ins.2023.119979","article-title":"Resilient heuristic aggregation of judgments in the pairwise comparisons method","volume":"657","author":"Szybowski","year":"2024","journal-title":"Inf. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"118933","DOI":"10.1016\/j.ins.2023.118933","article-title":"Consensus modeling with interactive utility and partial preorder of decision-makers, involving fairness and tolerant behavior","volume":"638","author":"Zhao","year":"2023","journal-title":"Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.knosys.2018.05.032","article-title":"Identifying items for moderation in a peer assessment framework","volume":"162","author":"James","year":"2018","journal-title":"Knowl.-Based Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.24059\/olj.v18i2.429","article-title":"Peer Grading in a MOOC: Reliability, Validity, and Perceived Effects","volume":"18","author":"Luo","year":"2014","journal-title":"Online Learn."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1109\/TLT.2016.2565476","article-title":"A Fuzzy Group Decision Making Model for Ordinal Peer Assessment","volume":"10","author":"Capuano","year":"2017","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1080\/02602930701292498","article-title":"Relationships between student characteristics and self, peer and tutor evaluations of oral presentations","volume":"33","author":"Langan","year":"2008","journal-title":"Assess. Eval. High. Educ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.ijar.2020.12.007","article-title":"A Bayesian method for calibration and aggregation of expert judgement","volume":"130","author":"Hartley","year":"2021","journal-title":"Int. J. Approx. Reason."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Greco, S., Ehrgott, M., and Figueira, J.R. (2016). Multiple Criteria Decision Analysis: State of the Art Surveys, Springer.","DOI":"10.1007\/978-1-4939-3094-4"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.ins.2023.01.034","article-title":"Group AHP framework based on geometric standard deviation and interval group pairwise comparisons","volume":"626","author":"Dolinar","year":"2023","journal-title":"Inf. Sci."},{"key":"ref_25","first-page":"100560","article-title":"Application of grey analytic hierarchy process to estimate mode choice alternatives: A case study from Budapest","volume":"13","author":"Duleba","year":"2022","journal-title":"Transp. Res. Interdiscip. Perspect."},{"key":"ref_26","first-page":"92","article-title":"Review of different methods for deriving weights in The Analytic Hierarchy Process","volume":"6","author":"Hefnawy","year":"2014","journal-title":"Int. J. Anal. Hierarchy Process"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.mcm.2010.02.047","article-title":"On optimal completion of incomplete pairwise comparison matrices","volume":"52","year":"2010","journal-title":"Math. Comput. Model."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1080\/03081079.2019.1585432","article-title":"The (logarithmic) least squares optimality of the arithmetic (geometric) mean of weight vectors calculated from all spanning trees for incomplete additive (multiplicative) pairwise comparison matrices","volume":"48","author":"Tsyganok","year":"2019","journal-title":"Int. J. Gen. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ku\u0142akowski, K. (2020). On the Geometric Mean Method for Incomplete Pairwise Comparisons. Mathematics, 8.","DOI":"10.3390\/math8111873"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1080\/03081079.2018.1523156","article-title":"A survey of inconsistency indices for pairwise comparisons","volume":"47","author":"Brunelli","year":"2018","journal-title":"Int. J. Gen. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1080\/03081079.2020.1713116","article-title":"Inconsistency indices for incomplete pairwise comparisons matrices","volume":"49","author":"Talaga","year":"2020","journal-title":"Int. J. Gen. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Munier, N., and Hontoria, E. (2021). Uses and Limitations of the AHP Method: A Non-Mathematical and Rational Analysis, Springer International Publishing.","DOI":"10.1007\/978-3-030-60392-2"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/0270-0255(87)90489-1","article-title":"The geometric mean procedure for estimating the scale of a judgement matrix","volume":"9","author":"Crawford","year":"1987","journal-title":"Math. Model."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"120015","DOI":"10.1016\/j.eswa.2023.120015","article-title":"Prioritisation in the analytic hierarchy process for real and generated comparison matrices","volume":"225","author":"Srdjevic","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1016\/S0305-0548(03)00042-X","article-title":"A common framework for deriving preference values from pairwise comparison matrices","volume":"31","author":"Choo","year":"2004","journal-title":"Comput. Oper. Res."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1016\/j.ijar.2022.08.014","article-title":"On the derivation of weights from incomplete pairwise comparisons matrices via spanning trees with crisp and fuzzy confidence levels","volume":"150","author":"Mazurek","year":"2022","journal-title":"Int. J. Approx. Reason."},{"key":"ref_37","unstructured":"Margalit, D., Rabinoff, J., and Williams, B. (2024). Interactive Linear Algebra, Georgia Institute of Technology, University of British Columbia."},{"key":"ref_38","first-page":"251","article-title":"Relative Measurement and Its Generalization in Decision Making. Why Pairwise Comparisons are Central in Mathematics for the Measurement of Intangible Factors. The Analytic Hierarchy\/Network Process","volume":"102","author":"Saaty","year":"2008","journal-title":"Estad\u00edstica Investig. Oper.\/Stat. Oper. Res. (RACSAM)"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Dong, Y., and Xu, J. (2016). Consensus Building in Group Decision Making: Searching the Consensus Path with Minimum Adjustments, Springer.","DOI":"10.1007\/978-981-287-892-2"},{"key":"ref_40","unstructured":"Golub, G.H., and Van Loan, C.F. (1996). Matrix Computations, Johns Hopkins University Press. [3rd ed.]."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Subrahmanyam, P.V. (2018). Elementary Fixed Point Theorems, Springer.","DOI":"10.1007\/978-981-13-3158-9"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.15352\/bjma\/1240321550","article-title":"On Stefan Banach and some of his results","volume":"1","author":"Ciesielski","year":"2007","journal-title":"Banach J. Math. Anal."},{"key":"ref_43","unstructured":"Nair, P. (2025). Softmax is 1\/2-Lipschitz: A tight bound across all \u2113p norms. arXiv, arxiv.2510.23012."},{"key":"ref_44","unstructured":"Arrow, K.J. (1977). Social Choice and Individual Values, Yale University Press. [2nd ed.]."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1093\/jigpal\/jzp062","article-title":"On distance-based inconsistency reduction algorithms for pairwise comparisons","volume":"18","author":"Koczkodaj","year":"2010","journal-title":"Log. J. IGPL"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1007\/s11257-023-09380-z","article-title":"An overview of consensus models for group decision-making and group recommender systems","volume":"34","author":"Tran","year":"2023","journal-title":"User Model. User-Adapt. Interact."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"5","DOI":"10.17730\/humo.12.1.304x56630j17j785","article-title":"Status Among Clerical Workers","volume":"12","author":"Homans","year":"1953","journal-title":"Hum. Organ."},{"key":"ref_48","unstructured":"Homans, G.C. (1974). Social Behavior; Its Elementary Forms, Harcourt, Brace, Jovanovich. [rev. ed.]. Chapter xi."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1037\/h0040968","article-title":"Towards an understanding of inequity","volume":"67","author":"Adams","year":"1963","journal-title":"J. Abnorm. Soc. Psychol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/S0065-2601(08)60108-2","article-title":"Inequity In Social Exchange","volume":"Volume 2","author":"Adams","year":"1965","journal-title":"Advances in Experimental Social Psychology"},{"key":"ref_51","unstructured":"Sayles, L.R. (1958). Behavior of Industrial Work Groups: Prediction and Control, John Wiley."},{"key":"ref_52","unstructured":"Patchen, M. (1961). The Choice of Wage Comparisons, Prentice-Hall."},{"key":"ref_53","first-page":"71","article-title":"Aggregation Methods in Group Decision Making: A Decade Survey","volume":"41","author":"Mohd","year":"2017","journal-title":"Informatica"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Petrovi\u0107, G., Mihajlovi\u0107, J., Markovi\u0107, D., Hashemkhani Zolfani, S., and Madi\u0107, M. (2023). Comparison of Aggregation Operators in the Group Decision-Making Process: A Real Case Study of Location Selection Problem. Sustainability, 15.","DOI":"10.3390\/su15108229"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1016\/j.ejor.2021.08.049","article-title":"Weighted aggregation systems and an expectation level-based weighting and scoring procedure","volume":"299","author":"Dombi","year":"2022","journal-title":"Eur. J. Oper. Res."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"102576","DOI":"10.1016\/j.omega.2021.102576","article-title":"Inconsistency thresholds for incomplete pairwise comparison matrices","volume":"108","year":"2022","journal-title":"Omega"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1016\/j.ejor.2018.03.024","article-title":"Inconsistency in the ordinal pairwise comparisons method with and without ties","volume":"270","year":"2018","journal-title":"Eur. J. Oper. Res."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.omega.2017.02.008","article-title":"Strategic weight manipulation in multiple attribute decision making","volume":"75","author":"Dong","year":"2018","journal-title":"Omega"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"7315","DOI":"10.1007\/s10462-022-10361-8","article-title":"An approach to prevent weight manipulation by minimum adjustment and maximum entropy method in social network group decision making","volume":"56","author":"Sun","year":"2022","journal-title":"Artif. Intell. Rev."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"121560","DOI":"10.1016\/j.eswa.2023.121560","article-title":"A consensus method in social network large-scale group decision making with interval information","volume":"237","author":"Tan","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"119848","DOI":"10.1016\/j.ins.2023.119848","article-title":"A consensus model considers managing manipulative and overconfident behaviours in large-scale group decision-making","volume":"654","author":"Liang","year":"2024","journal-title":"Inf. Sci."}],"container-title":["Axioms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-1680\/15\/1\/71\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T05:25:55Z","timestamp":1769059555000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-1680\/15\/1\/71"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,20]]},"references-count":61,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["axioms15010071"],"URL":"https:\/\/doi.org\/10.3390\/axioms15010071","relation":{},"ISSN":["2075-1680"],"issn-type":[{"value":"2075-1680","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,20]]}}}