{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T17:44:03Z","timestamp":1784137443507,"version":"3.55.0"},"reference-count":29,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T00:00:00Z","timestamp":1770076800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Committee of Science of the Ministry of Science and Higher Education of the Republic of Kazakhstan","award":["BR28713385"],"award-info":[{"award-number":["BR28713385"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>The evaluation of research and development (R&amp;D) project proposals plays a critical role in shaping national scientific and technological priorities. However, existing expert review systems are often characterized by fragmented digital workflows, limited traceability of decisions, and a strong reliance on manual coordination, which reduces transparency and auditability. This paper proposes a conceptual and methodological framework for a national research project evaluation system that integrates artificial intelligence and blockchain technologies as complementary decision-support and data integrity mechanisms. The framework formalizes the complete evaluation lifecycle, including applicant authorization, formal compliance verification, originality and plagiarism analysis, expert selection and assessment, analytical consolidation of reviews, and fixation of final decisions. Artificial intelligence modules are introduced to support thematic classification, compliance checking, expert matching, and analytical processing of expert evaluations, while blockchain technology is incorporated as an immutable integrity layer for recording critical evaluation events and ensuring data provenance. The proposed approach focuses on architectural design, governance principles, and process modeling rather than system implementation or empirical validation. The framework is intended to serve as a reference model for the design and future development of transparent, accountable, and scalable research project evaluation platforms at national and institutional levels.<\/jats:p>","DOI":"10.3390\/info17020151","type":"journal-article","created":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T09:00:58Z","timestamp":1770109258000},"page":"151","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Conceptual Framework for AI- and Blockchain-Enabled Research Project Evaluation Systems"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6779-9393","authenticated-orcid":false,"given":"Saule","family":"Amanzholova","sequence":"first","affiliation":[{"name":"School of Cybersecurity, Astana IT University, Astana 010000, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1375-1343","authenticated-orcid":false,"given":"Galimkair","family":"Mutanov","sequence":"additional","affiliation":[{"name":"Institute of Information and Computational Technologies, Almaty 050010, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5276-6118","authenticated-orcid":false,"given":"Olga","family":"Ussatova","sequence":"additional","affiliation":[{"name":"Institute of Information and Computational Technologies, Almaty 050010, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6815-1989","authenticated-orcid":false,"given":"Laura","family":"Aldasheva","sequence":"additional","affiliation":[{"name":"School of Cybersecurity, Astana IT University, Astana 010000, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5715-4954","authenticated-orcid":false,"given":"Akzhibek","family":"Amirova","sequence":"additional","affiliation":[{"name":"School of Cybersecurity, Astana IT University, Astana 010000, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9393-6733","authenticated-orcid":false,"given":"Vitaliy","family":"Naumenko","sequence":"additional","affiliation":[{"name":"Institute of Information and Computational Technologies, Almaty 050010, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,2,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1002\/aris.2011.1440450112","article-title":"Scientific peer review","volume":"45","author":"Lutz","year":"2011","journal-title":"Annu. Rev. Inf. Sci. Technol."},{"key":"ref_2","first-page":"1","article-title":"Peer review for funding decisions","volume":"11","author":"Liu","year":"2025","journal-title":"J. Data Inf. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1002\/asi.22784","article-title":"Bias in peer review","volume":"64","author":"Lee","year":"2013","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1007\/s11192-017-2518-4","article-title":"Scientometrics of peer review","volume":"113","author":"Squazzoni","year":"2017","journal-title":"Scientometrics"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"fny204","DOI":"10.1093\/femsle\/fny204","article-title":"The state of the art in peer review","volume":"365","author":"Tennant","year":"2018","journal-title":"FEMS Microbiol. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wilsdon, J. (2017). Responsible metrics. Higher Education Strategy and Planning, Routledge.","DOI":"10.4324\/9781315206455-15"},{"key":"ref_7","unstructured":"Charlin, L., and Richard, Z. (2025, December 10). The Toronto Paper Matching System: An Automated Paper-Reviewer Assignment System. Available online: https:\/\/openreview.net\/pdf?id=caynafZAnBafx."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2635","DOI":"10.1007\/s10639-019-10063-9","article-title":"A systematic review: Machine learning based recommendation systems for e-learning","volume":"25","author":"Khanal","year":"2020","journal-title":"Educ. Inf. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1617","DOI":"10.1007\/s11192-025-05263-9","article-title":"The university research assessment dilemma: A decision support system for the next evaluation campaigns","volume":"130","author":"Fantozzi","year":"2025","journal-title":"Scientometrics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2053951716679679","DOI":"10.1177\/2053951716679679","article-title":"The ethics of algorithms: Mapping the debate","volume":"3","author":"Mittelstadt","year":"2016","journal-title":"Big Data Soc."},{"key":"ref_11","unstructured":"Nakamoto, S. (2008). Bitcoin: A Peer-to-Peer Electronic Cash System, SSRN."},{"key":"ref_12","first-page":"80","article-title":"1 Blockchain\u2019s roles in meeting key supply chain management objectives","volume":"39","author":"Kshetri","year":"2018","journal-title":"Int. J. Inf. Manag."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Dasaklis, T.K., Voutsinas, T.G., Tsoulfas, G.T., and Casino, F. (2022). A systematic literature review of blockchain-enabled supply chain traceability implementations. Sustainability, 14.","DOI":"10.3390\/su14042439"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"851","DOI":"10.12688\/f1000research.19156.1","article-title":"Measuring bias, burden and conservatism in research funding processes","volume":"8","author":"Guthrie","year":"2019","journal-title":"F1000Research"},{"key":"ref_15","unstructured":"European Commission (2021). Horizon Europe Programme Guide, European Commission."},{"key":"ref_16","unstructured":"European Commission (2022). Horizon Europe Evaluation Criteria, European Commission."},{"key":"ref_17","unstructured":"National Science Foundation (2023). Proposal & Award Policies and Procedures Guide, National Science Foundation."},{"key":"ref_18","unstructured":"National Institutes of Health (2023). Peer Review Process, National Institutes of Health."},{"key":"ref_19","unstructured":"NSF (2022). Merit Review Criteria, NSF."},{"key":"ref_20","unstructured":"NIH (2022). Scoring System and Overall Impact, NIH."},{"key":"ref_21","unstructured":"UK Research and Innovation (2022). Assessment Process and Criteria, UK Research and Innovation."},{"key":"ref_22","unstructured":"UKRI (2021). Peer Review and Panel Moderation, UKRI."},{"key":"ref_23","unstructured":"Australian Research Council (2022). ARC Assessment Criteria, Australian Research Council."},{"key":"ref_24","unstructured":"Japan Society for the Promotion of Science (2021). Review Criteria and Procedures, Japan Society for the Promotion of Science."},{"key":"ref_25","unstructured":"Agence Nationale de la Recherche (2022). Evaluation Process, Agence Nationale de la Recherche."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Deutsche Forschungsgemeinschaft (2021). Guidelines for Proposal Review, Deutsche Forschungsgemeinschaft.","DOI":"10.1515\/9783110618839"},{"key":"ref_27","unstructured":"OECD (2019). DAC Criteria for Evaluating Development Assistance, OECD."},{"key":"ref_28","unstructured":"Wilsdon, J., Allen, L., Belfiore, E., Campbell, P., Curry, S., Hill, S., Jones, R., Kain, R., Kerridge, S., and Thelwall, M. (2015). The Metric Tide, HEFCE."},{"key":"ref_29","unstructured":"National Center for State Scientific and Technical Expertise of the Republic of Kazakhstan (2025, December 26). Information System for Scientific and Technical Expertise. Available online: https:\/\/is.ncste.kz\/."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/17\/2\/151\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T09:16:18Z","timestamp":1770110178000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/17\/2\/151"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,3]]},"references-count":29,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2026,2]]}},"alternative-id":["info17020151"],"URL":"https:\/\/doi.org\/10.3390\/info17020151","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,3]]}}}