{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T00:42:01Z","timestamp":1774658521845,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,11,10]],"date-time":"2025-11-10T00:00:00Z","timestamp":1762732800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan","award":["AP26199077"],"award-info":[{"award-number":["AP26199077"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Publications"],"abstract":"<jats:p>Modern approaches to research assessment often treat two independent dimensions: the degree of readiness (the progress of scientific maturity) and the Added Scientific Value (novelty, rigor, reproducibility, and societal significance). The present study aims to develop an integrative model that links the stepwise logic of Scientific Readiness Levels (SRLs) with the continuous evaluation of Added Scientific Value (ASV). To achieve this, we construct a two-dimensional quantitative framework, SRL \u00d7 ASV, in which discrete readiness levels are combined with the multiplicative aggregation of normalized qualitative indicators\u2014including novelty, rigor, reproducibility, openness, impact, and collaboration. Advancement to a higher readiness level becomes possible only when the evidential criteria are simultaneously satisfied and the ASV threshold value is reached. The model is formally defined and illustrated via the example of Kazakhstan\u2019s national science funding system. The results demonstrate that the integration of SRL and ASV creates a reproducible and transparent decision-making structure in which weak components cannot be compensated by strong ones, and excessive dependence on purely metric-based evaluations is eliminated. By uniting maturity and quality within a single coherent system, the SRL + ASV model bridges the gap between developmental staging and scientific value, transforming research assessment into a transparent, evidence-based, and continuously improvable process applicable to the governance of responsible and reproducible science.<\/jats:p>","DOI":"10.3390\/publications13040057","type":"journal-article","created":{"date-parts":[[2025,11,10]],"date-time":"2025-11-10T13:51:08Z","timestamp":1762782668000},"page":"57","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Integrating Scientific Readiness and Added Scientific Value: A Multiplicative Conceptual Model for Research Assessment"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7490-8375","authenticated-orcid":false,"given":"Eldar","family":"Knar","sequence":"first","affiliation":[{"name":"Institute of Philosophy, Political Science and Religion Studies, Ministry of Science and Higher Education of the Republic of Kazakhstan, Str. Kurmangazy, 29, Almaty City 050010, Kazakhstan"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1093\/scipol\/scu087","article-title":"How incentives trickle down: Local use of a national bibliometric indicator system","volume":"42","author":"Aagaard","year":"2015","journal-title":"Science and Public Policy"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1002\/asi.22803","article-title":"What is societal impact of research and how can it be assessed? A literature survey","volume":"64","author":"Bornmann","year":"2013","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bozeman, B., and Melkers, J. (1993). Evaluating R&D impacts: Methods and practice, Springer.","DOI":"10.1007\/978-1-4757-5182-6"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/0149-7189(79)90048-X","article-title":"Assessing the impact of planned social change","volume":"2","author":"Campbell","year":"1979","journal-title":"Evaluation and Program Planning"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1016\/0305-0548(94)00059-H","article-title":"Determining objective weights in multiple criteria problems: The CRITIC method","volume":"22","author":"Diakoulaki","year":"1995","journal-title":"Computers and Operations Research"},{"key":"ref_6","unstructured":"DORA (2025, September 01). San Francisco Declaration on Research Assessment (DORA), Available online: https:\/\/sfdora.org."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Engel, C. C., Silberglitt, R., Chow, B. G., Jones, M. M., and Grant, J. (2019). Development of a knowledge readiness level framework for medical research, RAND Corporation.","DOI":"10.7249\/RR2127"},{"key":"ref_8","unstructured":"ESA (2023). Scientific Readiness Levels (SRL) handbook, Available online: https:\/\/missionadvice.esa.int\/wp-content\/uploads\/2024\/01\/Scientific-Readiness-Levels-Handbook-document-v2.0-Web.pdf."},{"key":"ref_9","unstructured":"European Commission (2025, September 01). Horizon 2020\u2014Work programme 2014\u20132015: General annexes, part 19\u2014Annex G: Technology Readiness Levels (TRL), Available online: https:\/\/ec.europa.eu\/research\/participants\/data\/ref\/h2020\/wp\/2014_2015\/annexes\/h2020-wp1415-annex-g-trl_en.pdf."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1023\/B:MINE.0000005155.70870.bd","article-title":"University research evaluation and funding: An international comparison","volume":"41","author":"Geuna","year":"2003","journal-title":"Minerva"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1007\/s11192-012-0898-z","article-title":"Opinion paper: Thoughts and facts on bibliometric indicators","volume":"96","author":"Moed","year":"2013","journal-title":"Scientometrics"},{"key":"ref_12","first-page":"29","article-title":"Goodhart\u2019s law","volume":"9","author":"Goodhart","year":"2013","journal-title":"Libellio"},{"key":"ref_13","unstructured":"Guan, H., Gentimis, T., Krim, H., and Keiser, J. (2017). First study on data readiness level. arXiv, Available online: https:\/\/arxiv.org\/pdf\/1702.02107.pdf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"75","DOI":"10.2307\/25148625","article-title":"Design science in information systems research","volume":"28","author":"Hevner","year":"2004","journal-title":"MIS Quarterly"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.respol.2011.09.007","article-title":"Performance-based university research funding systems","volume":"41","author":"Hicks","year":"2012","journal-title":"Research Policy"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/520429a","article-title":"The Leiden Manifesto for research metrics","volume":"520","author":"Hicks","year":"2015","journal-title":"Nature"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hwang, C.-L., and Yoon, K. (1981). Multiple attributes decision making methods and applications, Springer.","DOI":"10.1007\/978-3-642-48318-9"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2, (8).","DOI":"10.1371\/journal.pmed.0020124"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1007\/s13162-020-00161-0","article-title":"Designing conceptual articles: Four approaches","volume":"10","author":"Jaakkola","year":"2020","journal-title":"AMS Review"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1162\/dint_r_00024","article-title":"FAIR principles: Interpretations and implementation considerations","volume":"2","author":"Jacobsen","year":"2020","journal-title":"Data Intelligence"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1108\/JARHE-02-2020-0048","article-title":"Statistical analysis of ERA and the quality of research in Australian universities","volume":"13","author":"Jajo","year":"2021","journal-title":"Journal of Applied Research in Higher Education"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1007\/s10198-020-01195-8","article-title":"Which multiattribute utility instruments are recommended for use in cost\u2013utility analysis? A review of national health technology assessment (HTA) guidelines","volume":"21","author":"Slaap","year":"2020","journal-title":"European Journal of Health Economics"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Knar, E. (2024a). Level of scientific readiness with ternary data types. arXiv.","DOI":"10.31235\/osf.io\/jk7dz"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Knar, E. (2024b). Recursive index for assessing value added of individual scientific publications. arXiv.","DOI":"10.33774\/coe-2024-m32bc"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.eswa.2018.06.060","article-title":"Aggregation in the analytic hierarchy process: Why weighted geometric mean should be used instead of weighted arithmetic mean","volume":"114","author":"Stoklasa","year":"2018","journal-title":"Expert Systems with Applications"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.rai.2015.08.001","article-title":"Application of maturity assessment tools in the innovation process: Converting system\u2019s emergent properties into technological knowledge","volume":"13","author":"Lemos","year":"2016","journal-title":"RAI: Revista de Administra\u00e7\u00e3o e Inova\u00e7\u00e3o"},{"key":"ref_27","unstructured":"Manheim, D. (2018). Building less flawed metrics: Dodging Goodhart and Campbell\u2019s laws, Munich Personal RePEc Archive."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1007\/s11192-016-2111-2","article-title":"Change of perspective: Bibliometrics from the point of view of cited references","volume":"109","author":"Marx","year":"2016","journal-title":"Scientometrics"},{"key":"ref_29","first-page":"3","article-title":"Theory building through conceptual methods","volume":"13","author":"Meredith","year":"1993","journal-title":"International Journal of Operations & Production Management"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1063\/1.3128814","article-title":"The sociology of science: Theoretical and empirical investigation","volume":"27","author":"Merton","year":"1974","journal-title":"Physics Today"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"0021","DOI":"10.1038\/s41562-016-0021","article-title":"A manifesto for reproducible science","volume":"1","author":"Nosek","year":"2017","journal-title":"Nature Human Behavior"},{"key":"ref_32","unstructured":"NASA (2019). Technology readiness level definitions, NASA.gov."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2600","DOI":"10.1073\/pnas.1708274114","article-title":"The preregistration revolution","volume":"115","author":"Nosek","year":"2018","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349, (6251), aac4716.","DOI":"10.1126\/science.aac4716"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1016\/S0377-2217(03)00020-1","article-title":"Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS","volume":"156","author":"Opricovic","year":"2004","journal-title":"European Journal of Operational Research"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Popper, K. (2005). The logic of scientific discovery, Taylor and Francis.","DOI":"10.4324\/9780203994627"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/0270-0255(87)90473-8","article-title":"The analytic hierarchy process\u2014What it is and how it is used","volume":"9","author":"Saaty","year":"1987","journal-title":"Mathematical Modeling"},{"key":"ref_38","first-page":"215","article-title":"Decision making with the analytic hierarchy process","volume":"9","author":"Saaty","year":"2002","journal-title":"Scientia Iranica"},{"key":"ref_39","unstructured":"Sauser, B., Verma, D., Ramirez-Marquez, J., and Gove, R. (, January April). From TRL to SRL: The concept of systems readiness levels. Conference on Systems Engineering Research, Los Angeles, CA, USA."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"61","DOI":"10.2478\/dim-2019-0008","article-title":"Understanding and evaluating research and scholarly publishing in the social sciences and humanities (SSH)","volume":"3","author":"Sivertsen","year":"2019","journal-title":"Data and Information Management"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1126\/science.1240474","article-title":"Atypical combinations and scientific impact","volume":"342","author":"Uzzi","year":"2013","journal-title":"Science"},{"key":"ref_42","first-page":"56","article-title":"An analysis of multicriteria decision-making methods","volume":"10","author":"Velasquez","year":"2013","journal-title":"International Journal of Operations Research"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"160018","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR guiding principles for scientific data management and stewardship","volume":"3","author":"Wilkinson","year":"2016","journal-title":"Scientific Data"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Wilsdon, J. (2015). The metric tide: Report of the independent review of the role of metrics in research assessment and management, SAGE Publications Ltd.","DOI":"10.4135\/9781473978782"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1036","DOI":"10.1126\/science.1136099","article-title":"The increasing dominance of teams in the production of knowledge","volume":"316","author":"Wuchty","year":"2007","journal-title":"Science"}],"container-title":["Publications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2304-6775\/13\/4\/57\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,10]],"date-time":"2025-11-10T14:24:36Z","timestamp":1762784676000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2304-6775\/13\/4\/57"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,10]]},"references-count":45,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["publications13040057"],"URL":"https:\/\/doi.org\/10.3390\/publications13040057","relation":{},"ISSN":["2304-6775"],"issn-type":[{"value":"2304-6775","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,10]]}}}