{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T16:49:02Z","timestamp":1786121342744,"version":"build-2736575974"},"reference-count":51,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T00:00:00Z","timestamp":1785888000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100018537","name":"National Science and Technology Major Project","doi-asserted-by":"crossref","award":["2022ZD0114900"],"award-info":[{"award-number":["2022ZD0114900"]}],"id":[{"id":"10.13039\/501100018537","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32471151"],"award-info":[{"award-number":["32471151"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32200854"],"award-info":[{"award-number":["32200854"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"award":["32471151"],"award-info":[{"award-number":["32471151"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"publisher"}]},{"award":["32200854"],"award-info":[{"award-number":["32200854"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"publisher"}]},{"name":"State Key Laboratory of General Artificial Intelligence"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Intell."],"abstract":"<jats:p>Current artificial intelligence evaluation often relies on static benchmarks and task-specific performance metrics, which are useful for system comparison but limited in assessing developmental progression, cognitive architecture, adaptive transfer, and real-world applicability. Building on developmental approaches to AGI testing, including our earlier conceptual proposal, this article develops an operational formulation of the General\u2013Specialized\u2013Applicable (GSA) framework for artificial general intelligence (AGI) evaluation. The framework organizes evidence into three non-interchangeable stages: the General stage, which assesses foundational capacities for open-ended generalization, value-oriented regulation, and autonomy; the Specialized stage, which evaluates stable domain-specific competence; and the Applicable stage, which examines whether such competence can be deployed safely and robustly in realistic environments. The article further introduces a dynamic task-generation pipeline and a provisional operational rubric for interpreting stage-specific evidence. An illustrative case study using household tasks in a simulated embodied environment illustrates how GSA can provide diagnostic information beyond aggregate benchmark scores by identifying capability gaps in current multimodal large language model (MLLM) agents. Rather than offering a final universal standard, the GSA framework provides an evaluation-oriented structure for connecting benchmark performance with architectural readiness, specialization, and deployment-level applicability.<\/jats:p>","DOI":"10.3390\/jintelligence14080179","type":"journal-article","created":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T08:14:46Z","timestamp":1785917686000},"page":"179","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Bridging Cognitive Architecture and Developmental Measurement for Artificial General Intelligence"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0457-3389","authenticated-orcid":false,"given":"Yuqiu","family":"Fu","sequence":"first","affiliation":[{"name":"School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China"},{"name":"State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuxi","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China"},{"name":"State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7143-7619","authenticated-orcid":false,"given":"Hongzhao","family":"Xie","sequence":"additional","affiliation":[{"name":"State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-3389-9875","authenticated-orcid":false,"given":"Shiyun","family":"Zhao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingyuan","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-0611-083X","authenticated-orcid":false,"given":"Yujie","family":"Lu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyi","family":"He","sequence":"additional","affiliation":[{"name":"State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China"},{"name":"Institute for Artificial Intelligence, Peking University, Beijing 100871, China"},{"name":"School of Intelligence Science and Technology, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenku","family":"Cheng","sequence":"additional","affiliation":[{"name":"School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2453-6622","authenticated-orcid":false,"given":"Yujia","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China"},{"name":"State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China"},{"name":"Institute for Artificial Intelligence, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3620-7228","authenticated-orcid":false,"given":"Zhenliang","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,5]]},"reference":[{"key":"ref_1","first-page":"119","article-title":"Approximate is better than \u201cexact\u201d for interval estimation of binomial proportions","volume":"52","author":"Agresti","year":"1998","journal-title":"The American Statistician"},{"key":"ref_2","unstructured":"American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (2014). Standards for educational and psychological testing, American Educational Research Association."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Anderson, J. R. (2007). How can the human mind occur in the physical universe?, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780195324259.001.0001"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"191","DOI":"10.3406\/psy.1904.3675","article-title":"M\u00e9thodes nouvelles pour le diagnostic du niveau intellectuel des anormaux","volume":"11","author":"Binet","year":"1904","journal-title":"L\u2019Ann\u00e9e Psychologique"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"27823","DOI":"10.1038\/s41598-024-73582-7","article-title":"Neural networks for abstraction and reasoning","volume":"14","author":"Banerjee","year":"2024","journal-title":"Scientific Reports"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1023\/A:1011206622741","article-title":"Creativity, the turing test, and the (better) lovelace test","volume":"11","author":"Bringsjord","year":"2001","journal-title":"Minds and Machines"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/0004-3702(91)90053-M","article-title":"Intelligence without representation","volume":"47","author":"Brooks","year":"1991","journal-title":"Artificial Intelligence"},{"key":"ref_8","unstructured":"Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., Nori, H., Palangi, H., Ribeiro, M. T., and Zhang, Y. (2023). Sparks of artificial general intelligence: Early experiments with GPT-4. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Cangelosi, A., and Schlesinger, M. (2015). Developmental robotics: From babies to robots, MIT Press.","DOI":"10.7551\/mitpress\/9320.001.0001"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies, Cambridge University Press.","DOI":"10.1017\/CBO9780511571312"},{"key":"ref_11","unstructured":"Chang, M., Chhablani, G., Clegg, A., Cote, M. D., Desai, R., Hlavac, M., Karashchuk, V., Krantz, J., Mottaghi, R., Parashar, P., Patki, S., Prasad, I., Puig, X., Rai, A., Ramrakhya, R., Tran, D., Truong, J., Turner, J. M., Undersander, E., and Yang, T.-Y. (2025). PARTNR: A benchmark for planning and reasoning in embodied multi-agent tasks. Proceedings of the international conference on learning representations, OpenReview.net. Available online: https:\/\/openreview.net\/forum?id=T5QLRRHyL1."},{"key":"ref_12","unstructured":"Chollet, F. (2019). On the measure of intelligence. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1023\/A:1011285919106","article-title":"The turing test","volume":"10","author":"Copeland","year":"2000","journal-title":"Minds and Machines"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Fang, K., Migimatsu, T., Mandlekar, A., Fei-Fei, L., and Bohg, J. (2023). Active task randomization: Learning robust skills via unsupervised generation of diverse and feasible tasks. 2023 IEEE\/RSJ international conference on intelligent robots and systems (IROS), IEEE.","DOI":"10.1109\/IROS55552.2023.10341727"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1109\/TAMD.2013.2277589","article-title":"LIDA: A systems-level architecture for cognition, emotion, and learning","volume":"6","author":"Franklin","year":"2014","journal-title":"IEEE Transactions on Autonomous Mental Development"},{"key":"ref_16","unstructured":"Geifman, Y., and El-Yaniv, R. (2019). SelectiveNet: A deep neural network with an integrated reject option. Proceedings of the 36th international conference on machine learning, PMLR."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1038\/s42256-020-00257-z","article-title":"Shortcut learning in deep neural networks","volume":"2","author":"Geirhos","year":"2020","journal-title":"Nature Machine Intelligence"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Goertzel, B., and Pennachin, C. (2007). Artificial general intelligence, Springer.","DOI":"10.1007\/978-3-540-68677-4"},{"key":"ref_19","unstructured":"Guo, C., Pleiss, G., Sun, Y., and Weinberger, K. Q. (2017). On calibration of modern neural networks. Proceedings of the 34th international conference on machine learning, PMLR."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1016\/0167-2789(90)90087-6","article-title":"The symbol grounding problem","volume":"42","author":"Harnad","year":"1990","journal-title":"Physica D: Nonlinear Phenomena"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"He, D., Fang, C., Wang, Y., Peng, Y., Wang, Y., and Zhu, S.-C. (2025). A mathematical formulation of AGI in the (C, U, V) framework. Engineering.","DOI":"10.1016\/j.eng.2025.08.034"},{"key":"ref_22","unstructured":"Hendrycks, D., Burns, C., Basart, S., Zou, A., Mazeika, M., Song, D., and Steinhardt, J. (2021a). Measuring massive multitask language understanding. Proceedings of the international conference on learning representations, OpenReview.net. Available online: https:\/\/openreview.net\/forum?id=d7KBjmI3GmQ."},{"key":"ref_23","unstructured":"Hendrycks, D., Burns, C., Kadavath, S., Arora, A., Basart, S., Tang, E., Song, D., and Steinhardt, J. (2021b). Measuring mathematical problem solving with the MATH dataset. Proceedings of the neural information processing systems track on datasets and benchmarks 1, OpenReview.net. Available online: https:\/\/openreview.net\/forum?id=7Bywt2mQsCe."},{"key":"ref_24","unstructured":"ISO\/IEC (2023). Information technology\u2014Artificial intelligence\u2014Guidance on risk management (Standard No. ISO\/IEC 23894:2023)."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1515\/JISYS.1996.6.2.133","article-title":"Can we define levels of artificial intelligence?","volume":"6","author":"Kak","year":"1996","journal-title":"Journal of Intelligent Systems"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Laird, J. E. (2012). The Soar cognitive architecture, MIT Press.","DOI":"10.7551\/mitpress\/7688.001.0001"},{"key":"ref_27","unstructured":"Lake, B., and Baroni, M. (2018). Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks. Proceedings of the 35th international conference on machine learning, PMLR."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e253","DOI":"10.1017\/S0140525X16001837","article-title":"Building machines that learn and think like people","volume":"40","author":"Lake","year":"2017","journal-title":"Behavioral and Brain Sciences"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1380","DOI":"10.1038\/s41597-025-05687-1","article-title":"A comprehensive behavioral dataset for the abstraction and reasoning corpus","volume":"12","author":"LeGris","year":"2025","journal-title":"Scientific Data"},{"key":"ref_30","unstructured":"Levesque, H. J., Davis, E., and Morgenstern, L. (2012). The winograd schema challenge. Proceedings of the 13th international conference on principles of knowledge representation and reasoning, AAAI Press."},{"key":"ref_31","unstructured":"Liang, P., Bommasani, R., Lee, T., Tsipras, D., Soylu, D., Yasunaga, M., Zhang, Y., Narayanan, D., Wu, Y., Kumar, A., Newman, B., Yuan, B., Yan, B., Zhang, C., Cosgrove, C., Manning, C. D., R\u00e9, C., Acosta-Navas, D., Hudson, D. A., and Koreeda, Y. (2026, July 10). Holistic evaluation of language models. Transactions on Machine Learning Research, Available online: https:\/\/openreview.net\/forum?id=iO4LZibEqW."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lin, S., Hilton, J., and Evans, O. (2022). TruthfulQA: Measuring how models mimic human falsehoods. Proceedings of the 60th annual meeting of the association for computational linguistics, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.acl-long.229"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liu, Y., Duan, H., Zhang, Y., Li, B., Zhang, S., Zhao, W., Yuan, Y., Wang, J., He, C., Liu, Z., Chen, K., and Lin, D. (2024). MMBench: Is your multi-modal model an all-around player?. Proceedings of the European conference on computer vision, Springer.","DOI":"10.1007\/978-3-031-72658-3_13"},{"key":"ref_34","unstructured":"Lu, P., Bansal, H., Xia, T., Liu, J., Li, C., Hajishirzi, H., Cheng, H., Chang, K.-W., Galley, M., and Gao, J. (2024). MathVista: Evaluating mathematical reasoning of foundation models in visual contexts. Proceedings of the international conference on learning representations, OpenReview.net. Available online: https:\/\/openreview.net\/forum?id=KUNzEQMWU7."},{"key":"ref_35","first-page":"35","article-title":"The Minimum Intelligent Signal Test (MIST) as an alternative to the Turing Test","volume":"16","author":"Jurowska","year":"2019","journal-title":"Diametros"},{"key":"ref_36","unstructured":"Flanagan, D. P., and Harrison, P. L. (2005). The Cattell\u2013Horn\u2013Carroll theory of cognitive abilities: Past, present, and future. Contemporary intellectual assessment: Theories, tests, and issues, Guilford Press. [2nd ed.]."},{"key":"ref_37","unstructured":"Mialon, G., Fourrier, C., Swift, C., Wolf, T., LeCun, Y., and Scialom, T. (2024). GAIA: A benchmark for general AI assistants. Proceedings of the international conference on learning representations, OpenReview.net. Available online: https:\/\/openreview.net\/forum?id=fibxvahvs3."},{"key":"ref_38","unstructured":"Morris, M. R., Sohl-Dickstein, J., Fiedel, N., Warkentin, T., Dafoe, A., Faust, A., Farabet, C., and Legg, S. (2024). Position: Levels of AGI for operationalizing progress on the path to AGI. Proceedings of the 41st international conference on machine learning, PMLR."},{"key":"ref_39","unstructured":"Moskvichev, A., Odouard, V. V., and Mitchell, M. (2026, July 10). The ConceptARC benchmark: Evaluating understanding and generalization in the ARC domain. Transactions on Machine Learning Research, Available online: https:\/\/openreview.net\/forum?id=8ykyGbtt2q."},{"key":"ref_40","unstructured":"National Institute of Standards and Technology (2023). Artificial intelligence risk management framework (AI RMF 1.0)."},{"key":"ref_41","unstructured":"Nunnally, J. C., and Bernstein, I. H. (1994). Psychometric theory, McGraw-Hill. [3rd ed.]."},{"key":"ref_42","unstructured":"OpenAI (2023). GPT-4 technical report. arXiv."},{"key":"ref_43","first-page":"271","article-title":"Human intelligence-inspired testing for the developmental stages of artificial general intelligence: From general to applicable","volume":"49","author":"Peng","year":"2026","journal-title":"Journal of Psychological Science"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Shah, H., and Warwick, K. (2009). Emotion in the Turing Test: A downward trend for machines in recent Loebner Prizes. Handbook of research on synthetic emotions and sociable robotics: New applications in affective computing and artificial intelligence, IGI Global.","DOI":"10.4018\/978-1-60566-354-8.ch017"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"201","DOI":"10.2307\/1412107","article-title":"\u201cGeneral intelligence,\u201d objectively determined and measured","volume":"15","author":"Spearman","year":"1904","journal-title":"The American Journal of Psychology"},{"key":"ref_46","unstructured":"Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., Kluska, A., Lewkowycz, A., Agarwal, A., Power, A., Ray, A., Warstadt, A., Kocurek, A. W., Safaya, A., Tazarv, A., and Wu, Z. (2026, July 10). Beyond the imitation game: Quantifying and extrapolating the capabilities of language models. Transactions on Machine Learning Research, Available online: https:\/\/openreview.net\/forum?id=uyTL5Bvosj."},{"key":"ref_47","first-page":"3261","article-title":"SuperGLUE: A stickier benchmark for general-purpose language understanding systems","volume":"32","author":"Wang","year":"2019","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., and Bowman, S. (2018). GLUE: A multi-task benchmark and analysis platform for natural language understanding. Proceedings of the 2018 EMNLP workshop blackboxNLP: Analyzing and interpreting neural networks for NLP, Association for Computational Linguistics.","DOI":"10.18653\/v1\/W18-5446"},{"key":"ref_49","unstructured":"Wang, Y., Xian, Z., Chen, F., Wang, T.-H., Wang, Y., Fragkiadaki, K., Erickson, Z., Held, D., and Gan, C. (2024). RoboGen: Towards unleashing infinite data for automated robot learning via generative simulation. Proceedings of the 41st international conference on machine learning, PMLR."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Wechsler, D. (1939). The measurement of adult intelligence, Williams & Wilkins.","DOI":"10.1037\/10020-000"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Zellers, R., Holtzman, A., Bisk, Y., Farhadi, A., and Choi, Y. (2019). HellaSwag: Can a machine really finish your sentence?. Proceedings of the 57th annual meeting of the association for computational linguistics, Association for Computational Linguistics.","DOI":"10.18653\/v1\/P19-1472"}],"container-title":["Journal of Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/8\/179\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T04:20:46Z","timestamp":1786076446000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/8\/179"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,5]]},"references-count":51,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["jintelligence14080179"],"URL":"https:\/\/doi.org\/10.3390\/jintelligence14080179","relation":{},"ISSN":["2079-3200"],"issn-type":[{"value":"2079-3200","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,5]]}}}