{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T22:11:44Z","timestamp":1767910304028,"version":"3.49.0"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,10,1]],"date-time":"2024-10-01T00:00:00Z","timestamp":1727740800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["23-18-01059"],"award-info":[{"award-number":["23-18-01059"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:sec><jats:title>Objective<\/jats:title><jats:p>The study is devoted to comparing various models based on Artificial Intelligence to determine the level of creativity based on drawings performed using the Urban test, as well as analyzing the results of applying explainable artificial intelligence methods to a trained model to identify the most relevant features in drawings that influence the model\u2019s prediction.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>The dataset is represented by a set of 1,823 scanned forms of drawings of participants performed according to the Urban test. The test results of each participant were assessed by an expert. Preprocessed images were used for fine-tuning pre-trained models such as MobileNet, ResNet18, AlexNet, DenseNet, ResNext, EfficientNet, ViT with additional linear layers to predict the participant\u2019s score. Visualization of the areas that are of greatest importance from the point of view of the model was carried out using the Gradient-weighted Class Activation Mapping (Grad-CAM) method.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Trained models based on MobileNet showed the highest prediction accuracy rate of 76%. The results of the application of explainable artificial intelligence demonstrated areas of interest that correlated with the criteria for expert assessment according to the Urban test. Analysis of erroneous predictions of the model in terms of interpretation of areas of interest made it possible to clarify the features of the drawing on which the model relies, contrary to the expert.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The study demonstrated the possibility of using neural network methods for automated diagnosis of the level of creativity according to the Urban test based on the respondents\u2019 drawings. The application of explainable artificial intelligence methods to the trained model demonstrated the compliance of the identified activation zones with the rules of expert assessment according to the Urban test.<\/jats:p><\/jats:sec>","DOI":"10.3389\/frai.2024.1310518","type":"journal-article","created":{"date-parts":[[2024,10,1]],"date-time":"2024-10-01T05:10:45Z","timestamp":1727759445000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["The application of explainable artificial intelligence methods to models for automatic creativity assessment"],"prefix":"10.3389","volume":"7","author":[{"given":"Anastasia S.","family":"Panfilova","sequence":"first","affiliation":[]},{"given":"Ekaterina A.","family":"Valueva","sequence":"additional","affiliation":[]},{"given":"Ivan Y.","family":"Ilyin","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,10,1]]},"reference":[{"key":"ref1","year":""},{"key":"ref2","author":"Arrieta","year":"2019"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"e0130140","DOI":"10.1371\/journal.pone.0130140","article-title":"On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation","volume":"10","author":"Bach","year":"2015","journal-title":"PLoS One"},{"key":"ref4","author":"Cropley","year":"2021"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1177\/0278364915592961","article-title":"A novel type of compliant and underactuated robotic hand for dexterous grasping","volume":"35","author":"Deimel","year":"2016","journal-title":"Int. J. Robot. Res."},{"key":"ref6","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1177\/1932202X21990099","article-title":"Validity and utility of the test of creative thinking drawing production for Dutch adolescents","volume":"32","author":"Desmet","year":"2021","journal-title":"J. Adv. Acad."},{"key":"ref7","author":"Dosovitskiy","year":"2020"},{"key":"ref8","author":"Eyiokur","year":"2018"},{"key":"ref9","volume-title":"PyTorch library for CAM methods","author":"Gildenblat","year":"2021"},{"key":"ref10","year":""},{"key":"ref11","year":""},{"key":"ref13","author":"He","year":"2015"},{"key":"ref14","author":"Huang","year":"2016"},{"key":"ref15","author":"Kim","year":"2006"},{"key":"ref16","author":"Kofler","year":"2021"},{"key":"ref17","author":"Krizhevsky","year":"2012"},{"key":"ref18","author":"Liang","year":"2022"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1111\/nyas.13136","article-title":"Creativity in gifted identification: increasing accuracy and diversity","volume":"1377","author":"Luria","year":"2016","journal-title":"Ann. N. Y. Acad. Sci."},{"key":"ref20","author":"Mahendran","year":"2014"},{"key":"ref21","year":""},{"key":"ref22","author":"Nguyen","year":"2016"},{"key":"ref23","year":""},{"key":"ref24","author":"Sandler","year":"2018"},{"key":"ref25","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1007\/s11263-019-01228-7","article-title":"Grad-CAM: visual explanations from deep networks via gradient-based localization","volume":"128","author":"Selvaraju","year":"2016","journal-title":"Int. J. Comput. Vis."},{"key":"ref26","author":"Shelhamer","year":"2014"},{"key":"ref27","author":"Simonyan","year":"2014"},{"key":"ref28","author":"Tan","year":"2021"},{"key":"ref29","year":""},{"key":"ref30","year":""},{"key":"ref31","year":""},{"key":"ref32","year":""},{"key":"ref33","first-page":"272","article-title":"Assessing creativity: the test for creative thinking-drawing production (TCT-DP)","volume":"6","author":"Urban","year":"2004","journal-title":"Int. Educ. J."},{"key":"ref34","volume-title":"Manual of test for creative thinking-drawing production (TCT-DP)","author":"Urban","year":"1996"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"70","DOI":"10.17759\/jmfp.2018070207","article-title":"Evaluation of the effectiveness of the program for the development of emotional abilities of high school students","volume":"7","author":"Valueva","year":"2018","journal-title":"J. Modern Foreign Psychol."},{"key":"ref36","article-title":"Automatic scoring of verbal divergent thinking tests: from lexical databases to large language models","author":"Valueva","year":"2024","journal-title":"Psychol. J. High. School Econ."},{"key":"ref37","first-page":"103","article-title":"Empirical verification of the model of relation of cognitive and emotional abilities","volume":"7","author":"Valueva","year":"2010","journal-title":"Psychol. J. High. School Econ."},{"key":"ref38","author":"Xie","year":"2016"},{"key":"ref39","author":"Zhang","year":"2016"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1310518\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,1]],"date-time":"2024-10-01T05:10:47Z","timestamp":1727759447000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1310518\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,1]]},"references-count":38,"alternative-id":["10.3389\/frai.2024.1310518"],"URL":"https:\/\/doi.org\/10.3389\/frai.2024.1310518","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,1]]},"article-number":"1310518"}}