{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T10:37:04Z","timestamp":1762079824122,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,12,9]],"date-time":"2022-12-09T00:00:00Z","timestamp":1670544000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002261","name":"RFBR","doi-asserted-by":"publisher","award":["20-07-00764"],"award-info":[{"award-number":["20-07-00764"]}],"id":[{"id":"10.13039\/501100002261","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>The article discusses the problem of visualization of complex multiparameter systems, defined by datasets on their structure, functional structure, and activity in the form of complex graphs and transition of traditional representation of the data acquired by graph mining to a compact image built by pictographic methods. In these situations, we propose using the Unified Graphic Visualization of Activity (UGVA) method for data concentration and structuring. The UGVA method allows coding in an anthropomorphic image of elements of graphs with data on structural and functional features of systems and overlaying these images with the data on the system\u2019s activity using coloring and artifacts. The image can be composed in different ways: it can include the zone of integral evaluation parameters, segmented data axes of five types, and four types of symmetry. We describe the method of creating UGVA images, which consists of 13 stages: the parametric model is represented as a structural image that is converted to a basic image that is then detailed into the particular image by defining geometric parameters of the primitives and to the individualized image with the data about a particular object. We show how the individualized image can be overlaid with the operative data as color coding and artifacts and describe the principles of interpreting UGVA images. This allows solving tasks of evaluation, comparison, and monitoring of complex multiparameter systems by showing the decision-maker an anthropomorphic image instead of the graph. We describe a case study of using the UGVA method for visualization of data about an educational process: curricula and graduate students, including the data mined from the university\u2019s learning management system at the Siberian Federal University for students majoring in \u201cinformatics and computing\u201d. The case study demonstrates all stages of image synthesis and examples of their interpretation for situation assessment, monitoring, and comparison of students and curricula. It allowed for finding problematic moments in learning for individual students and their entire group by analyzing the development of their competence profiles and formulating recommendations for further learning. The effectiveness of the resulting images is compared to the other approaches: elastic maps and Chernoff faces. We discuss using graph mining to generate learning problems in order to lessen the workload of gathering raw data for the UGVA method and provide general recommendations for using the UGVA method based on our experience of supporting decision making.<\/jats:p>","DOI":"10.3390\/a15120468","type":"journal-article","created":{"date-parts":[[2022,12,9]],"date-time":"2022-12-09T02:50:51Z","timestamp":1670554251000},"page":"468","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Evaluation, Comparison and Monitoring of Multiparameter Systems by Unified Graphic Visualization of Activity Method on the Example of Learning Process"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1205-2652","authenticated-orcid":false,"given":"Viktor","family":"Uglev","sequence":"first","affiliation":[{"name":"Department of Applied Physics and Space Technologies, Siberian Federal University, Kirova Str., 12a, 662971 Zheleznogorsk, Krasnoyarsk Krai, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7296-2538","authenticated-orcid":false,"given":"Oleg","family":"Sychev","sequence":"additional","affiliation":[{"name":"Software Engineering Department, Volgograd State Technical University, Lenin Ave, 28, 400005 Volgograd, Volgograd Oblast, Russia"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ilves, K., Leinonen, J., and Hellas, A. (2018, January 21\u201324). Supporting Self-Regulated Learning with Visualizations in Online Learning Environments. Proceedings of the 49th ACM Technical Symposium on Computer Science Education, SIGCSE \u201918, Baltimore, MD, USA.","DOI":"10.1145\/3159450.3159509"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Hinz, M., Lehmann, N., Melcher, K., Aye, N., Radi\u0107, V., Wagner, H., and Taubert, M. (2021). Reliability of Perceptual-Cognitive Skills in a Complex, Laboratory-Based Team-Sport Setting. Appl. Sci., 11.","DOI":"10.3390\/app11115203"},{"key":"ref_3","first-page":"117","article-title":"Methods of cognitive-graphical representation of information for effective monitoring of complex technical systems","volume":"9","author":"Fralenko","year":"2018","journal-title":"Program Syst. Theory Appl."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Albert, C.N., Mihai, M., and Mudure-Iacob, I. (2022). Visual Thinking Strategies\u2014Theory and Applied Areas of Insertion. Sustainability, 14.","DOI":"10.3390\/su14127195"},{"key":"ref_5","first-page":"83","article-title":"Data mining concepts and techniques third edition","volume":"5","author":"Han","year":"2011","journal-title":"Morgan Kaufmann Ser. Data Manag. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gallagher, B. (2006, January 13\u201315). Matching Structure and Semantics: A Survey on Graph-Based Pattern Matching. Proceedings of the AAAI Fall Symposium: Capturing and Using Patterns for Evidence Detection, Washington, DC, USA.","DOI":"10.2172\/895418"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kulinich, A.A. (2018, January 1\u20133). Semiotic Approach in Modeling and Decision-making in Ill-defined Complex Situations. Proceedings of the 2018 Eleventh International Conference \"Management of Large-scale System Development\" (MLSD), Moscow, Russia.","DOI":"10.1109\/MLSD.2018.8551835"},{"key":"ref_8","unstructured":"Anochin, P., and Pickenhain, L. (1967). Das funktionelle System als Grundlage der physiologischen Architektur des Verhaltensaktes, Gustav Fischer."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xuan, Q., Ruan, Z., and Min, Y. (2021). Graph Data Mining: Algorithm, Security and Application, Springer.","DOI":"10.1007\/978-981-16-2609-8"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1249","DOI":"10.1109\/TVCG.2016.2640960","article-title":"Visualizing high-dimensional data: Advances in the past decade","volume":"23","author":"Liu","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_11","unstructured":"Kromesch, S., and Juh\u00e1sz, S. (2005, January 18\u201319). High dimensional data visualization. Proceedings of the 6th International Symposium of Hungarian Researchers on Computational Intelligence, Budapest, Hungary."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gorban, A.N., and Zinovyev, A. (2015, January 7). Fast and user-friendly non-linear principal manifold learning by method of elastic maps. Proceedings of the 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA), Paris, France.","DOI":"10.1109\/DSAA.2015.7344818"},{"key":"ref_13","unstructured":"Few, S. (2006). Information Dashboard Design: The Effective Visual Communication of Data, O\u2019Reilly Media, Inc."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ward, M.O. (2008). Multivariate data glyphs: Principles and practice. Handbook of Data Visualization, Springer.","DOI":"10.1007\/978-3-540-33037-0_8"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1080\/01621459.1973.10482434","article-title":"The use of faces to represent points in k-dimensional space graphically","volume":"68","author":"Chernoff","year":"1973","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Uglev, V., Sychev, O., and Gavrilova, T. (2022). Cross-Cutting Support of Making and Explaining Decisions in Intelligent Tutoring Systems Using Cognitive Maps of Knowledge Diagnosis. International Conference on Intelligent Tutoring Systems, LNCS, Springer.","DOI":"10.1007\/978-3-031-09680-8_5"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.tics.2020.10.004","article-title":"Structuring knowledge with cognitive maps and cognitive graphs","volume":"25","author":"Peer","year":"2021","journal-title":"Trends Cogn. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1080\/01621459.1981.10477718","article-title":"Graphical Representation of Multivariate Data by Means of Asymmetrical Faces","volume":"76","author":"Flury","year":"1981","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_19","unstructured":"Reyes Nu\u00f1ez, J.J. (2022, October 29). Ideas for the Use of Chernoff Faces in School Cartography. World\u2019s Geo-Spatial Solut. Available online: https:\/\/www.academia.edu\/8026644\/IDEAS_FOR_THE_USE_OF_CHERNOFF_FACES_IN_SCHOOL_CARTOGRAPHY."},{"key":"ref_20","unstructured":"Jones, D. (1982). The Inventions of Daedalus: A Compendium of Plausible Schemes, WH Freeman."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Rodriguez, J., and Kaczmarek, P. (2016). Visualizing Financial Data, John Wiley & Sons.","DOI":"10.1002\/9781119183563"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1134\/S1054661820030141","article-title":"Digital facial anthropometry: Application and implementation","volume":"30","author":"Kukharev","year":"2020","journal-title":"Pattern Recognit. Image Anal."},{"key":"ref_23","unstructured":"Filimonov, V. (2021). Method for cognitive visualization multi-parameter system components. XIII International Conference on Robotics and Artificial Intelligence, Litera-print. (In Russian)."},{"key":"ref_24","unstructured":"Corbusier, L. (1948). Le Modulor. Boulogne-sur-Seine: Editions de l\u2019Architecture d\u2019Aujoud\u2019hui, Groupe Expansion."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kossiakoff, A., Sweet, W., Seymour, S., and Biemer, S. (2011). Systems Engineering Principles and Practice, Wiley-Interscience.","DOI":"10.1002\/9781118001028"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Uglev, V. (2022). Unified Graphic Visualization of Activity (UGVA) Method. Novel and Intelligent Digital Systems 2022, LNNS, Springer.","DOI":"10.1007\/978-3-031-17601-2_25"},{"key":"ref_27","unstructured":"Weyl, H. (2015). Symmetry, Princeton University Press."},{"key":"ref_28","unstructured":"Federal Educational Standards Registry for Higher Education for Informatics and Software Engineering (Graduate Level) (2022, January 11). Russian Ministry of Science and Higher Education. Available online: http:\/\/fgosvo.ru\/fgosvo\/152\/150\/25\/31."},{"key":"ref_29","unstructured":"Professional Standards Registry (2022, January 11). Russian Ministry of Labor and Social Protection. Available online: https:\/\/profstandart.rosmintrud.ru\/obshchiy-informatsionnyy-blok\/natsionalnyy-reestr-professionalnykh-standartov\/reestr-professionalnykh-standartov\/."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Uglev, V., and Ustinov, V. (2014). The new competencies development level expertise method within Intelligent Automated Educational Systems. Trends in Practical Applications of Heterogeneous Multi-agent Systems. The PAAMS Collection. Advances in Intelligent Systems and Computing, Springer.","DOI":"10.1007\/978-3-319-07476-4_19"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4231","DOI":"10.1007\/s10639-020-10127-1","article-title":"Toward the visual understanding of computing curricula","volume":"25","author":"Takada","year":"2020","journal-title":"Educ. Inf. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1109\/TLT.2017.2740172","article-title":"Review of research on student-facing learning analytics dashboards and educational recommender systems","volume":"10","author":"Bodily","year":"2017","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mgboh, U., Ogbuokiri, B., Obaido, G., and Aruleba, K. (2020). Visual Data Mining: A Comparative Analysis of Selected Datasets. International Conference on Intelligent Systems Design and Applications, Springer.","DOI":"10.1007\/978-3-030-71187-0_35"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Drousiotis, E., Shi, L., and Maskell, S. (2021). Early Predictor for Student Success Based on Behavioural and Demographical Indicators. International Conference on Intelligent Tutoring Systems, Springer.","DOI":"10.1007\/978-3-030-80421-3_19"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1108\/14676370710726634","article-title":"Sustainable development cognitive map: A new method of evaluating student understanding","volume":"8","author":"Lourdel","year":"2007","journal-title":"Int. J. Sustain. High. Educ."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1007\/s00521-020-05057-5","article-title":"Domain knowledge graph-based research progress of knowledge representation","volume":"33","author":"Lin","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_37","first-page":"684","article-title":"Evaluate Curricula Balance for Software Engineering Education with using UGVA Method","volume":"17","author":"Uglev","year":"2021","journal-title":"Mod. Inf. Technol. IT Educ."},{"key":"ref_38","unstructured":"Buchanan, B., and Shortliffe, E. (1984). Rule-Based Expert System: The MYCIN Experiments of the Stanford Heuristic Programming Project, Addison-Wesley."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"121","DOI":"10.17516\/1999-494X-0378","article-title":"Data Mining of Digital Footprint during Assessment Grading for Intelligent Decision Making during Learning Process","volume":"15","author":"Uglev","year":"2022","journal-title":"J. Sib. Fed. Univ. Eng. Technol."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ziatdinov, R., and Valles, J.R. (2022). Synthesis of Modeling, Visualization, and Programming in GeoGebra as an Effective Approach for Teaching and Learning STEM Topics. Mathematics, 10.","DOI":"10.3390\/math10030398"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Shi, D., Zhou, J., Wang, D., and Wu, X. (2022). Research Status, Hotspots, and Evolutionary Trends of Intelligent Education from the Perspective of Knowledge Graph. Sustainability, 14.","DOI":"10.3390\/su141710934"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kumar, A.N. (2015, January 22\u201326). Automated Generation of Self-Explanation Questions in Worked Examples in a Model-Based Tutor. Proceedings of the Artificial Intelligence in Education\u201317th International Conference, AIED 2015, Madrid, Spain.","DOI":"10.1007\/978-3-319-19773-9_91"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Sychev, O., Anikin, A., Penskoy, N., Denisov, M., and Prokudin, A. (2021, January 7\u201311). CompPrehension\u2013Model-Based Intelligent Tutoring System on Comprehension Level. Proceedings of the Intelligent Tutoring Systems: 17th International Conference, ITS 2021, Virtual Event.","DOI":"10.3390\/educsci11110719"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Sychev, O., Penskoy, N., and Prokudin, A. (2022, January 1\u20134). Generating Expression Evaluation Learning Problems from Existing Program Code. Proceedings of the International Conference on Advanced Learning Technologies, ICALT 2022, Bucharest, Romania.","DOI":"10.1109\/ICALT55010.2022.00061"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1037\/h0043158","article-title":"The magical number seven, plus or minus two: Some limits on our capacity for processing information","volume":"63","author":"Miller","year":"1956","journal-title":"Psychol. Rev."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Uglev, V., and Gavrilova, T. (2022). Cross-Cutting Visual Support of Decision Making for Forming Personalized Learning Spaces. Novel and Intelligent Digital Systems 2022. LNNS, Springer.","DOI":"10.1007\/978-3-031-17601-2_1"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/12\/468\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:36:57Z","timestamp":1760146617000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/12\/468"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,9]]},"references-count":46,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["a15120468"],"URL":"https:\/\/doi.org\/10.3390\/a15120468","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2022,12,9]]}}}