{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T14:23:17Z","timestamp":1783088597724,"version":"3.54.6"},"reference-count":25,"publisher":"Sociedade Brasileira de Computa\u00e7\u00e3o","issue":"1","license":[{"start":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T00:00:00Z","timestamp":1782777600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JIS"],"abstract":"<jats:p>Emotions are central to interactive systems, shaping user experience, decision-making, and engagement. In educational contexts, emotionally expressive avatars can foster empathy, motivation, and social belonging, but existing solutions face critical limitations. This article proposes an emotion-aware multidimensional framework that integrates technical, pedagogical, sociocultural, and operational perspectives to guide the equitable design of interactive educational systems. Grounded in a systematic review of 127 studies (2014\u20132024), our results show that current approaches face three key challenges: (1) realism-accessibility trade-offs (e.g., diffusion models\u2019 F1=0.91 vs. GANs\u2019 34ms latency), (2) cultural bias in emotion recognition (89% Western dominance reduced to 20% using our adaptation protocols), and (3) limited pedagogical integration of affective features (with gains of 23% in retention when aligned with Bloom\u2019s Taxonomy). The review highlights fragmentation across technical, pedagogical, and cultural domains, underscoring the need for integration. To address this, we propose an Emotion-Aware Multidimensional Framework that unifies these perspectives into actionable design and evaluation protocols. By situating emotions as a core dimension of system design, the study contributes not only to educational applications but also to the broader field of interactive systems where affective engagement is critical.<\/jats:p>","DOI":"10.5753\/jis.2026.6580","type":"journal-article","created":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T14:05:35Z","timestamp":1783087535000},"page":"567-579","source":"Crossref","is-referenced-by-count":0,"title":["Emotion-Aware Framework for Equitable Facial Expression Synthesis in Interactive Educational Systems"],"prefix":"10.5753","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3355-3966","authenticated-orcid":false,"given":"Diego Addan","family":"Gon\u00e7alves","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6045-1274","authenticated-orcid":false,"given":"Eduardo","family":"Todt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"3742","published-online":{"date-parts":[[2026,6,30]]},"reference":[{"key":"1","doi-asserted-by":"crossref","unstructured":"Baylor, A. L. (2019). The impact of pedagogical agent gesturing in multimedia learning environments: A meta-analysis. Educational Research Review, 28. DOI: https:\/\/doi.org\/10.1016\/j.edurev.2019.05.002.","DOI":"10.1016\/j.edurev.2019.05.002"},{"key":"2","unstructured":"Baylor, A. L., Kim, Y., and Lee, S. (2023). Pedagogical agents in special education: A systematic review of affective computing applications. Journal of Educational Computing Research, 61(4):783\u2013810. DOI: https:\/\/doi.org\/10.1177\/07356331231154420."},{"key":"3","doi-asserted-by":"crossref","unstructured":"Braun, V. and Clarke, V. (2022). Thematic analysis: A practical guide. Sage.","DOI":"10.4135\/9781036232078.n9"},{"key":"4","unstructured":"Buolamwini, J. and Gebru, T. (2023). Intersectional ai: Understanding and addressing the social impacts of artificial intelligence. AI & Society, 38(2):1\u201312. DOI: https:\/\/doi.org\/10.1007\/s00146-022-01496-3."},{"key":"5","unstructured":"Deng, Y., Yang, J., Xu, S., Chen, D., Jia, Y., and Tong, X. (2023). Accurate 3d face reconstruction with weakly-supervised learning: From single image to image set. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(1):346\u2013360. DOI: https:\/\/doi.org\/10.1109\/TPAMI.2021.3130384."},{"key":"6","doi-asserted-by":"crossref","unstructured":"Gusenbauer, M. and Haddaway, N. R. (2020). Which academic search systems are suitable for systematic reviews or meta-analyses? evaluating retrieval qualities of google scholar, pubmed, and 26 other resources. Research Synthesis Methods, 11(2):181\u2013217. DOI: https:\/\/doi.org\/10.1002\/jrsm.1378.","DOI":"10.1002\/jrsm.1378"},{"key":"7","unstructured":"Johnson, W. L. and Lester, J. C. (2021). Digital human pedagogical agents to support learning. International Journal of Artificial Intelligence in Education, 31(4):723\u2013755. DOI: https:\/\/doi.org\/10.1007\/s40593-021-00256-7."},{"key":"8","unstructured":"Johnson, W. L., Lester, J. C., and Lee, J. (2023). Affective pedagogical agents in language learning: A meta-analysis of emotional expression effects. Computer Assisted Language Learning, 36(5):912\u2013940. DOI: https:\/\/doi.org\/10.1080\/09588221.2023.2181382."},{"key":"9","unstructured":"Karras, T., Aittala, M., Laine, S., H\u00e4rk\u00f6nen, E., Hellsten, J., Lehtinen, J., and Aila, T. (2021). Alias-free generative adversarial networks. Advances in Neural Information Processing Systems, 34:852\u2013863. StyleGAN3 paper."},{"key":"10","unstructured":"Kitchenham, B. and Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering. Keele University and Durham University Joint Report. EBSE Technical Report EBSE-2007-01."},{"key":"11","doi-asserted-by":"crossref","unstructured":"Kolestra, J., van der Meij, H., and de Jong, T. (2016). Personalized affective feedback for adaptive learning systems. Computers & Education, 101:85\u201398. DOI: https:\/\/doi.org\/10.1016\/j.compedu.2016.06.004.","DOI":"10.1016\/j.compedu.2016.06.004"},{"key":"12","doi-asserted-by":"crossref","unstructured":"K\u00e4rkk\u00e4inen, K. and Joo, J. (2021). Fairface: Face attribute dataset for balanced race, gender, and age. arXiv preprint. arXiv:1908.04913. DOI: https:\/\/doi.org\/10.48550\/arXiv.1908.04913.","DOI":"10.1109\/WACV48630.2021.00159"},{"key":"13","doi-asserted-by":"crossref","unstructured":"Mollahosseini, A., Hasani, B., and Mahoor, M. H. (2019). Affectnet: A database for facial expression, valence, and arousal computing in the wild. IEEE Transactions on Affective Computing, 10(1):18\u201331. DOI: https:\/\/doi.org\/10.1109\/TAFFC.2017.2740923.","DOI":"10.1109\/TAFFC.2017.2740923"},{"key":"14","doi-asserted-by":"crossref","unstructured":"Ortega-Ochoa, E., Arguedas, M., and Daradoumis, T. (2024). Empathic pedagogical conversational agents: A systematic literature review. British Journal of Educational Technology, 55:886\u2013909. DOI: https:\/\/doi.org\/10.1111\/bjet.13413.","DOI":"10.1111\/bjet.13413"},{"key":"15","doi-asserted-by":"crossref","unstructured":"Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., and Moher, D. (2021). The prisma 2020 statement: An updated guideline for reporting systematic reviews. Systematic Reviews, 10(1):1\u201311. DOI: https:\/\/doi.org\/10.1186\/s13643-021-01626-4.","DOI":"10.1186\/s13643-021-01626-4"},{"key":"16","doi-asserted-by":"crossref","unstructured":"Pereira, R., Darin, T., and Silveira, M. S. (2024). Grandihc-br: Grand research challenges in human-computer interaction in brazil for 2025-2035. Proceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems (IHC \u201924), pages 1\u201324. DOI: https:\/\/doi.org\/10.1145\/3702038.3702061.","DOI":"10.1145\/3702038.3702061"},{"key":"17","unstructured":"Podell, D., English, Z., Lacey, K., Blattmann, A., Dockhorn, T., M\u00fcller, J., Penna, J., and Rombach, R. (2023). Sdxl: Improving latent diffusion models for high-resolution image synthesis. arXiv preprint. arXiv:2307.01952. DOI: https:\/\/doi.org\/10.48550\/arXiv.2307.01952."},{"key":"18","unstructured":"Ruiz, N., Cheng, Y., and Liu, Y. (2024). Real-time affective adaptation in intelligent tutoring systems: A design-based research approach. IEEE Transactions on Learning Technologies, 17(2):456\u2013473. DOI: https:\/\/doi.org\/10.1109\/TLT.2023.3298741."},{"key":"19","unstructured":"Ruiz, N., Liu, Y., Jourabloo, A., and Cheng, Y. (2023). Learning bias-invariant facial representations for domain generalization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3):3723\u20133736. DOI: https:\/\/doi.org\/10.1109\/TPAMI.2022.3194378."},{"key":"20","doi-asserted-by":"crossref","unstructured":"Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., and Norouzi, M. (2023). Image super-resolution via iterative refinement. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(4):1485\u20131497. DOI: https:\/\/doi.org\/10.1109\/TPAMI.2022.3204461.","DOI":"10.1109\/TPAMI.2022.3204461"},{"key":"21","doi-asserted-by":"crossref","unstructured":"Septiana, I., Mutijarsa, K., Putro, B. L., and Rosmansyah, Y. (2024). Emotion-related pedagogical agent: A systematic literature review. IEEE Access, 12. DOI: https:\/\/doi.org\/10.1109\/ACCESS.2024.3374376.","DOI":"10.1109\/ACCESS.2024.3374376"},{"key":"22","unstructured":"Valstar, M. F., Pantic, M., and Cohn, J. F. (2017). Facs-based facial expression recognition: A comprehensive review. IEEE Transactions on Affective Computing, 8(2):156\u2013176. DOI: https:\/\/doi.org\/10.1109\/TAFFC.2017.2705084."},{"key":"23","unstructured":"Vieira, L. N., O\u2019Hagan, M., and O\u2019Sullivan, C. (2021). Understanding the societal impacts of machine translation: A critical review of the literature. Translation Spaces, 10(2):171\u2013200. DOI: https:\/\/doi.org\/10.1075\/ts.21002.vie."},{"key":"24","doi-asserted-by":"crossref","unstructured":"Wohlin, C., Runeson, P., H\u00f6st, M., Ohlsson, M. C., Regnell, B., and Wessl\u00e9n, A. (2012). Experimentation in software engineering. Springer.","DOI":"10.1007\/978-3-642-29044-2"},{"key":"25","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zhang, H., Cun, X., Shen, X., Guo, Y., Shan, Y., and Wang, F. (2023). A survey of facial animation generation and editing with deep learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(5):5591\u20135610. DOI: https:\/\/doi.org\/10.1109\/TPAMI.2022.3204461.","DOI":"10.1109\/TPAMI.2022.3204461"}],"container-title":["Journal on Interactive Systems"],"original-title":[],"link":[{"URL":"https:\/\/journals-sol.sbc.org.br\/index.php\/jis\/article\/download\/6580\/4086","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals-sol.sbc.org.br\/index.php\/jis\/article\/download\/6580\/4086","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T14:06:18Z","timestamp":1783087578000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals-sol.sbc.org.br\/index.php\/jis\/article\/view\/6580"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,30]]},"references-count":25,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1,1]]}},"URL":"https:\/\/doi.org\/10.5753\/jis.2026.6580","relation":{},"ISSN":["2763-7719"],"issn-type":[{"value":"2763-7719","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,30]]}}}