{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T05:35:43Z","timestamp":1763444143856,"version":"3.45.0"},"reference-count":25,"publisher":"Emerald","issue":"4","funder":[{"name":"Natural Science Foundation of Beijing Municipality","award":["No.U21A20449","Unassigned"],"award-info":[{"award-number":["No.U21A20449","Unassigned"]}]},{"DOI":"10.13039\/501100002766","name":"Beijing University of Posts and Telecommunications","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002766","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002766","name":"Beijing University of Posts and Telecommunications","doi-asserted-by":"crossref","award":["Unassigned"],"award-info":[{"award-number":["Unassigned"]}],"id":[{"id":"10.13039\/501100002766","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,11,18]]},"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Educational assignments are pivotal for student learning, yet educators face the dual burden of creating meaningful questions and providing timely, individualized feedback. This study introduces IntelliA, a generative AI-powered platform designed to address these challenges by holistically automating the entire assignment lifecycle, from pedagogically aware question generation to concept-centric evaluation, thereby alleviating instructor workload and enhancing student learning outcomes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design\/methodology\/approach<\/jats:title>\n                    <jats:p>IntelliA\u2019s core innovation is a synergistic architecture that operationalizes pedagogical principles directly into the AI-driven assignment workflow. For question generation, its pedagogical primitive-driven system allows educators to design assessments at a conceptual level \u2013 by selecting instructional goals \u2013 rather than manually crafting prompts. For evaluation, a novel three-stage, rubric-driven methodology is designed to produce pedagogically valuable feedback, grounding its supportive guidance in objective, evidence-based scoring. These subsystems are unified by a unified quality augmentation module, creating a self-reinforcing loop that continuously refines the system\u2019s pedagogical alignment. This architecture\u2019s ability to enhance both educational quality and operational efficiency was rigorously validated through a semester-long university deployment, assessed via a multi-faceted framework of instructor interviews, student surveys and cross-model benchmarking.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Findings<\/jats:title>\n                    <jats:p>The results demonstrate that IntelliA significantly reduces assignment creation time for instructors while maintaining high pedagogical quality in generated questions. Student surveys revealed high satisfaction with the grading accuracy and the personalized, actionable feedback, which they reported as instrumental to their learning. The findings confirm that an architecturally sophisticated AI system can successfully move beyond simple automation to enhance both operational efficiency and educational quality.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Research limitations\/implications<\/jats:title>\n                    <jats:p>Our study\u2019s validation was conducted within a single university STEM course, which limits the generalizability of our findings. Future research should expand the library of pedagogical primitives to diverse domains (e.g. humanities and K-12) and validate their effectiveness in these new contexts. Additionally, a more rigorous, controlled experiment is needed to quantitatively measure efficiency gains in terms of time-on-task and cognitive load. This work signals a shift in AI-in-education research, moving from single-task automation toward designing synergistic, architecturally aware systems.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Practical implications<\/jats:title>\n                    <jats:p>IntelliA offers a practical, scalable solution for educators to significantly reduce the workload associated with assignment creation and feedback personalization. By automating routine tasks, the platform empowers instructors to shift their focus from content generation to higher-value pedagogical activities, such as refining learning objectives and providing nuanced student support. This model demonstrates how AI can be integrated into educational workflows as a collaborative partner, enhancing both operational efficiency and the quality of pedagogical practice.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Social implications<\/jats:title>\n                    <jats:p>The widespread adoption of synergistic AI systems like IntelliA could democratize access to high-quality, personalized learning support, potentially narrowing educational equity gaps. However, it also raises critical social questions about the future of the teaching profession and the risk of over-reliance on automation. The key social implication is the need for a public discourse on responsible AI integration in education, ensuring that technology serves to amplify educator agency and enhance human-centric learning, rather than deskilling teachers or creating uniform, passive learning pathways.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Originality\/value<\/jats:title>\n                    <jats:p>This study presents a significant leap forward by proposing a novel, synergistic system architecture for AI in education. Unlike prior systems that address isolated tasks, IntelliA offers a holistically integrated and self-improving ecosystem. By demonstrating how to embed pedagogical principles directly into an AI\u2019s core logic, IntelliA provides a scalable and flexible blueprint for a new generation of educational tools. This approach moves beyond simple automation, fostering a new dynamic where AI functions not as a mere instrument but as a genuine partner in the pedagogical process.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1108\/ijicc-03-2025-0177","type":"journal-article","created":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T05:36:17Z","timestamp":1761197777000},"page":"661-675","source":"Crossref","is-referenced-by-count":0,"title":["IntelliA: an intelligent educational assignment practicing platform driven by generative AI"],"prefix":"10.1108","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-5942-4231","authenticated-orcid":true,"given":"Zhihai","family":"Wang","sequence":"first","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications , ,","place":["Beijing, China"]}]},{"given":"Kun","family":"Niu","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications , ,","place":["Beijing, China"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-9035-4138","authenticated-orcid":true,"given":"Siying","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications , ,","place":["Beijing, China"]}]},{"given":"Shuai","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications , ,","place":["Beijing, China"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-4931-8399","authenticated-orcid":true,"given":"Fangbo","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications , ,","place":["Beijing, China"]}]}],"member":"140","published-online":{"date-parts":[[2025,10,24]]},"reference":[{"key":"2025111800321407200_ref001","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1007\/978-3-031-47994-6_38","volume-title":"Artificial Intelligence XL","author":"Bhowmick","year":"2023"},{"key":"2025111800321407200_ref002","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/978-3-030-84060-0_5","volume-title":"Machine Learning and Knowledge Extraction","author":"Bonthu","year":"2021"},{"key":"2025111800321407200_ref003","first-page":"536","volume-title":"Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky","author":"Elkins","year":"2023"},{"key":"2025111800321407200_ref004","doi-asserted-by":"publisher","first-page":"23084","DOI":"10.1609\/aaai.v38i21.30353","article-title":"How teachers can use Large Language models and bloom's Taxonomy to create educational quizzes","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Elkins","year":"2024"},{"key":"2025111800321407200_ref005","article-title":"ChatGLM: a family of Large Language models from GLM-130B to GLM-4 all tools","author":"Glm","year":"2024","journal-title":"arXiv preprint arXiv:2406.12793"},{"key":"2025111800321407200_ref007","doi-asserted-by":"publisher","DOI":"10.1016\/j.lindif.2023.102274","article-title":"ChatGPT for good? On opportunities and challenges of large language models for education","volume":"103","author":"Kasneci","year":"2023","journal-title":"Learning and Individual Differences"},{"key":"2025111800321407200_ref008","first-page":"369","article-title":"Improving student learning in math through web-based homework","volume":"3","author":"Kelly","year":"2014","journal-title":"Proceedings of the 38th Conference of the International Group for the Psychology of Mathematics Education and the 36th Conference of the North American Chapter of the Psychology of Mathematics Education"},{"key":"2025111800321407200_ref009","doi-asserted-by":"publisher","DOI":"10.1016\/j.caeai.2022.100080","article-title":"Personalized feedback in digital learning environments: classification framework and literature review","volume":"3","author":"Maier","year":"2022","journal-title":"Computers and Education: Artificial Intelligence"},{"key":"2025111800321407200_ref010","doi-asserted-by":"publisher","first-page":"53","DOI":"10.18420\/seuh2024_04","article-title":"EvalQuiz \u2013 LLM-based automated generation of self-assessment quizzes in software engineering education","author":"Mei\u00dfner","year":"2024","journal-title":"Lecture Notes in Informatics (LNI) - Proceedings"},{"key":"2025111800321407200_ref006","article-title":"The llama 3 herd of models","author":"Meta","year":"2024","journal-title":"arXiv preprint arXiv:2407.21783"},{"key":"2025111800321407200_ref011","first-page":"2830","volume-title":"Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, Presented at the EACL 2023","author":"Naeiji","year":"2023"},{"key":"2025111800321407200_ref026","unstructured":"OpenAI\n           (2024), \u201cGPT-4 technical Report\u201d, 4 March, arXiv preprint arXiv:2303.08774."},{"issue":"7","key":"2025111800321407200_ref012","doi-asserted-by":"publisher","first-page":"710","DOI":"10.1037\/bul0000151","article-title":"Transfer of test-enhanced learning: meta-analytic review and synthesis","volume":"144","author":"Pan","year":"2018","journal-title":"Psychological Bulletin"},{"issue":"3","key":"2025111800321407200_ref013","doi-asserted-by":"publisher","first-page":"235","DOI":"10.18608\/jla.2018.53.15","article-title":"OnTask: delivering data-informed, personalized learning support actions","volume":"5","author":"Pardo","year":"2018","journal-title":"Journal of Learning Analytics"},{"issue":"3","key":"2025111800321407200_ref014","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1177\/0976500x231210427","article-title":"Perspectives of ChatGPT in pharmacology education, and research in health care: a narrative review","volume":"14","author":"Patel","year":"2023","journal-title":"Journal of Pharmacology and Pharmacotherapeutics"},{"key":"2025111800321407200_ref015","unstructured":"Qwen\n           (2025), \u201cQwen2.5 technical Report\u201d, 3 January, arXiv preprint arXiv:2412.15115."},{"key":"2025111800321407200_ref016","first-page":"2349","article-title":"SQuAD: 100,000+ questions for machine comprehension of text","author":"Rajpurkar","year":"2016","journal-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing"},{"issue":"3","key":"2025111800321407200_ref017","doi-asserted-by":"publisher","first-page":"2495","DOI":"10.1007\/s10462-021-10068-2","article-title":"An automated essay scoring systems: a systematic literature review","volume":"55","author":"Ramesh","year":"2022","journal-title":"Artificial Intelligence Review"},{"issue":"3","key":"2025111800321407200_ref018","doi-asserted-by":"publisher","first-page":"823","DOI":"10.1007\/s10648-020-09578-2","article-title":"Metacognition about practice testing: a review of learners' beliefs, monitoring, and control of test-enhanced learning","volume":"33","author":"Rivers","year":"2021","journal-title":"Educational Psychology Review"},{"issue":"4","key":"2025111800321407200_ref027","doi-asserted-by":"publisher","DOI":"10.1177\/2332858416673968","article-title":"Online mathematics homework increases student achievement","volume":"2","author":"Roschelle","year":"2016","journal-title":"AERA Open"},{"volume-title":"Towards Automated Generation and Evaluation of Questions in Educational Domains","year":"2022","author":"Shravya","key":"2025111800321407200_ref019"},{"key":"2025111800321407200_ref020","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1007\/978-3-031-32883-1_58","volume-title":"Augmented Intelligence and Intelligent Tutoring Systems","author":"Troussas","year":"2023"},{"key":"2025111800321407200_ref021","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1007\/978-3-031-11644-5_13","volume-title":"Artificial Intelligence in Education","author":"Wang","year":"2022"},{"key":"2025111800321407200_ref022","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1007\/978-3-319-71054-9_39","volume-title":"Second Handbook of Information Technology in Primary and Secondary Education","author":"Whitelock","year":"2018"},{"issue":"1","key":"2025111800321407200_ref023","doi-asserted-by":"publisher","first-page":"14:1","DOI":"10.1145\/3468889","article-title":"A review on question generation from natural language text","volume":"40","author":"Zhang","year":"2021","journal-title":"ACM Transactions on Information Systems"}],"container-title":["International Journal of Intelligent Computing and Cybernetics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/ijicc\/article-pdf\/doi\/10.1108\/IJICC-03-2025-0177\/10379520\/ijicc-03-2025-0177en.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.emerald.com\/ijicc\/article-pdf\/doi\/10.1108\/IJICC-03-2025-0177\/10379520\/ijicc-03-2025-0177en.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T05:32:35Z","timestamp":1763443955000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/ijicc\/article\/18\/4\/661\/1306360\/IntelliA-an-intelligent-educational-assignment"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,24]]},"references-count":25,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,11,18]]}},"URL":"https:\/\/doi.org\/10.1108\/ijicc-03-2025-0177","relation":{},"ISSN":["1756-378X","1756-3798"],"issn-type":[{"type":"print","value":"1756-378X"},{"type":"electronic","value":"1756-3798"}],"subject":[],"published":{"date-parts":[[2025,10,24]]}}}