{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T09:49:03Z","timestamp":1747216143553,"version":"3.40.5"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"type":"electronic","value":"9781643685489"}],"license":[{"start":{"date-parts":[[2024,10,16]],"date-time":"2024-10-16T00:00:00Z","timestamp":1729036800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,10,16]]},"abstract":"<jats:p>Understanding student engagement in online education is crucial for optimizing learning outcomes. This paper introduces ECLIPSE dataset (Extended Classroom Learning Insights via Prolonged Student Engagement), comprising 10,110 annotated images from a 55-minutes , 30-minutes and 20-minutes online lecture. Annotations include four affective states: engagement, boredom, confusion, and frustration. ECLIPSE enables the investigation of learner attention dynamics over extended periods, overcoming the limitations of short-duration datasets. We establish benchmarks for ECLIPSE using models such as EfficientNet, Vision Transformer, Residual Attention Network, and GLAMOR-Net. We propose NeuralGaze, a novel framework integrating Neural Cellular Automata (NCA) with self-attention mechanisms, demonstrating superior accuracy in engagement level assessment compared to basic single-frame models. Furthermore, we introduce CG-SwT, a content-guided Swin Transformer model, which significantly outperforms the baseline ViT model on the ECLIPSE dataset (with F1-score improvements of 21.12%, 12.5%, 16.77%, and 15.41% for engagement, boredom, frustration, and confusion respectively). Our methods surpass existing single-frame engagement prediction baselines for both EngageNet and DAiSEE datasets by significant margins (7.4% and 6.2%, respectively). The code and dataset will be made publicly available.<\/jats:p>","DOI":"10.3233\/faia240551","type":"book-chapter","created":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T12:49:20Z","timestamp":1729169360000},"source":"Crossref","is-referenced-by-count":0,"title":["Unveiling Learner Dynamics: The ECLIPSE Dataset and NeuralGaze Framework for Prolonged Engagement Assessment in Online Learning"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-2479-0342","authenticated-orcid":false,"given":"Avinash","family":"Anand","sequence":"first","affiliation":[{"name":"IIIT, New Delhi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-9543-9295","authenticated-orcid":false,"given":"Avni","family":"Mittal","sequence":"additional","affiliation":[{"name":"IIT, Mandi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-4217-5400","authenticated-orcid":false,"given":"Laavanaya","family":"Dhawan","sequence":"additional","affiliation":[{"name":"NSUT, New Delhi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-1737-4058","authenticated-orcid":false,"given":"Mahisha","family":"Ramesh","sequence":"additional","affiliation":[{"name":"IIIT, New Delhi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2850-8799","authenticated-orcid":false,"given":"Juhi","family":"Krishnamurthy","sequence":"additional","affiliation":[{"name":"Adobe, Noida"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-2914-5509","authenticated-orcid":false,"given":"Naman","family":"Lal","sequence":"additional","affiliation":[{"name":"IIIT, New Delhi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-5044-1409","authenticated-orcid":false,"given":"Raj","family":"Jaiswal","sequence":"additional","affiliation":[{"name":"IIIT, New Delhi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2132-0882","authenticated-orcid":false,"given":"Pijush","family":"Bhuyan","sequence":"additional","affiliation":[{"name":"IIIT, New Delhi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2661-5822","authenticated-orcid":false,"family":"Himani","sequence":"additional","affiliation":[{"name":"IIIT, New Delhi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3615-5373","authenticated-orcid":false,"given":"Astha","family":"Verma","sequence":"additional","affiliation":[{"name":"IIIT, New Delhi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1028-9373","authenticated-orcid":false,"given":"Rajiv","family":"Ratn Shah","sequence":"additional","affiliation":[{"name":"IIIT, New Delhi"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7410-2590","authenticated-orcid":false,"given":"Roger","family":"Zimmermann","sequence":"additional","affiliation":[{"name":"NUS, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6995-6447","authenticated-orcid":false,"given":"Shin\u2019ichi","family":"Satoh","sequence":"additional","affiliation":[{"name":"NII, Tokyo"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2024"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA240551","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T12:49:21Z","timestamp":1729169361000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA240551"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,16]]},"ISBN":["9781643685489"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia240551","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"type":"print","value":"0922-6389"},{"type":"electronic","value":"1879-8314"}],"subject":[],"published":{"date-parts":[[2024,10,16]]}}}