{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T11:56:37Z","timestamp":1763034997204,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2017,6,14]],"date-time":"2017-06-14T00:00:00Z","timestamp":1497398400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We advocate for and introduce LEARNSense, a framework for learning analytics using commodity wearable devices to capture learner\u2019s physical actions and accordingly infer learner context (e.g., student activities and engagement status in class). Our work is motivated by the observations that: (a) the fine-grained individual-specific learner actions are crucial to understand learners and their context information; (b) sensor data available on the latest wearable devices (e.g., wrist-worn and eye wear devices) can effectively recognize learner actions and help to infer learner context information; (c) the commodity wearable devices that are widely available on the market can provide a hassle-free and non-intrusive solution. Following the above observations and under the proposed framework, we design and implement a sensor-based learner context collector running on the wearable devices. The latest data mining and sensor data processing techniques are employed to detect different types of learner actions and context information. Furthermore, we detail all of the above efforts by offering a novel and exemplary use case: it successfully provides the accurate detection of student actions and infers the student engagement states in class. The specifically designed learner context collector has been implemented on the commodity wrist-worn device. Based on the collected and inferred learner information, the novel intervention and incentivizing feedback are introduced into the system service. Finally, a comprehensive evaluation with the real-world experiments, surveys and interviews demonstrates the effectiveness and impact of the proposed framework and this use case. The F1 score for the student action classification tasks achieve 0.9, and the system can effectively differentiate the defined three learner states. Finally, the survey results show that the learners are satisfied with the use of our system (mean score of 3.7 with a standard deviation of 0.55).<\/jats:p>","DOI":"10.3390\/s17061382","type":"journal-article","created":{"date-parts":[[2017,6,14]],"date-time":"2017-06-14T10:49:53Z","timestamp":1497437393000},"page":"1382","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["A Framework for Learning Analytics Using Commodity Wearable Devices"],"prefix":"10.3390","volume":"17","author":[{"given":"Yu","family":"Lu","sequence":"first","affiliation":[{"name":"Advanced Innovation Center for Future Education, Beijing Normal University, Beijing 100875, China"},{"name":"Institute for Infocomm Research, Agency for Science, Technology and Research, Singapore 138632, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8010-6045","authenticated-orcid":false,"given":"Sen","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology, Beijing 100083, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0204-3867","authenticated-orcid":false,"given":"Zhiqiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Electronic and Electrical Engineering, University of Leeds, Leeds LS29JT, UK"}]},{"given":"Wendong","family":"Xiao","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology, Beijing 100083, China"}]},{"given":"Shengquan","family":"Yu","sequence":"additional","affiliation":[{"name":"Advanced Innovation Center for Future Education, Beijing Normal University, Beijing 100875, China"}]}],"member":"1968","published-online":{"date-parts":[[2017,6,14]]},"reference":[{"key":"ref_1","unstructured":"Siemens, G. (March, January 27). Proceedings of the 1st International Conference on Learning Analytics and Knowledge, Banff, AB, Canada. Available online: http:\/\/tekri.athabascau.ca\/analytics\/."},{"key":"ref_2","unstructured":"Initiative, E.L. (2011). Learning Analytics. The Horizon Report, The New Media Consortium. [2011 ed.]."},{"key":"ref_3","unstructured":"(2017, June 01). Apple Watch Series 2. Available online: http:\/\/www.apple.com\/watch\/."},{"key":"ref_4","unstructured":"(2017, June 01). Google and Foxconn. Available online: https:\/\/www.google.com\/glass\/start\/."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"31334","DOI":"10.3390\/s151229858","article-title":"Physical Human Activity Recognition Using Wearable Sensors","volume":"15","author":"Attal","year":"2015","journal-title":"Sensors"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Stoppa, M., and Chiolerio, A. (2014). Wearable Electronics and Smart Textiles: A Critical Review. Sensors, 14.","DOI":"10.3390\/s140711957"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/RBME.2015.2427254","article-title":"Body Sensor Networks: In the Era of Big Data and Beyond","volume":"8","author":"Poon","year":"2015","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1504\/IJTEL.2012.051816","article-title":"Learning analytics: Drivers, developments and challenges","volume":"4","author":"Ferguson","year":"2012","journal-title":"Int. J. Technol. Enhanc. Learn."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Prieto, L.P., Sharma, K., Dillenbourg, P., and Jes\u00fas, M. (2016, January 25\u201329). Teaching Analytics: Towards Automatic Extraction of Orchestration Graphs Using Wearable Sensors. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, Edinburgh, UK.","DOI":"10.1145\/2883851.2883927"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Pirkl, G., Hevesi, P., Lukowicz, P., Klein, P., Heisel, C., Gr\u00f6ber, S., Kuhn, J., and Sick, B. (2016, January 12\u201316). Any Problems? A Wearable Sensor-based Platform for Representational Learning-Analytics. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, Heidelberg, Germany.","DOI":"10.1145\/2968219.2971383"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Adjei, S.A., Botelho, A.F., and Heffernan, N.T. (2016, January 25\u201329). Predicting Student Performance on Post-requisite Skills Using Prerequisite Skill Data: An Alternative Method for Refining Prerequisite Skill Structures. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, Edinburgh, UK.","DOI":"10.1145\/2883851.2883867"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Pel\u00e1nek, R., Rih\u00e1k, J., and Papou\u0161ek, J. (2016, January 25\u201329). Impact of Data Collection on Interpretation and Evaluation of Student Models. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, Edinburgh, UK.","DOI":"10.1145\/2883851.2883868"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Pijeira-D\u00edaz, H.J., Drachsler, H., J\u00e4rvel\u00e4, S., and Kirschner, P.A. (2016, January 25\u201329). Investigating Collaborative Learning Success with Physiological Coupling Indices Based on Electrodermal Activity. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, Edinburgh, UK.","DOI":"10.1145\/2883851.2883897"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"McPherson, J., Tong, H.L., Fatt, S.J., and Liu, D.Y.T. (2016, January 25\u201329). Student Perspectives on Data Provision and Use: Starting to Unpack Disciplinary Differences. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, Edinburgh, UK.","DOI":"10.1145\/2883851.2883945"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Drachsler, H., and Greller, W. (2016, January 25\u201329). Privacy and Analytics: It\u2019s a DELICATE Issue a Checklist for Trusted Learning Analytics. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, Edinburgh, UK.","DOI":"10.1145\/2883851.2883893"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.chb.2014.11.050","article-title":"Using Learning Analytics to improve teamwork assessment","volume":"47","year":"2015","journal-title":"Comput. Hum. Behav."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1109\/TLT.2016.2557333","article-title":"Introducing IoT and Wearable Technologies into Task-Based Language Learning for Young Children","volume":"9","author":"Camacho","year":"2016","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1432","DOI":"10.1016\/j.eswa.2013.08.042","article-title":"Educational data mining: A survey and a data mining-based analysis of recent works","volume":"41","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/MCI.2014.2307227","article-title":"Jumping NLP Curves: A Review of Natural Language Processing Research","volume":"9","author":"Cambria","year":"2014","journal-title":"IEEE Comput. Intell. Mag."},{"key":"ref_20","unstructured":"Consortium, N.M., and Initiative, E.L. (2016). Wearable Technology. The Horizon Report, NMC."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/TLT.2009.49","article-title":"Deploying a Wearable Computing Platform for Computing Education","volume":"3","author":"Ngai","year":"2009","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1109\/TLT.2014.2377732","article-title":"Context Becomes Content: Sensor Data for Computer-Supported Reflective Learning","volume":"8","author":"Muller","year":"2015","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_23","unstructured":"(2017, June 01). Adidas Brings Fitness Tracking to Schoolchildren. Available online: http:\/\/go.nmc.org\/adizone."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gill, T., Keller, J.M., Anderson, D.T., and Luke, R.H. (2011, January 11\u201313). A system for change detection and human recognition in voxel space using the Microsoft Kinect sensor. Proceedings of the 2011 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington, DC, USA.","DOI":"10.1109\/AIPR.2011.6176347"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Okoshi, T., Lu, Y., Lee, Y., Balan, R.K., and Misra, A. (2015, January 14\u201316). QueueVadis: Queuing Analytics using Smartphones. Proceedings of the 14th International ACM Conference on Information Processing in Sensor Networks (IPSN), Seattle, WA, USA.","DOI":"10.1145\/2737095.2737120"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sen, S., Subbaraju, V., Misra, A., Balan, R.K., and Lee, Y. (2015, January 23\u201327). The case for smartwatch-based diet monitoring. Proceedings of the 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops), St. Louis, MO, USA.","DOI":"10.1109\/PERCOMW.2015.7134103"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Radhakrishnan, M., Sen, S., Vigneshwaran, S., Misra, A., and Balan, R. (2016, January 5\u201310). IoT + Small Data: Transforming in-store shopping analytics services. Proceedings of the 2016 8th International Conference on Communication Systems and Networks (COMSNETS), Bangalore, India.","DOI":"10.1109\/COMSNETS.2016.7439946"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Knighten, J., McMillan, S., Chambers, T., and Payton, J. (2015, January 23\u201327). Recognizing social gestures with a wrist-worn smartband. Proceedings of the 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops), St. Louis, MO, USA.","DOI":"10.1109\/PERCOMW.2015.7134096"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ustev, Y.E., Durmaz Incel, O., and Ersoy, C. (2013, January 8\u201312). User, device and orientation independent human activity recognition on mobile phones: Challenges and a proposal. Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication, Zurich, Switzerland.","DOI":"10.1145\/2494091.2496039"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jin, Y., Toh, H.S., Soh, W.S., and Wong, W.C. (2011, January 21\u201325). A robust dead-reckoning pedestrian tracking system with low cost sensors. Proceedings of the 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom), Seattle, WA, USA.","DOI":"10.1109\/PERCOM.2011.5767590"},{"key":"ref_31","unstructured":"Ayub, S., Bahraminasab, A., and Honary, B. (2012). A sensor fusion method for smart phone orientation estimation. Annual Symposium on the Convergence of Telecommunications, Networking and Broadcasting, Liverpool John Moores University."},{"key":"ref_32","unstructured":"(2017, June 01). Android Developer Manual. Available online: https:\/\/developer.android.com\/reference\/android\/...\/SensorManager.html."},{"key":"ref_33","unstructured":"Skog, I., and Hndel, P. (2006, January 17\u201322). Calibration of a MEMS inertial measurement unit. Proceeding of the IMEKO World Congress 2006, Rio de Janeiro, Brazil."},{"key":"ref_34","unstructured":"(2017, June 01). Ticwatch Version 2. Available online: https:\/\/en.ticwear.com\/."},{"key":"ref_35","unstructured":"(2017, June 01). Ticwatch SDK for Developer. Available online: http:\/\/developer.chumenwenwen.com\/en\/doc\/ticwear.html."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1109\/TSMCC.2007.905750","article-title":"Survey of Wireless Indoor Positioning Techniques and Systems","volume":"37","author":"Liu","year":"2007","journal-title":"Trans. Syst. Man Cybern. Part C"},{"key":"ref_37","unstructured":"(2017, June 01). Class Twist Inc.. Available online: https:\/\/www.classdojo.com\/."},{"key":"ref_38","unstructured":"Mankiewicz, R. (2004). The Story of Mathematics, Princeton University Press."},{"key":"ref_39","unstructured":"(2017, June 01). National Survey of Student Engagement (NSSE). Available online: http:\/\/nsse.indiana.edu\/."},{"key":"ref_40","unstructured":"Lachman, R., Lachman, J.L., and Butterfield, E.C. (1979). Cognitive Psychology and Information Processing: An Introduction, Lawrence Erlbaum Associates."},{"key":"ref_41","unstructured":"Card, S.K., Moran, T.P., and Newell, A. (1983). The Psychology of Human Computer Interaction, L. Erlbaum Associates Inc."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"R32","DOI":"10.1088\/1741-2560\/4\/2\/R03","article-title":"A survey of signal processing algorithms in brain\u2013computer interfaces based on electrical brain signals","volume":"4","author":"Bashashati","year":"2007","journal-title":"J. Neural Eng."},{"key":"ref_43","unstructured":"(2017, June 01). Bragi Headphone. Available online: https:\/\/www.bragi.com\/theheadphone\/."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1080\/00461520.2014.965823","article-title":"The ICAP framework: Linking cognitive engagement to active learning outcomes","volume":"49","author":"Chi","year":"2014","journal-title":"Educ. Psychol."},{"key":"ref_45","first-page":"1","article-title":"Student engagement literature review","volume":"11","author":"Vicki","year":"2010","journal-title":"High. Educ. Acad."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/6\/1382\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:39:00Z","timestamp":1760207940000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/6\/1382"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,14]]},"references-count":45,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2017,6]]}},"alternative-id":["s17061382"],"URL":"https:\/\/doi.org\/10.3390\/s17061382","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2017,6,14]]}}}