{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T21:48:28Z","timestamp":1785448108158,"version":"3.56.0"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,9,9]],"date-time":"2019-09-09T00:00:00Z","timestamp":1567987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-1747997,IIS-1822813,CSR-1526237"],"award-info":[{"award-number":["IIS-1747997,IIS-1822813,CSR-1526237"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2019,9,9]]},"abstract":"<jats:p>Providing university teachers with high-quality opportunities for professional development cannot happen without data about the classroom environment. Currently, the most effective mechanism is for an expert to observe one or more lectures and provide personalized formative feedback to the instructor. Of course, this is expensive and unscalable, and perhaps most critically, precludes a continuous learning feedback loop for the instructor. In this paper, we present the culmination of two years of research and development on EduSense, a comprehensive sensing system that produces a plethora of theoretically-motivated visual and audio features correlated with effective instruction, which could feed professional development tools in much the same way as a Fitbit sensor reports step count to an end user app. Although previous systems have demonstrated some of our features in isolation, EduSense is the first to unify them into a cohesive, real-time, in-the-wild evaluated, and practically-deployable system. Our two studies quantify where contemporary machine learning techniques are robust, and where they fall short, illuminating where future work remains to bring the vision of automated classroom analytics to reality.<\/jats:p>","DOI":"10.1145\/3351229","type":"journal-article","created":{"date-parts":[[2019,9,10]],"date-time":"2019-09-10T15:58:26Z","timestamp":1568131106000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":129,"title":["EduSense"],"prefix":"10.1145","volume":"3","author":[{"given":"Karan","family":"Ahuja","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dohyun","family":"Kim","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Franceska","family":"Xhakaj","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Virag","family":"Varga","sequence":"additional","affiliation":[{"name":"ETH Zurich, Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"Xie","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stanley","family":"Zhang","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jay Eric","family":"Townsend","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chris","family":"Harrison","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy","family":"Ogan","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuvraj","family":"Agarwal","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,9,9]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"A. L. Abrahamson (1998). \"An Overview of Teaching and Learning Research with Classroom Communication Systems \" International Conference on Teaching of Mathematics (1998) Village of Pythagorion Samos Greece.  A. L. Abrahamson (1998). \"An Overview of Teaching and Learning Research with Classroom Communication Systems \" International Conference on Teaching of Mathematics (1998) Village of Pythagorion Samos Greece."},{"key":"e_1_2_2_2_1","volume-title":"Proceedings of the 2009 conference on Artificial Intelligence in Education. IOS Press","author":"Arroyo I.","year":"2009"},{"issue":"1","key":"e_1_2_2_3_1","first-page":"94","article-title":"Preparing the Next Generation of Faculty: Graduate School as Socialization to the Academic Career","volume":"73","author":"Austin A.E.","year":"2002","journal-title":"The Journal of Higher Education"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00019"},{"key":"e_1_2_2_5_1","article-title":"ESP: Everyday Sensing and Perception in the Classroom","volume":"14","author":"Beckwith R.","year":"2010","journal-title":"Intel\u00ae Technology Journal"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07221-0_5"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2946837"},{"key":"e_1_2_2_8_1","unstructured":"G. Bradski (2000). The OpenCV Library. Dr. Dobb's Journal of Software Tools. Article 2236121.  G. Bradski (2000). The OpenCV Library. Dr. Dobb's Journal of Software Tools. Article 2236121."},{"issue":"5","key":"e_1_2_2_9_1","first-page":"574","article-title":"The Practice of Giving Feedback to Improve Teaching: What Is Effective","volume":"64","author":"Brinko K.T.","year":"1993","journal-title":"The Journal of Higher Education"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1187\/cbe.12-09-0163"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2890633"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1187\/cbe.06-12-0205"},{"key":"e_1_2_2_13_1","volume-title":"Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","year":"2017"},{"key":"e_1_2_2_14_1","volume-title":"Classroom discourse: The language of teaching and learning (pp. 53--79).","author":"Cazden C.D.","year":"2001"},{"key":"e_1_2_2_15_1","unstructured":"G. Chen S.N. Clarke & L.B. Resnick (2015). Classroom Discourse Analyzer (CDA): A Discourse Analytic Tool for Teachers. Technology Instruction Cognition & Learning 10(2).  G. Chen S.N. Clarke & L.B. Resnick (2015). Classroom Discourse Analyzer (CDA): A Discourse Analytic Tool for Teachers. Technology Instruction Cognition & Learning 10(2)."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2014.965823"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380124"},{"key":"e_1_2_2_18_1","volume-title":"Design Recommendations for Intelligent Tutoring Systems","volume":"48","author":"D'Mello S.","year":"2014"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818346.2830602"},{"key":"e_1_2_2_20_1","first-page":"13","article-title":"Electronically Enhanced Classroom Interaction","author":"Draper S.","year":"2002","journal-title":"Australian Journal of Educational Technology"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10956-006-0360-1"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2168-9830.2008.tb00989.x"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/325737.325790"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1319030111"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2513456.2513468"},{"key":"e_1_2_2_26_1","volume-title":"International Conference of the Learning Sciences (Vol. 3).","author":"Gerritsen D.","year":"2018"},{"key":"e_1_2_2_27_1","volume-title":"Carnegie Mellon University","author":"Gerritsen D.","year":"2018"},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"G. Gibbs & M. Coffey (2004). The impact of training of university teachers on their teaching skills their approach to teaching and the approach to learning of their students. Active learning in higher education 5(1) 87--100.  G. Gibbs & M. Coffey (2004). The impact of training of university teachers on their teaching skills their approach to teaching and the approach to learning of their students. Active learning in higher education 5(1) 87--100.","DOI":"10.1177\/1469787404040463"},{"issue":"2","key":"e_1_2_2_29_1","first-page":"187","article-title":"Feedback about Teaching in Higher Ed: Neglected Opportunities to Promote Change","volume":"13","author":"Gormally C.","year":"2014","journal-title":"Cell Biology Education"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9779.2012.01554.x"},{"key":"e_1_2_2_31_1","volume-title":"Proceedings of the 6th International Conference on Educational Data Mining","author":"Grafsgaard J.F.","year":"2013"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025669"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10755-005-6301-8"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11251-010-9163-0"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/tea.20439"},{"key":"e_1_2_2_36_1","first-page":"3055A","article-title":"An Investigation of Instructor Use of Space","volume":"1972","author":"Hesler M.W.","year":"1972","journal-title":"Dissertation Abstracts International"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170358.3170377"},{"key":"e_1_2_2_38_1","volume-title":"International Conference on Artificial Intelligence in Education. Springer, 154--168","author":"McLaren B.","year":"2018"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.64.4.349"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pragma.2013.12.002"},{"key":"e_1_2_2_41_1","first-page":"171","volume-title":"Emerging Research in Computing, Information, Communication and Applications (ERCICA '16)","author":"Jesna J.","year":"2016"},{"key":"e_1_2_2_42_1","unstructured":"JobScheduler. Software- und Organisations-Service (SOS). Last retrieved September 12 2018. Thttp:\/\/www.sos-berlin.com\/jobscheduler  JobScheduler. Software- und Organisations-Service (SOS). Last retrieved September 12 2018. Thttp:\/\/www.sos-berlin.com\/jobscheduler"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2007.02.003"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.241"},{"key":"e_1_2_2_45_1","unstructured":"D.E. King (2009). Dlib-ml: A Machine Learning Toolkit. J. Mach. Learn. Res. 10 (December 2009) 1755--1758.   D.E. King (2009). Dlib-ml: A Machine Learning Toolkit. J. Mach. Learn. Res. 10 (December 2009) 1755--1758."},{"key":"e_1_2_2_46_1","unstructured":"P. Koshland-Crane (2008). The effect of professional development of nonverbal communication behaviors of participants' regognition and understanding of these behaviors. (University of San Francisco)  P. Koshland-Crane (2008). The effect of professional development of nonverbal communication behaviors of participants' regognition and understanding of these behaviors. (University of San Francisco)"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1322192.1322256"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242609"},{"key":"e_1_2_2_49_1","first-page":"1","article-title":"Evaluating the Efficacy of Questioning Strategies in Lecture-Based Classroom Environments: Are We Asking the Right Questions","volume":"24","author":"Larson L.R.","year":"2013","journal-title":"Journal of Excellence in College Teaching"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-008-0152-6"},{"key":"e_1_2_2_51_1","doi-asserted-by":"crossref","unstructured":"J. Lin F. Jiang & R. Shen. (2018). Hand-Raising Gesture Detection in Real Classroom. 6453--6457.  J. Lin F. Jiang & R. Shen. (2018). Hand-Raising Gesture Detection in Real Classroom. 6453--6457.","DOI":"10.1109\/ICASSP.2018.8461733"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2011.5771414"},{"key":"e_1_2_2_53_1","unstructured":"P. Martins. \"Anthropometric Model\". Last retrieved May 15 2018. aifi.isr.uc.pt\/Downloads\/OpenGL\/glAnthropometric3DModel.cpp  P. Martins. \"Anthropometric Model\". Last retrieved May 15 2018. aifi.isr.uc.pt\/Downloads\/OpenGL\/glAnthropometric3DModel.cpp"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMI.2002.1166962"},{"key":"e_1_2_2_55_1","unstructured":"A. Mehrabian (1971). Silent messages (Vol. 8). Belmont CA: Wadsworth.  A. Mehrabian (1971). Silent messages (Vol. 8). Belmont CA: Wadsworth."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)1052-3928(2006)132:3(204)"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/WMUTE.2012.22"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2003.10047"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.2307\/2943844"},{"key":"e_1_2_2_60_1","unstructured":"NVIDIA Visual Profiler. Last Retrieved September 13 2018. https:\/\/developer.nvidia.com\/nvidia-visual-profiler.  NVIDIA Visual Profiler. Last Retrieved September 13 2018. https:\/\/developer.nvidia.com\/nvidia-visual-profiler."},{"key":"e_1_2_2_61_1","doi-asserted-by":"crossref","unstructured":"T. Parker O. Hoopes & D. Eggett (2011). The effect of seat location and movement or permanence on student-initiated participation. College teaching 59(2) 79--84.  T. Parker O. Hoopes & D. Eggett (2011). The effect of seat location and movement or permanence on student-initiated participation. College teaching 59(2) 79--84.","DOI":"10.1080\/87567555.2010.538766"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.5555\/2062780.2062784"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2460296.2460351"},{"key":"e_1_2_2_64_1","unstructured":"M. Raca and P. Dillenbourg (2015). \"Camera-based estimation of student's attention in class.\" EPFL Thesis 6745. urn: urn:nbn:ch:belepfl-thesis6745-4  M. Raca and P. Dillenbourg (2015). \"Camera-based estimation of student's attention in class.\" EPFL Thesis 6745. urn: urn:nbn:ch:belepfl-thesis6745-4"},{"key":"e_1_2_2_65_1","unstructured":"V.P. Richmond (2002). Teacher nonverbal immediacy. Communication for teachers 65 82.  V.P. Richmond (2002). Teacher nonverbal immediacy. Communication for teachers 65 82."},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1080\/23808985.1987.11678663"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1080\/01463379109369795"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953347"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1080\/03634520903505936"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2164-6163.1975.tb00192.x"},{"key":"e_1_2_2_71_1","volume-title":"Proc. of 21st Computer Vision Winter Workshop","author":"Soukupov\u00e1 T.","year":"2016"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.edurev.2009.07.001"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMI.2002.1167006"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1162\/089120100561737"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3090092"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2316163"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-45153-4_26"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66610-5_23"},{"key":"e_1_2_2_79_1","doi-asserted-by":"crossref","unstructured":"N. Yannier K. Koedinger and S. Hudson (2013) \"Tangible Collaborative Learning with a Mixed-Reality Game: EarthShake\" Artificial Intelligence in Education 131--140.  N. Yannier K. Koedinger and S. Hudson (2013) \"Tangible Collaborative Learning with a Mixed-Reality Game: EarthShake\" Artificial Intelligence in Education 131--140.","DOI":"10.1007\/978-3-642-39112-5_14"},{"key":"e_1_2_2_80_1","article-title":"Predicting students' attention in the classroom from Kinect facial and body features","volume":"1","author":"Zaletelj J.","year":"2017","journal-title":"EURASIP Journal on Image and Video Processing."},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2009.01.254"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3351229","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3351229","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3351229","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:50Z","timestamp":1750206350000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3351229"}},"subtitle":["Practical Classroom Sensing at Scale"],"short-title":[],"issued":{"date-parts":[[2019,9,9]]},"references-count":81,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,9,9]]}},"alternative-id":["10.1145\/3351229"],"URL":"https:\/\/doi.org\/10.1145\/3351229","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,9]]},"assertion":[{"value":"2019-09-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}