{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T00:51:22Z","timestamp":1770511882897,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,21]],"date-time":"2020-10-21T00:00:00Z","timestamp":1603238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000183","name":"Army Research Office","doi-asserted-by":"publisher","award":["W911NF-20-2-0053"],"award-info":[{"award-number":["W911NF-20-2-0053"]}],"id":[{"id":"10.13039\/100000183","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,21]]},"DOI":"10.1145\/3382507.3418832","type":"proceedings-article","created":{"date-parts":[[2020,10,22]],"date-time":"2020-10-22T10:04:35Z","timestamp":1603361075000},"page":"660-664","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["OpenSense: A Platform for Multimodal Data Acquisition and Behavior Perception"],"prefix":"10.1145","author":[{"given":"Kalin","family":"Stefanov","sequence":"first","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}]},{"given":"Baiyu","family":"Huang","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}]},{"given":"Zongjian","family":"Li","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}]},{"given":"Mohammad","family":"Soleymani","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,10,22]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"M. Abadi A. Agarwal P. Barham E. Brevdo Z. Chen C. Citro G. S. Corrado A. Davis J. Dean M. Devin S. Ghemawat I. Goodfellow A. Harp G. Irving M. Isard Y. Jia R. Jozefowicz L. Kaiser M. Kudlur J. Levenberg D. Man\u00e9 R. Monga S. Moore D. Murray C. Olah M. Schuster J. Shlens B. Steiner I. Sutskever K. Talwar P. Tucker V. Vanhoucke V. Vasudevan F. Vi\u00e9gas O. Vinyals P. Warden M. Wattenberg M. Wicke Y. Yu and X. Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. http:\/\/tensorflow.org\/  M. Abadi A. Agarwal P. Barham E. Brevdo Z. Chen C. Citro G. S. Corrado A. Davis J. Dean M. Devin S. Ghemawat I. Goodfellow A. Harp G. Irving M. Isard Y. Jia R. Jozefowicz L. Kaiser M. Kudlur J. Levenberg D. Man\u00e9 R. Monga S. Moore D. Murray C. Olah M. Schuster J. Shlens B. Steiner I. Sutskever K. Talwar P. Tucker V. Vanhoucke V. Vasudevan F. Vi\u00e9gas O. Vinyals P. Warden M. Wattenberg M. Wicke Y. Yu and X. Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. http:\/\/tensorflow.org\/"},{"key":"e_1_3_2_2_2_1","volume-title":"Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition. 1--6.","author":"Baltru\u0161aitis T.","unstructured":"T. Baltru\u0161aitis , M. Mahmoud , and P. Robinson . 2015. Cross-Dataset Learning and Person-Specific Normalisation for Automatic Action Unit Detection . In Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition. 1--6. T. Baltru\u0161aitis, M. Mahmoud, and P. Robinson. 2015. Cross-Dataset Learning and Person-Specific Normalisation for Automatic Action Unit Detection. In Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition. 1--6."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2013.54"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00019"},{"key":"e_1_3_2_2_5_1","volume-title":"Proceedings of the ACM International Conference on Multimodal Interaction. 493-- 494","author":"Bohus D.","unstructured":"D. Bohus , S. Andrist , and M. Jalobeanu . 2017. Rapid Development of Multimodal Interactive Systems: A Demonstration of Platform for Situated Intelligence . In Proceedings of the ACM International Conference on Multimodal Interaction. 493-- 494 . D. Bohus, S. Andrist, and M. Jalobeanu. 2017. Rapid Development of Multimodal Interactive Systems: A Demonstration of Platform for Situated Intelligence. In Proceedings of the ACM International Conference on Multimodal Interaction. 493-- 494."},{"key":"e_1_3_2_2_6_1","unstructured":"Z. Cao G. Hidalgo Martinez T. Simon S. Wei and Y. A. Sheikh. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019).  Z. Cao G. Hidalgo Martinez T. Simon S. Wei and Y. A. Sheikh. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019)."},{"key":"e_1_3_2_2_7_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Cao Z.","unstructured":"Z. Cao , T. Simon , S-E. Wei , and Y. Sheikh . 2017. Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Z. Cao, T. Simon, S-E. Wei, and Y. Sheikh. 2017. Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_2_8_1","unstructured":"Fran\u00e7ois Chollet etal 2015. Keras. https:\/\/keras.io.  Fran\u00e7ois Chollet et al. 2015. Keras. https:\/\/keras.io."},{"key":"e_1_3_2_2_9_1","volume-title":"Proceedings of the ACM International Conference on Multimedia. 835--838","author":"Eyben F.","unstructured":"F. Eyben , F. Weninger , F. Gross , and B. Schuller . 2013. Recent Developments in OpenSmile, the Munich Open-Source Multimedia Feature Extractor . In Proceedings of the ACM International Conference on Multimedia. 835--838 . F. Eyben, F. Weninger, F. Gross, and B. Schuller. 2013. Recent Developments in OpenSmile, the Munich Open-Source Multimedia Feature Extractor. In Proceedings of the ACM International Conference on Multimedia. 835--838."},{"key":"e_1_3_2_2_10_1","volume-title":"Proceedings of the ACM International Conference on Multimedia. 1459--1462","author":"Eyben F.","unstructured":"F. Eyben , M. W\u00f6llmer , and B. Schuller . 2010. OpenSmile: The Munich Versatile and Fast Open-Source Audio Feature Extractor . In Proceedings of the ACM International Conference on Multimedia. 1459--1462 . F. Eyben, M. W\u00f6llmer, and B. Schuller. 2010. OpenSmile: The Munich Versatile and Fast Open-Source Audio Feature Extractor. In Proceedings of the ACM International Conference on Multimedia. 1459--1462."},{"key":"e_1_3_2_2_11_1","unstructured":"The Apache Software Foundation. 2020. Apache ActiveMQ. http:\/\/activemq. apache.org\/  The Apache Software Foundation. 2020. Apache ActiveMQ. http:\/\/activemq. apache.org\/"},{"key":"e_1_3_2_2_12_1","unstructured":"Google. 2020. Google Cloud Platform. https:\/\/cloud.google.com  Google. 2020. Google Cloud Platform. https:\/\/cloud.google.com"},{"key":"e_1_3_2_2_13_1","unstructured":"J. Haas. 2014. A History of the Unity Game Engine. (2014).  J. Haas. 2014. A History of the Unity Game Engine. (2014)."},{"key":"e_1_3_2_2_14_1","unstructured":"D. J. McDuff K. Rowan P. Choudhury J. Wolk T. Pham and M. Czerwinski. 2019. A Multimodal Emotion Sensing Platform for Building Emotion-Aware Applications. CoRR abs\/1903.12133 (2019).  D. J. McDuff K. Rowan P. Choudhury J. Wolk T. Pham and M. Czerwinski. 2019. A Multimodal Emotion Sensing Platform for Building Emotion-Aware Applications. CoRR abs\/1903.12133 (2019)."},{"key":"e_1_3_2_2_15_1","unstructured":"Microsoft. 2020. Microsoft Azure. https:\/\/azure.microsoft.com  Microsoft. 2020. Microsoft Azure. https:\/\/azure.microsoft.com"},{"key":"e_1_3_2_2_16_1","unstructured":"Nvidia. 2020. CUDA. https:\/\/developer.nvidia.com\/cuda-zone  Nvidia. 2020. CUDA. https:\/\/developer.nvidia.com\/cuda-zone"},{"key":"e_1_3_2_2_17_1","volume-title":"Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. 2038--2045","author":"Shen J.","unstructured":"J. Shen and M. Pantic . 2009. A Software Framework for Multimodal HumanComputer Interaction Systems . In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. 2038--2045 . J. Shen and M. Pantic. 2009. A Software Framework for Multimodal HumanComputer Interaction Systems. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. 2038--2045."},{"key":"e_1_3_2_2_18_1","volume-title":"Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition. 766--773","author":"Shen J.","unstructured":"J. Shen , W. Shi , and M. Pantic . 2011. HCI2 Workbench: A Development Tool for Multimodal Human-Computer Interaction Systems . In Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition. 766--773 . J. Shen, W. Shi, and M. Pantic. 2011. HCI2 Workbench: A Development Tool for Multimodal Human-Computer Interaction Systems. In Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition. 766--773."},{"key":"e_1_3_2_2_19_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Simon T.","unstructured":"T. Simon , H. Joo , I. Matthews , and Y. Sheikh . 2017. Hand Keypoint Detection in Single Images Using Multiview Bootstrapping . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. T. Simon, H. Joo, I. Matthews, and Y. Sheikh. 2017. Hand Keypoint Detection in Single Images Using Multiview Bootstrapping. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_2_20_1","volume-title":"Webcam-based Eye Gaze Tracking Under Natural Head Movement. Master's thesis","author":"Stefanov K.","unstructured":"K. Stefanov . 2010. Webcam-based Eye Gaze Tracking Under Natural Head Movement. Master's thesis . University of Amsterdam. K. Stefanov. 2010. Webcam-based Eye Gaze Tracking Under Natural Head Movement. Master's thesis. University of Amsterdam."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2614300"},{"key":"e_1_3_2_2_22_1","volume-title":"Proceedings of the ACM International Conference on Multimedia. 831--834","author":"Wagner J.","unstructured":"J. Wagner , F. Lingenfelser , T. Baur , I. Damian , F. Kistler , and E. Andr\u00e9 . 2013. The Social Signal Interpretation (SSI) Framework: Multimodal Signal Processing and Recognition in Real-Time . In Proceedings of the ACM International Conference on Multimedia. 831--834 . J. Wagner, F. Lingenfelser, T. Baur, I. Damian, F. Kistler, and E. Andr\u00e9. 2013. The Social Signal Interpretation (SSI) Framework: Multimodal Signal Processing and Recognition in Real-Time. In Proceedings of the ACM International Conference on Multimedia. 831--834."},{"key":"e_1_3_2_2_23_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Wei S-E.","unstructured":"S-E. Wei , V. Ramakrishna , T. Kanade , and Y. Sheikh . 2016. Convolutional Pose Machines . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. S-E. Wei, V. Ramakrishna, T. Kanade, and Y. Sheikh. 2016. Convolutional Pose Machines. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_2_24_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 3756--3764","author":"Wood E.","unstructured":"E. Wood , T. Baltru\u0161aitis , X. Zhang , Y. Sugano , P. Robinson , and A. Bulling . 2015. Rendering of Eyes for Eye-Shape Registration and Gaze Estimation . In Proceedings of the IEEE International Conference on Computer Vision. 3756--3764 . E. Wood, T. Baltru\u0161aitis, X. Zhang, Y. Sugano, P. Robinson, and A. Bulling. 2015. Rendering of Eyes for Eye-Shape Registration and Gaze Estimation. In Proceedings of the IEEE International Conference on Computer Vision. 3756--3764."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2017.296"}],"event":{"name":"ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Virtual Event Netherlands","acronym":"ICMI '20","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2020 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3418832","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3382507.3418832","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3382507.3418832","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:27Z","timestamp":1750199907000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3418832"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,21]]},"references-count":25,"alternative-id":["10.1145\/3382507.3418832","10.1145\/3382507"],"URL":"https:\/\/doi.org\/10.1145\/3382507.3418832","relation":{},"subject":[],"published":{"date-parts":[[2020,10,21]]},"assertion":[{"value":"2020-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}