{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T17:43:20Z","timestamp":1772905400617,"version":"3.50.1"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"MHCI","license":[{"start":{"date-parts":[[2022,9,19]],"date-time":"2022-09-19T00:00:00Z","timestamp":1663545600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,9,19]]},"abstract":"<jats:p>In this paper, we present EatingTrak, an AI-powered sensing system using a wrist-mounted inertial measurement unit (IMU) to recognize eating moments in a near-free-living semi-wild setup. It significantly improves the SOTA in time resolution using similar hardware on identifying eating moments, from over five minutes to three seconds. Different from prior work which directly learns from raw IMU data, it proposes intelligent algorithms which can estimate the arm posture in 3D in the wild and then learns the detailed eating moments from the series of estimated arm postures. To evaluate the system, we collected eating activity data from 9 participants in semi-wild scenarios for over 113 hours. Results showed that it was able to recognize eating moments at three time-resolutions: 3 seconds and 15 minutes with F-1 scores of 73.7% and 83.8%, respectively. EatingTrak would introduce new opportunities in sensing detailed eating behavior information requiring high time resolution, such as eating frequency, snack-taking, on-site behavior intervention. We also discuss the opportunities and challenges in deploying EatingTrak on commodity devices at scale.<\/jats:p>","DOI":"10.1145\/3546749","type":"journal-article","created":{"date-parts":[[2022,9,20]],"date-time":"2022-09-20T23:14:30Z","timestamp":1663715670000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["EatingTrak"],"prefix":"10.1145","volume":"6","author":[{"given":"Ruidong","family":"Zhang","sequence":"first","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jihai","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nitish","family":"Gade","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peng","family":"Cao","sequence":"additional","affiliation":[{"name":"MIT, Cambridge, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seyun","family":"Kim","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junchi","family":"Yan","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,9,20]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298751"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2005.17"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/11551201_4"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206754"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376869"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130902"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818346.2820767"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2802083.2808411"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264902"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2015.2469095"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46454-1_34"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.143"},{"key":"e_1_2_1_13_1","unstructured":"Xianjie Chen and Alan L Yuille. 2014. Articulated pose estimation by a graphical model with image dependent pairwise relations. In Advances in neural information processing systems. 1736--1744.  Xianjie Chen and Alan L Yuille. 2014. Articulated pose estimation by a graphical model with image dependent pairwise relations. In Advances in neural information processing systems. 1736--1744."},{"key":"e_1_2_1_14_1","volume-title":"Won Gu Lee, and Hyunwoo Bang","author":"Chung Jungman","year":"2017","unstructured":"Jungman Chung , Jungmin Chung , Wonjun Oh , Yongkyu Yoo , Won Gu Lee, and Hyunwoo Bang . 2017 . A glasses-type wearable device for monitoring the patterns of food intake and facial activity. Scientific reports 7, 1 (2017), 1--8. Jungman Chung, Jungmin Chung, Wonjun Oh, Yongkyu Yoo, Won Gu Lee, and Hyunwoo Bang. 2017. A glasses-type wearable device for monitoring the patterns of food intake and facial activity. Scientific reports 7, 1 (2017), 1--8."},{"key":"e_1_2_1_15_1","volume-title":"A human activity recognition system using skeleton data from RGBD sensors. Computational intelligence and neuroscience 2016","author":"Cippitelli Enea","year":"2016","unstructured":"Enea Cippitelli , Samuele Gasparrini , Ennio Gambi , and Susanna Spinsante . 2016. A human activity recognition system using skeleton data from RGBD sensors. Computational intelligence and neuroscience 2016 ( 2016 ). Enea Cippitelli, Samuele Gasparrini, Ennio Gambi, and Susanna Spinsante. 2016. A human activity recognition system using skeleton data from RGBD sensors. Computational intelligence and neuroscience 2016 (2016)."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702155"},{"key":"e_1_2_1_17_1","volume-title":"Detecting periods of eating during free-living by tracking wrist motion","author":"Dong Yujie","year":"2013","unstructured":"Yujie Dong , Jenna Scisco , Mike Wilson , Eric Muth , and Adam Hoover . 2013. Detecting periods of eating during free-living by tracking wrist motion . IEEE journal of biomedical and health informatics 18, 4 ( 2013 ), 1253--1260. Yujie Dong, Jenna Scisco, Mike Wilson, Eric Muth, and Adam Hoover. 2013. Detecting periods of eating during free-living by tracking wrist motion. IEEE journal of biomedical and health informatics 18, 4 (2013), 1253--1260."},{"key":"e_1_2_1_18_1","volume-title":"Segmentation and characterization of chewing bouts by monitoring temporalis muscle using smart glasses with piezoelectric sensor","author":"Farooq Muhammad","year":"2016","unstructured":"Muhammad Farooq and Edward Sazonov . 2016. Segmentation and characterization of chewing bouts by monitoring temporalis muscle using smart glasses with piezoelectric sensor . IEEE journal of biomedical and health informatics 21, 6 ( 2016 ), 1495--1503. Muhammad Farooq and Edward Sazonov. 2016. Segmentation and characterization of chewing bouts by monitoring temporalis muscle using smart glasses with piezoelectric sensor. IEEE journal of biomedical and health informatics 21, 6 (2016), 1495--1503."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-019-00619-1"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.3390\/s17061257"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.322"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3272127.3275108","article-title":"Deep inertial poser: learning to reconstruct human pose from sparse inertial measurements in real time","volume":"37","author":"Huang Yinghao","year":"2018","unstructured":"Yinghao Huang , Manuel Kaufmann , Emre Aksan , Michael J Black , Otmar Hilliges , and Gerard Pons-Moll . 2018 . Deep inertial poser: learning to reconstruct human pose from sparse inertial measurements in real time . ACM Transactions on Graphics (TOG) 37 , 6 (2018), 1 -- 15 . Yinghao Huang, Manuel Kaufmann, Emre Aksan, Michael J Black, Otmar Hilliges, and Gerard Pons-Moll. 2018. Deep inertial poser: learning to reconstruct human pose from sparse inertial measurements in real time. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1--15.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2007.11.016"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2018.8513627"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2019.2892011"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307334.3326109"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData50022.2020.9378382"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2018.00024"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073596"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131894"},{"key":"e_1_2_1_31_1","volume-title":"Machine Learning for Healthcare Conference. 641--662","author":"Mirtchouk Mark","year":"2019","unstructured":"Mark Mirtchouk , Dana L McGuire , Andrea L Deierlein , and Samantha Kleinberg . 2019 . Automated estimation of food type from body-worn audio and motion sensors in free-living environments . In Machine Learning for Healthcare Conference. 641--662 . Mark Mirtchouk, Dana L McGuire, Andrea L Deierlein, and Samantha Kleinberg. 2019. Automated estimation of food type from body-worn audio and motion sensors in free-living environments. In Machine Learning for Healthcare Conference. 641--662."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971677"},{"key":"e_1_2_1_33_1","volume-title":"Richard Li, Koustuv Saha, Leah Galante Roper, Lama Nachman, Hong Lu, Lucia Mirabella, Sanjeev Srivastava, Munmun De Choudhury, et al.","author":"Morshed Mehrab Bin","year":"2020","unstructured":"Mehrab Bin Morshed , Samruddhi Shreeram Kulkarni , Richard Li, Koustuv Saha, Leah Galante Roper, Lama Nachman, Hong Lu, Lucia Mirabella, Sanjeev Srivastava, Munmun De Choudhury, et al. 2020 . A Real-Time Eating Detection System for Capturing Eating Moments and Triggering Ecological Momentary Assessments to Obtain Further Context: System Development and Validation Study. JMIR mHealth and uHealth 8, 12 (2020), e20625. Mehrab Bin Morshed, Samruddhi Shreeram Kulkarni, Richard Li, Koustuv Saha, Leah Galante Roper, Lama Nachman, Hong Lu, Lucia Mirabella, Sanjeev Srivastava, Munmun De Choudhury, et al. 2020. A Real-Time Eating Detection System for Capturing Eating Moments and Triggering Ecological Momentary Assessments to Obtain Further Context: System Development and Validation Study. JMIR mHealth and uHealth 8, 12 (2020), e20625."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.3945\/jn.115.219808"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_29"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.10.033"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIEA.2013.6566433"},{"key":"e_1_2_1_38_1","volume-title":"2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth). IEEE, 108--111","author":"Rahman Shah Atiqur","year":"2015","unstructured":"Shah Atiqur Rahman , Christopher Merck , Yuxiao Huang , and Samantha Kleinberg . 2015 . Unintrusive eating recogni- tion using Google Glass . In 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth). IEEE, 108--111 . Shah Atiqur Rahman, Christopher Merck, Yuxiao Huang, and Samantha Kleinberg. 2015. Unintrusive eating recogni- tion using Google Glass. In 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth). IEEE, 108--111."},{"key":"e_1_2_1_39_1","volume-title":"Improving the recognition of eating gestures using intergesture sequential dependencies","author":"Ramos-Garcia Raul I","year":"2014","unstructured":"Raul I Ramos-Garcia , Eric R Muth , John N Gowdy , and Adam W Hoover . 2014. Improving the recognition of eating gestures using intergesture sequential dependencies . IEEE journal of biomedical and health informatics 19, 3 ( 2014 ), 825--831. Raul I Ramos-Garcia, Eric R Muth, John N Gowdy, and Adam W Hoover. 2014. Improving the recognition of eating gestures using intergesture sequential dependencies. IEEE journal of biomedical and health informatics 19, 3 (2014), 825--831."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jand.2013.09.017"},{"key":"e_1_2_1_41_1","volume-title":"Automatic Detection of Periods of Eating Using Wrist Motion Tracking. In 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE)","author":"Sharma Surya","unstructured":"Surya Sharma , Phillip Jasper , Eric Muth , and Adam Hoover . 2016. Automatic Detection of Periods of Eating Using Wrist Motion Tracking. In 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE) . IEEE , 362--363. Surya Sharma, Phillip Jasper, Eric Muth, and Adam Hoover. 2016. Automatic Detection of Periods of Eating Using Wrist Motion Tracking. In 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE). IEEE, 362--363."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3407623"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2906388.2906407"},{"key":"e_1_2_1_44_1","volume-title":"The Impact of Quantity of Training Data on Recognition of Eating Gestures. arXiv preprint arXiv:1812.04513","author":"Shen Yiru","year":"2018","unstructured":"Yiru Shen , Eric Muth , and Adam Hoover . 2018. The Impact of Quantity of Training Data on Recognition of Eating Gestures. arXiv preprint arXiv:1812.04513 ( 2018 ). Yiru Shen, Eric Muth, and Adam Hoover. 2018. The Impact of Quantity of Training Data on Recognition of Eating Gestures. arXiv preprint arXiv:1812.04513 (2018)."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1964921.1964926"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21051902"},{"key":"e_1_2_1_47_1","volume-title":"Fusing 2d uncertainty and 3d cues for monocular body pose estimation. arXiv preprint arXiv:1611.05708 2, 3","author":"Tekin Bugra","year":"2016","unstructured":"Bugra Tekin , Pablo M\u00e1rquez-Neila , Mathieu Salzmann , and Pascal Fua . 2016. Fusing 2d uncertainty and 3d cues for monocular body pose estimation. arXiv preprint arXiv:1611.05708 2, 3 ( 2016 ). Bugra Tekin, Pablo M\u00e1rquez-Neila, Mathieu Salzmann, and Pascal Fua. 2016. Fusing 2d uncertainty and 3d cues for monocular body pose estimation. arXiv preprint arXiv:1611.05708 2, 3 (2016)."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807545"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2526667.2526672"},{"key":"e_1_2_1_50_1","unstructured":"Jonathan J Tompson Arjun Jain Yann LeCun and Christoph Bregler. 2014. Joint training of a convolutional network and a graphical model for human pose estimation. In Advances in neural information processing systems. 1799--1807.  Jonathan J Tompson Arjun Jain Yann LeCun and Christoph Bregler. 2014. Joint training of a convolutional network and a graphical model for human pose estimation. In Advances in neural information processing systems. 1799--1807."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.214"},{"key":"e_1_2_1_52_1","volume-title":"Computer Graphics Forum","author":"von Marcard Timo","unstructured":"Timo von Marcard , Bodo Rosenhahn , Michael J Black , and Gerard Pons-Moll . 2017. Sparse inertial poser: Automatic 3d human pose estimation from sparse imus . In Computer Graphics Forum , Vol. 36 . Wiley Online Library , 349--360. Timo von Marcard, Bodo Rosenhahn, Michael J Black, and Gerard Pons-Moll. 2017. Sparse inertial poser: Automatic 3d human pose estimation from sparse imus. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 349--360."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.511"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/BSN51625.2021.9507012"},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Liguang Xie Mithilesh Kumar Yong Cao Denis Gracanin and Francis Quek. 2008. Data-driven motion estimation with low-cost sensors. (2008).  Liguang Xie Mithilesh Kumar Yong Cao Denis Gracanin and Francis Quek. 2008. Data-driven motion estimation with low-cost sensors. (2008).","DOI":"10.1049\/cp:20080384"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370216.2370269"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/1060044.1060046"},{"key":"e_1_2_1_58_1","volume-title":"Monitoring chewing and eating in free-living using smart eyeglasses","author":"Zhang Rui","year":"2017","unstructured":"Rui Zhang and Oliver Amft . 2017. Monitoring chewing and eating in free-living using smart eyeglasses . IEEE journal of biomedical and health informatics 22, 1 ( 2017 ), 23--32. Rui Zhang and Oliver Amft. 2017. Monitoring chewing and eating in free-living using smart eyeglasses. IEEE journal of biomedical and health informatics 22, 1 (2017), 23--32."},{"key":"e_1_2_1_59_1","volume-title":"2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI). IEEE, 128--132","author":"Oliver Amft Rui Zhang","year":"2018","unstructured":"Rui Zhang anid Oliver Amft . 2018 . Free-living eating event spotting using EMG-monitoring eyeglasses . In 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI). IEEE, 128--132 . Rui Zhang anid Oliver Amft. 2018. Free-living eating event spotting using EMG-monitoring eyeglasses. In 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI). IEEE, 128--132."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20020557"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/BSN.2016.7516224"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123024.3124409"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2017.08.003"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415213"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.537"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3546749","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3546749","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:40Z","timestamp":1750186840000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3546749"}},"subtitle":["Detecting Fine-grained Eating Moments in the Wild Using a Wrist-mounted IMU"],"short-title":[],"issued":{"date-parts":[[2022,9,19]]},"references-count":65,"journal-issue":{"issue":"MHCI","published-print":{"date-parts":[[2022,9,19]]}},"alternative-id":["10.1145\/3546749"],"URL":"https:\/\/doi.org\/10.1145\/3546749","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,19]]},"assertion":[{"value":"2022-09-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}