{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T04:33:35Z","timestamp":1787027615353,"version":"build-2736575974"},"reference-count":54,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T00:00:00Z","timestamp":1644537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["1R01HL118181"],"award-info":[{"award-number":["1R01HL118181"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Bioengineering"],"abstract":"<jats:p>In this work, we describe a new method to detect periods of eating by tracking wrist motion during everyday life. Eating uses hand-to-mouth gestures for ingestion, each of which lasts a few seconds. Previous works have detected these gestures individually and then aggregated them to identify meals. The novelty of our approach is that we analyze a much longer window (0.5\u201315 min) using a convolutional neural network. Longer windows can contain other gestures related to eating, such as cutting or manipulating food, preparing foods for consumption, and resting between ingestion events. The context of these other gestures can improve the detection of periods of eating. We test our methods on the public Clemson all-day dataset, which consists of 354 recordings containing 1063 eating episodes. We found that accuracy at detecting eating increased by 15% in \u22654 min windows compared to \u226415 s windows. Using a 6 min window, we detected 89% of eating episodes, with 1.7 false positives for every true positive (FP\/TP). These are the best results achieved to date on this dataset.<\/jats:p>","DOI":"10.3390\/bioengineering9020070","type":"journal-article","created":{"date-parts":[[2022,2,13]],"date-time":"2022-02-13T20:32:30Z","timestamp":1644784350000},"page":"70","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Top-Down Detection of Eating Episodes by Analyzing Large Windows of Wrist Motion Using a Convolutional Neural Network"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7214-587X","authenticated-orcid":false,"given":"Surya","family":"Sharma","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, Clemson University, Clemson, SC 29634, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2965-6524","authenticated-orcid":false,"given":"Adam","family":"Hoover","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Clemson University, Clemson, SC 29634, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.jada.2010.10.008","article-title":"Self-monitoring in weight loss: A systematic review of the literature","volume":"111","author":"Burke","year":"2011","journal-title":"J. Am. Diet. Assoc."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1002\/j.1550-8528.1998.tb00340.x","article-title":"Further support for consistent self-monitoring as a vital component of successful weight control","volume":"6","author":"Boutelle","year":"1998","journal-title":"Obes. Res."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Cordeiro, F., Epstein, D.A., Thomaz, E., Bales, E., Jagannathan, A.K., Abowd, G.D., and Fogarty, J. (2015, January 18\u201323). Barriers and negative nudges: Exploring challenges in food journaling. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Korea.","DOI":"10.1145\/2702123.2702155"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1177\/014107680609900517","article-title":"Trends in national and state-level obesity in the USA after correction for self-report bias: Analysis of health surveys","volume":"99","author":"Ezzati","year":"2006","journal-title":"J. R. Soc. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e109","DOI":"10.2196\/jmir.3084","article-title":"Factors related to sustained use of a free mobile app for dietary self-monitoring with photography and peer feedback: Retrospective cohort study","volume":"16","author":"Helander","year":"2014","journal-title":"J. Med. Internet Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/2049-3258-72-28","article-title":"Smart Wearable Body Sensors for Patient Self-assessment and Monitoring","volume":"72","author":"Appelboom","year":"2014","journal-title":"Arch. Public Health"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Vu, T., Lin, F., Alshurafa, N., and Xu, W. (2017). Wearable food intake monitoring technologies: A comprehensive review. Computers, 6.","DOI":"10.3390\/computers6010004"},{"key":"ref_8","unstructured":"Dong, B., Biswas, S., Gernhardt, R., and Schlemminger, J. (October, January 30). A mobile food intake monitoring system based on breathing signal analysis. Proceedings of the 8th International Conference on Body Area Networks, Boston, MA, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3909","DOI":"10.1109\/JSEN.2015.2402652","article-title":"Recognition of nutrition intake using time-frequency decomposition in a wearable necklace using a piezoelectric sensor","volume":"15","author":"Alshurafa","year":"2015","journal-title":"IEEE Sens. J."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, R., and Amft, O. (2018, January 4\u20137). Free-living eating event spotting using EMG-monitoring eyeglasses. Proceedings of the 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Las Vegas, NV, USA.","DOI":"10.1109\/BHI.2018.8333386"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1109\/JBHI.2013.2282471","article-title":"Detecting periods of eating during free-living by tracking wrist motion","volume":"18","author":"Dong","year":"2014","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1088\/0967-3334\/29\/5\/001","article-title":"Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior","volume":"29","author":"Sazonov","year":"2008","journal-title":"Physiol. Meas."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.artmed.2007.11.007","article-title":"Recognition of dietary activity events using on-body sensors","volume":"42","author":"Amft","year":"2008","journal-title":"Artif. Intell. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1145\/3130902","article-title":"EarBit: Using wearable sensors to detect eating episodes in unconstrained environments","volume":"1","author":"Bedri","year":"2017","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1145\/3191736","article-title":"Detecting Eating Episodes by Tracking Jawbone Movements with a Non-Contact Wearable Sensor","volume":"2","author":"Chun","year":"2018","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_16","first-page":"1","article-title":"NeckSense: A Multi-Sensor Necklace for Detecting Eating Activities in Free-Living Conditions","volume":"37","author":"Zhang","year":"2020","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1145\/3264902","article-title":"Auracle: Detecting eating episodes with an ear-mounted sensor","volume":"2","author":"Bi","year":"2018","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Farooq, M., and Sazonov, E. (2016). A novel wearable device for food intake and physical activity recognition. Sensors, 16.","DOI":"10.3390\/s16071067"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1109\/JBHI.2020.2995473","article-title":"Automatic Ingestion Monitor Version 2\u2014A Novel Wearable Device for Automatic Food Intake Detection and Passive Capture of Food Images","volume":"25","author":"Doulah","year":"2020","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Muth, E.R., and Hoover, A. (2017). Designing Mobile Health Technologies for Self-Monitoring: The Bite Counter as a Case Study. Mobile Health, Springer.","DOI":"10.1007\/978-3-319-51394-2_6"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Schiboni, G., and Amft, O. (2018, January 8\u201312). Sparse natural gesture spotting in free living to monitor drinking with wrist-worn inertial sensors. Proceedings of the 2018 ACM International Symposium on Wearable Computers, Singapore.","DOI":"10.1145\/3267242.3267253"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2325","DOI":"10.1109\/JBHI.2019.2892011","article-title":"Modeling Wrist Micromovements to Measure In-Meal Eating Behavior from Inertial Sensor Data","volume":"23","author":"Kyritsis","year":"2019","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/JBHI.2020.2984907","article-title":"A Data Driven End-to-end Approach for In-the-wild Monitoring of Eating Behavior Using Smartwatches","volume":"25","author":"Kyritsis","year":"2020","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.compbiomed.2015.07.013","article-title":"Audio-based detection and evaluation of eating behavior using the smartwatch platform","volume":"65","author":"Kalantarian","year":"2015","journal-title":"Comput. Biol. Med."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1109\/MPRV.2017.1","article-title":"A survey of diet monitoring technology","volume":"16","author":"Kalantarian","year":"2017","journal-title":"IEEE Pervasive Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"8914","DOI":"10.1109\/ACCESS.2016.2624938","article-title":"A perspective on deep imaging","volume":"4","author":"Wang","year":"2016","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","article-title":"A guide to deep learning in healthcare","volume":"25","author":"Esteva","year":"2019","journal-title":"Nat. Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4507","DOI":"10.1007\/s11063-021-10611-w","article-title":"Time Analysis in Human Activity Recognition","volume":"53","year":"2021","journal-title":"Neural Process. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Heydarian, H., Adam, M., Burrows, T., Collins, C., and Rollo, M.E. (2019). Assessing eating behaviour using upper limb mounted motion sensors: A systematic review. Nutrients, 11.","DOI":"10.3390\/nu11051168"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1772","DOI":"10.1109\/TBME.2014.2306773","article-title":"Automatic ingestion monitor: A novel wearable device for monitoring of ingestive behavior","volume":"61","author":"Fontana","year":"2014","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Gao, Y., Zhang, N., Wang, H., Ding, X., Ye, X., Chen, G., and Cao, Y. (2016, January 27\u201329). iHear food: Eating detection using commodity bluetooth headsets. Proceedings of the 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE), Washington, DC, USA.","DOI":"10.1109\/CHASE.2016.14"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1145\/3131894","article-title":"Recognizing eating from body-worn sensors: Combining free-living and laboratory data","volume":"1","author":"Mirtchouk","year":"2017","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1109\/JBHI.2014.2329137","article-title":"Improving the recognition of eating gestures using intergesture sequential dependencies","volume":"19","author":"Muth","year":"2015","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1109\/JBHI.2016.2612580","article-title":"Assessing the accuracy of a wrist motion tracking method for counting bites across demographic and food variables","volume":"21","author":"Shen","year":"2017","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3407623","article-title":"The impact of walking and resting on wrist motion for automated detection of meals","volume":"1","author":"Sharma","year":"2020","journal-title":"ACM Trans. Comput. Healthc."},{"key":"ref_36","unstructured":"Davies, E.R. (2012). Computer and Machine Vision: Theory, Algorithms, Practicalities, Academic Press."},{"key":"ref_37","unstructured":"Nair, V., and Hinton, G.E. (2021, December 10). Rectified Linear Units Improve Restricted Boltzmann Machines. Available online: https:\/\/www.cs.toronto.edu\/~fritz\/absps\/reluICML.pdf."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Han, J., and Moraga, C. (1995, January 7\u20139). The influence of the sigmoid function parameters on the speed of backpropagation learning. Proceedings of the International Workshop on Artificial Neural Networks, Torremolinos, Spain.","DOI":"10.1007\/3-540-59497-3_175"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1111\/j.1467-9868.2007.00607.x","article-title":"L1-regularization path algorithm for generalized linear models","volume":"69","author":"Park","year":"2007","journal-title":"J. R. Stat. Soc. Ser."},{"key":"ref_40","unstructured":"Chollet, F. (2021, December 10). Keras. Available online: https:\/\/github.com\/keras-team\/keras."},{"key":"ref_41","unstructured":"Nielsen, M.A. (2015). Neural Networks and Deep Learning, Determination Press."},{"key":"ref_42","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_43","unstructured":"Dong, Y. (2012). Tracking Wrist Motion to Detect and Measure the Eating Intake of Free-Living Humans, Clemson University."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1038\/s41746-020-0246-2","article-title":"Automatic, wearable-based, in-field eating detection approaches for public health research: A scoping review","volume":"3","author":"Bell","year":"2020","journal-title":"NPJ Digit. Med."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Sharma, S., and Hoover, A. (2020, January 16\u201319). The Challenge of Metrics in Automated Dietary Monitoring as Analysis Transitions from Small Data to Big Data. Proceedings of the 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Seoul, Korea.","DOI":"10.1109\/BIBM49941.2020.9313465"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Breznitz, S. (2013). Cry Wolf: The Psychology of False Alarms, Psychology Press.","DOI":"10.4324\/9780203781203"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1109\/TSMCA.2004.836781","article-title":"Organizational-historical analysis of the \u201cfailure to respond to alarm\u201d problems","volume":"34","author":"Xiao","year":"2004","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Humans"},{"key":"ref_48","unstructured":"Scikit Learn (2021, December 12). Scikit Learn Kfold Model Selection Documentation. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.model_selection.KFold.html."},{"key":"ref_49","unstructured":"Brownlee, J. (2016). Deep Learning with Python: Develop Deep Learning Models on Theano and Tensor Flow Using Keras, Machine Learning Mastery."},{"key":"ref_50","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_51","first-page":"281","article-title":"Random search for hyper-parameter optimization","volume":"13","author":"Bergstra","year":"2012","journal-title":"J. Mach. Learn. Res."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Thomaz, E., Essa, I., and Abowd, G.D. (2015, January 7\u201311). A practical approach for recognizing eating moments with wrist-mounted inertial sensing. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Osaka, Japan.","DOI":"10.1145\/2750858.2807545"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Zhang, S., Alharbi, R., Nicholson, M., and Alshurafa, N. (2017, January 11\u201315). When generalized eating detection machine learning models fail in the field. Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Maui, HI, USA.","DOI":"10.1145\/3123024.3124409"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"2010","DOI":"10.1016\/j.patcog.2007.11.016","article-title":"Gesture spotting with body-worn inertial sensors to detect user activities","volume":"41","author":"Junker","year":"2008","journal-title":"Pattern Recognit."}],"container-title":["Bioengineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5354\/9\/2\/70\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:17:50Z","timestamp":1760134670000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5354\/9\/2\/70"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,11]]},"references-count":54,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["bioengineering9020070"],"URL":"https:\/\/doi.org\/10.3390\/bioengineering9020070","relation":{},"ISSN":["2306-5354"],"issn-type":[{"value":"2306-5354","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,11]]}}}