{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T18:15:28Z","timestamp":1771611328816,"version":"3.50.1"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,7,15]],"date-time":"2021-07-15T00:00:00Z","timestamp":1626307200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["1657262"],"award-info":[{"award-number":["1657262"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Healthcare"],"published-print":{"date-parts":[[2021,7,31]]},"abstract":"<jats:p>Advances in image-based dietary assessment methods have allowed nutrition professionals and researchers to improve the accuracy of dietary assessment, where images of food consumed are captured using smartphones or wearable devices. These images are then analyzed using computer vision methods to estimate energy and nutrition content of the foods. Food image segmentation, which determines the regions in an image where foods are located, plays an important role in this process. Current methods are data dependent and thus cannot generalize well for different food types. To address this problem, we propose a class-agnostic food image segmentation method. Our method uses a pair of eating scene images, one before starting eating and one after eating is completed. Using information from both the before and after eating images, we can segment food images by finding the salient missing objects without any prior information about the food class. We model a paradigm of top-down saliency that guides the attention of the human visual system based on a task to find the salient missing objects in a pair of images. Our method is validated on food images collected from a dietary study that showed promising results.<\/jats:p>","DOI":"10.1145\/3440274","type":"journal-article","created":{"date-parts":[[2021,7,15]],"date-time":"2021-07-15T10:09:26Z","timestamp":1626343766000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Saliency-Aware Class-Agnostic Food Image Segmentation"],"prefix":"10.1145","volume":"2","author":[{"given":"Sri Kalyan","family":"Yarlagadda","sequence":"first","affiliation":[{"name":"Purdue University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel Mas","family":"Montserrat","sequence":"additional","affiliation":[{"name":"Purdue University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"G\u00fcera","sequence":"additional","affiliation":[{"name":"Purdue University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carol J.","family":"Boushey","sequence":"additional","affiliation":[{"name":"University of Hawaii Cancer Center"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Deborah A.","family":"Kerr","sequence":"additional","affiliation":[{"name":"Curtin University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fengqing","family":"Zhu","sequence":"additional","affiliation":[{"name":"Purdue University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,7,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2015.39"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tcs.2015.06.048"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.1995.7.1.66"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2015.2487833"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.89"},{"key":"e_1_2_1_6_1","first-page":"1","article-title":"Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study","volume":"22","author":"Borji Ali","year":"2013","unstructured":"Ali Borji , Dicky N. Sihite , and Laurent Itti . 2013 . Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study . IEEE Transactions on Image Processing 22 , 1 (Jan. 2013), 55\u201369. https:\/\/doi.org\/10.1109\/TIP.2012.2210727 10.1109\/TIP.2012.2210727 Ali Borji, Dicky N. Sihite, and Laurent Itti. 2013. Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study. IEEE Transactions on Image Processing 22, 1 (Jan. 2013), 55\u201369. https:\/\/doi.org\/10.1109\/TIP.2012.2210727","journal-title":"IEEE Transactions on Image Processing"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 2014 European Conference on Computer Vision. 446\u2013461","author":"Bossard Lukas","year":"2014","unstructured":"Lukas Bossard , Matthieu Guillaumin , and Luc Van Gool . 2014 . Food-101\u2014Mining discriminative components with random forests . In Proceedings of the 2014 European Conference on Computer Vision. 446\u2013461 . https:\/\/doi.org\/10.1007\/978-3-319-10599-4_29 10.1007\/978-3-319-10599-4_29 Lukas Bossard, Matthieu Guillaumin, and Luc Van Gool. 2014. Food-101\u2014Mining discriminative components with random forests. In Proceedings of the 2014 European Conference on Computer Vision. 446\u2013461. https:\/\/doi.org\/10.1007\/978-3-319-10599-4_29"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the 2015 IEEE International Conference on Computer Vision. 2956\u20132964","author":"Cao Chunshui","year":"2015","unstructured":"Chunshui Cao , Xianming Liu , Yi Yang , Yinan Yu , Jiang Wang , Zilei Wang , Yongzhen Huang , et\u00a0al. 2015 . Look and think twice: Capturing top-down visual attention with feedback convolutional neural networks . In Proceedings of the 2015 IEEE International Conference on Computer Vision. 2956\u20132964 . https:\/\/doi.org\/10.1109\/ICCV.2015.338 10.1109\/ICCV.2015.338 Chunshui Cao, Xianming Liu, Yi Yang, Yinan Yu, Jiang Wang, Zilei Wang, Yongzhen Huang, et\u00a0al. 2015. Look and think twice: Capturing top-down visual attention with feedback convolutional neural networks. In Proceedings of the 2015 IEEE International Conference on Computer Vision. 2956\u20132964. https:\/\/doi.org\/10.1109\/ICCV.2015.338"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1088\/0957-0233\/26\/2\/025702"},{"key":"e_1_2_1_10_1","first-page":"2","article-title":"Novel technologies for assessing dietary intake: Evaluating the usability of a mobile telephone food record among adults and adolescents","volume":"14","author":"Daugherty Bethany L.","year":"2012","unstructured":"Bethany L. Daugherty , TusaRebecca E. Schap , Reynolette Ettienne-Gittens , Fengqing M. Zhu , Marc Bosch , Edward J. Delp , David S. Ebert , Deborah A. Kerr , and Carol J. Boushey . 2012 . Novel technologies for assessing dietary intake: Evaluating the usability of a mobile telephone food record among adults and adolescents . Journal of Medical Internet Research 14 , 2 (April 2012), e58. https:\/\/doi.org\/10.2196\/jmir.1967 10.2196\/jmir.1967 Bethany L. Daugherty, TusaRebecca E. Schap, Reynolette Ettienne-Gittens, Fengqing M. Zhu, Marc Bosch, Edward J. Delp, David S. Ebert, Deborah A. Kerr, and Carol J. Boushey. 2012. Novel technologies for assessing dietary intake: Evaluating the usability of a mobile telephone food record among adults and adolescents. Journal of Medical Internet Research 14, 2 (April 2012), e58. https:\/\/doi.org\/10.2196\/jmir.1967","journal-title":"Journal of Medical Internet Research"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2986035.2986047"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 2018 International Joint Conference on Artificial Intelligence. 684\u2013690","author":"Deng Zijun","year":"2018","unstructured":"Zijun Deng , Xiaowei Hu , Lei Zhu , Xuemiao Xu , Jing Qin , Guoqiang Han , and Pheng-Ann Heng . 2018 . R3Net: Recurrent residual refinement network for saliency detection . In Proceedings of the 2018 International Joint Conference on Artificial Intelligence. 684\u2013690 . http:\/\/dl.acm.org\/citation.cfm?id=3304415.3304513 Zijun Deng, Xiaowei Hu, Lei Zhu, Xuemiao Xu, Jing Qin, Guoqiang Han, and Pheng-Ann Heng. 2018. R3Net: Recurrent residual refinement network for saliency detection. In Proceedings of the 2018 International Joint Conference on Artificial Intelligence. 684\u2013690. http:\/\/dl.acm.org\/citation.cfm?id=3304415.3304513"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 31st International Conference on Machine Learning\u2014Volume 32","author":"Donahue Jeff","year":"2014","unstructured":"Jeff Donahue , Yangqing Jia , Oriol Vinyals , Judy Hoffman , Ning Zhang , Eric Tzeng , and Trevor Darrell . 2014 . DeCAF: A deep convolutional activation feature for generic visual recognition . In Proceedings of the 31st International Conference on Machine Learning\u2014Volume 32 . I-647\u2013I-655. Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. 2014. DeCAF: A deep convolutional activation feature for generic visual recognition. In Proceedings of the 31st International Conference on Machine Learning\u2014Volume 32. I-647\u2013I-655."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 2015 IEEE International Symposium on Multimedia. 385\u2013390","author":"Fang Shaobo","year":"2015","unstructured":"Shaobo Fang , Chang Liu , Fengqing Zhu , Edward J. Delp , and Carol J. Boushey . 2015. Single-view food portion estimation based on geometric models . In Proceedings of the 2015 IEEE International Symposium on Multimedia. 385\u2013390 . https:\/\/doi.org\/10.1109\/ISM. 2015 .67 10.1109\/ISM.2015.67 Shaobo Fang, Chang Liu, Fengqing Zhu, Edward J. Delp, and Carol J. Boushey. 2015. Single-view food portion estimation based on geometric models. In Proceedings of the 2015 IEEE International Symposium on Multimedia. 385\u2013390. https:\/\/doi.org\/10.1109\/ISM.2015.67"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP\u201918)","author":"Fang S.","year":"2018","unstructured":"S. Fang , Z. Shao , R. Mao , C. Fu , E. J. Delp , F. Zhu , D. A. Kerr , and C. J. Boushey . 2018. Single-view food portion estimation: Learning image-to-energy mappings using generative adversarial networks . In Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP\u201918) . 251\u2013255. https:\/\/doi.org\/10.1109\/ICIP. 2018 .8451461 10.1109\/ICIP.2018.8451461 S. Fang, Z. Shao, R. Mao, C. Fu, E. J. Delp, F. Zhu, D. A. Kerr, and C. J. Boushey. 2018. Single-view food portion estimation: Learning image-to-energy mappings using generative adversarial networks. In Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP\u201918). 251\u2013255. https:\/\/doi.org\/10.1109\/ICIP.2018.8451461"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 2017 IEEE Global Conference on Signal and Information Processing. 462\u2013466","author":"Fang Shaobo","year":"2017","unstructured":"Shaobo Fang , Fengqing Zhu , Carol J. Boushey , and Edward J. Delp . 2017. The use of co-occurrence patterns in single image based food portion estimation . In Proceedings of the 2017 IEEE Global Conference on Signal and Information Processing. 462\u2013466 . https:\/\/doi.org\/10.1109\/GlobalSIP. 2017 .8308685 10.1109\/GlobalSIP.2017.8308685 Shaobo Fang, Fengqing Zhu, Carol J. Boushey, and Edward J. Delp. 2017. The use of co-occurrence patterns in single image based food portion estimation. In Proceedings of the 2017 IEEE Global Conference on Signal and Information Processing. 462\u2013466. https:\/\/doi.org\/10.1109\/GlobalSIP.2017.8308685"},{"key":"e_1_2_1_18_1","first-page":"5","article-title":"The fast food and obesity link: Consumption patterns and severity of obesity","volume":"22","author":"Ginny Garcia","year":"2012","unstructured":"Garcia Ginny , Thankam S. Sunil , and Pedro Hinojosa . 2012 . The fast food and obesity link: Consumption patterns and severity of obesity . Obesity Surgery 22 , 5 (May 2012), 810\u2013818. https:\/\/doi.org\/10.1007\/s11695-012-0601-8 10.1007\/s11695-012-0601-8 Garcia Ginny, Thankam S. Sunil, and Pedro Hinojosa. 2012. The fast food and obesity link: Consumption patterns and severity of obesity. Obesity Surgery 22, 5 (May 2012), 810\u2013818. https:\/\/doi.org\/10.1007\/s11695-012-0601-8","journal-title":"Obesity Surgery"},{"key":"e_1_2_1_19_1","first-page":"6","article-title":"Is frequency of shared family meals related to the nutritional health of children and adolescents","volume":"127","author":"Hammons Amber J.","year":"2011","unstructured":"Amber J. Hammons and Barbara H. Fiese . 2011 . Is frequency of shared family meals related to the nutritional health of children and adolescents ? Pediatrics 127 , 6 (June 2011), e1565\u2013e1574. Amber J. Hammons and Barbara H. Fiese. 2011. Is frequency of shared family meals related to the nutritional health of children and adolescents? Pediatrics 127, 6 (June 2011), e1565\u2013e1574.","journal-title":"Pediatrics"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition.","author":"He Kaiming","year":"2016","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun . 2016 . Deep residual learning for image recognition . In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_1_21_1","series-title":"Lecture Notes in Computer Science","volume-title":"Computer Vision\u2014ECCV 2014 Workshops","author":"Kawano Yoshiyuki","unstructured":"Yoshiyuki Kawano and Keiji Yanai . 2015. Automatic expansion of a food image dataset leveraging existing categories with domain adaptation . In Computer Vision\u2014ECCV 2014 Workshops . Lecture Notes in Computer Science , Vol. 8927 . Springer , 3\u201317. https:\/\/doi.org\/10.1007\/978-3-319-16199-0_1 10.1007\/978-3-319-16199-0_1 Yoshiyuki Kawano and Keiji Yanai. 2015. Automatic expansion of a food image dataset leveraging existing categories with domain adaptation. In Computer Vision\u2014ECCV 2014 Workshops. Lecture Notes in Computer Science, Vol. 8927. Springer, 3\u201317. https:\/\/doi.org\/10.1007\/978-3-319-16199-0_1"},{"key":"e_1_2_1_22_1","first-page":"14","article-title":"FoodCam: A real-time food recognition system on a smartphone","volume":"74","author":"Kawano Yoshiyuki","year":"2015","unstructured":"Yoshiyuki Kawano and Keiji Yanai . 2015 . FoodCam: A real-time food recognition system on a smartphone . Multimedia Tools and Applications 74 , 14 (July 2015), 5263\u20135287. https:\/\/doi.org\/10.1007\/978-3-319-04117-9_38 10.1007\/978-3-319-04117-9_38 Yoshiyuki Kawano and Keiji Yanai. 2015. FoodCam: A real-time food recognition system on a smartphone. Multimedia Tools and Applications 74, 14 (July 2015), 5263\u20135287. https:\/\/doi.org\/10.1007\/978-3-319-04117-9_38","journal-title":"Multimedia Tools and Applications"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12966-016-0376-8"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the 2017 International Joint Conference on Artificial Intelligence. 2008\u20132015","author":"Khan Salman","year":"2017","unstructured":"Salman Khan , Xuming He , Fatih Porikli , Mohammed Bennamoun , Ferdous Sohel , and Roberto Togneri . 2017 . Learning deep structured network for weakly supervised change detection . In Proceedings of the 2017 International Joint Conference on Artificial Intelligence. 2008\u20132015 . http:\/\/dl.acm.org\/citation.cfm?id=3172077.3172167 Salman Khan, Xuming He, Fatih Porikli, Mohammed Bennamoun, Ferdous Sohel, and Roberto Togneri. 2017. Learning deep structured network for weakly supervised change detection. In Proceedings of the 2017 International Joint Conference on Artificial Intelligence. 2008\u20132015. http:\/\/dl.acm.org\/citation.cfm?id=3172077.3172167"},{"key":"e_1_2_1_25_1","first-page":"9","article-title":"Forest change detection in incomplete satellite images with deep neural networks","volume":"55","author":"Khan Salman H.","year":"2017","unstructured":"Salman H. Khan , Xuming He , Fatih Porikli , and Mohammed Bennamoun . 2017 . Forest change detection in incomplete satellite images with deep neural networks . IEEE Transactions on Geoscience and Remote Sensing 55 , 9 (Sept. 2017), 5407\u20135423. https:\/\/doi.org\/10.1109\/TGRS.2017.2707528 10.1109\/TGRS.2017.2707528 Salman H. Khan, Xuming He, Fatih Porikli, and Mohammed Bennamoun. 2017. Forest change detection in incomplete satellite images with deep neural networks. IEEE Transactions on Geoscience and Remote Sensing 55, 9 (Sept. 2017), 5407\u20135423. https:\/\/doi.org\/10.1109\/TGRS.2017.2707528","journal-title":"IEEE Transactions on Geoscience and Remote Sensing"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2011.07.003"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. 5455\u20135463","author":"Li Guanbin","year":"2015","unstructured":"Guanbin Li and Yizhou Yu . 2015 . Visual saliency based on multiscale deep features . In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. 5455\u20135463 . https:\/\/doi.org\/10.1109\/CVPR.2015.7299184 10.1109\/CVPR.2015.7299184 Guanbin Li and Yizhou Yu. 2015. Visual saliency based on multiscale deep features. In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. 5455\u20135463. https:\/\/doi.org\/10.1109\/CVPR.2015.7299184"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. 6593\u20136601","author":"Luo Zhiming","year":"2017","unstructured":"Zhiming Luo , Akshaya Mishra , Andrew Achka , Justin Eichel , Shaozi Li , and Pierre-Marc Jodoin . 2017 . Non-local deep features for salient object detection . In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. 6593\u20136601 . https:\/\/doi.org\/10.1109\/CVPR.2017.698 10.1109\/CVPR.2017.698 Zhiming Luo, Akshaya Mishra, Andrew Achka, Justin Eichel, Shaozi Li, and Pierre-Marc Jodoin. 2017. Non-local deep features for salient object detection. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. 6593\u20136601. https:\/\/doi.org\/10.1109\/CVPR.2017.698"},{"key":"e_1_2_1_29_1","first-page":"5","article-title":"Learning to detect natural image boundaries using local brightness, color, and texture cues","volume":"26","author":"Martin David R.","year":"2004","unstructured":"David R. Martin , Charless C. Fowlkes , and Jitendra Malik . 2004 . Learning to detect natural image boundaries using local brightness, color, and texture cues . IEEE Transactions on Pattern Analysis and Machine Intelligence 26 , 5 (May 2004), 530\u2013549. https:\/\/doi.org\/10.1109\/TPAMI.2004.1273918 10.1109\/TPAMI.2004.1273918 David R. Martin, Charless C. Fowlkes, and Jitendra Malik. 2004. Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence 26, 5 (May 2004), 530\u2013549. https:\/\/doi.org\/10.1109\/TPAMI.2004.1273918","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2012.157"},{"key":"e_1_2_1_31_1","volume-title":"et\u00a0al","author":"McCrory Megan","year":"2019","unstructured":"Megan McCrory , Mingui Sun , Edward Sazonov , Gary Frost , Alex Anderson , Wenyan Jia , Modou L. Jobarteh , et\u00a0al . 2019 . Methodology for objective, passive, image-and sensor-based assessment of dietary intake, meal-timing, and food-related activity in Ghana and Kenya (P13-028-19). Current Developments in Nutrition 3, Suppl . 1 (2019), nzz036\u2013P13. Megan McCrory, Mingui Sun, Edward Sazonov, Gary Frost, Alex Anderson, Wenyan Jia, Modou L. Jobarteh, et\u00a0al. 2019. Methodology for objective, passive, image-and sensor-based assessment of dietary intake, meal-timing, and food-related activity in Ghana and Kenya (P13-028-19). Current Developments in Nutrition 3, Suppl. 1 (2019), nzz036\u2013P13."},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1111\/j.1467-789X.2011.00936.x","article-title":"Selected eating behaviours and excess body weight: A systematic review","volume":"13","author":"Mesas A. E.","year":"2012","unstructured":"A. E. Mesas , M. Mu\u00f1oz-Pareja , E. L\u00f3pez-Garc\u00eda , and F. Rodr\u00edguez-Artalejo . 2012 . Selected eating behaviours and excess body weight: A systematic review . Obesity Reviews 13 , 2 (Feb. 2012), 106\u2013135. https:\/\/doi.org\/10.1111\/j.1467-789X.2011.00936.x 10.1111\/j.1467-789X.2011.00936.x A. E. Mesas, M. Mu\u00f1oz-Pareja, E. L\u00f3pez-Garc\u00eda, and F. Rodr\u00edguez-Artalejo. 2012. Selected eating behaviours and excess body weight: A systematic review. Obesity Reviews 13, 2 (Feb. 2012), 106\u2013135. https:\/\/doi.org\/10.1111\/j.1467-789X.2011.00936.x","journal-title":"Obesity Reviews"},{"key":"e_1_2_1_33_1","first-page":"4","article-title":"Food and health: Individual, cultural, or scientific matters","volume":"8","author":"Nordstr\u00f6m Karin","year":"2013","unstructured":"Karin Nordstr\u00f6m , Christian Coff , H\u00e5kan J\u00f6nsson , Lennart Nordenfelt , and Ulf G\u00f6rman . 2013 . Food and health: Individual, cultural, or scientific matters ? Genes & Nutrition 8 , 4 (July 2013), 357\u2013363. https:\/\/doi.org\/10.1007\/s12263-013-0336-8 10.1007\/s12263-013-0336-8 Karin Nordstr\u00f6m, Christian Coff, H\u00e5kan J\u00f6nsson, Lennart Nordenfelt, and Ulf G\u00f6rman. 2013. Food and health: Individual, cultural, or scientific matters? Genes & Nutrition 8, 4 (July 2013), 357\u2013363. https:\/\/doi.org\/10.1007\/s12263-013-0336-8","journal-title":"Genes & Nutrition"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 2016 International Workshop on Multimedia Assisted Dietary Management. 63\u201370","author":"Okamoto Koichi","year":"2016","unstructured":"Koichi Okamoto and Keiji Yanai . 2016 . An automatic calorie estimation system of food images on a smartphone . In Proceedings of the 2016 International Workshop on Multimedia Assisted Dietary Management. 63\u201370 . https:\/\/doi.org\/10.1145\/2986035.2986040 10.1145\/2986035.2986040 Koichi Okamoto and Keiji Yanai. 2016. An automatic calorie estimation system of food images on a smartphone. In Proceedings of the 2016 International Workshop on Multimedia Assisted Dietary Management. 63\u201370. https:\/\/doi.org\/10.1145\/2986035.2986040"},{"key":"e_1_2_1_35_1","volume-title":"Global Health Risks Mortality and Burden of Disease Attributable to Selected Major Risks","author":"World Health Organization","unstructured":"World Health Organization . 2009. Global Health Risks Mortality and Burden of Disease Attributable to Selected Major Risks . World Health Organization . https:\/\/apps.who.int\/iris\/handle\/10665\/44203 World Health Organization. 2009. Global Health Risks Mortality and Burden of Disease Attributable to Selected Major Risks. World Health Organization. https:\/\/apps.who.int\/iris\/handle\/10665\/44203"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS\u201917)","author":"Paszke Adam","year":"2017","unstructured":"Adam Paszke , Sam Gross , Soumith Chintala , Gregory Chanan , Edward Yang , Zachary DeVito , Zeming Lin , Alban Desmaison , Luca Antiga , and Adam Lerer . 2017 . Automatic differentiation in PyTorch . In Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS\u201917) . 1\u20134. Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in PyTorch. In Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS\u201917). 1\u20134."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. 733\u2013740","author":"Perazzi Federico","year":"2012","unstructured":"Federico Perazzi , Philipp Krahenbuhl , Yael Pritch , and Alexander Hornung . 2012 . Saliency filters: Contrast based filtering for salient region detection . In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. 733\u2013740 . https:\/\/doi.org\/10.1109\/CVPR.2012.6247743 10.1109\/CVPR.2012.6247743 Federico Perazzi, Philipp Krahenbuhl, Yael Pritch, and Alexander Hornung. 2012. Saliency filters: Contrast based filtering for salient region detection. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. 733\u2013740. https:\/\/doi.org\/10.1109\/CVPR.2012.6247743"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. 1\u20138. https:\/\/doi.org\/10","author":"Robert","year":"2007","unstructured":"Robert J. Peters and Laurent Itti. 2007. Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention . In Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. 1\u20138. https:\/\/doi.org\/10 .1109\/CVPR. 2007 .383337 10.1109\/CVPR.2007.383337 Robert J. Peters and Laurent Itti. 2007. Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention. In Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. 1\u20138. https:\/\/doi.org\/10.1109\/CVPR.2007.383337"},{"key":"e_1_2_1_39_1","first-page":"6","article-title":"Food portion patterns and trends among U.S. children and the relationship to total eating occasion size, 1977-2006","volume":"141","author":"Piernas Carmen","year":"2011","unstructured":"Carmen Piernas and Barry M. Popkin . 2011 . Food portion patterns and trends among U.S. children and the relationship to total eating occasion size, 1977-2006 . Journal of Nutrition 141 , 6 (June 2011), 1159\u20131164. https:\/\/doi.org\/10.3945\/jn.111.138727 10.3945\/jn.111.138727 Carmen Piernas and Barry M. Popkin. 2011. Food portion patterns and trends among U.S. children and the relationship to total eating occasion size, 1977-2006. Journal of Nutrition 141, 6 (June 2011), 1159\u20131164. https:\/\/doi.org\/10.3945\/jn.111.138727","journal-title":"Journal of Nutrition"},{"key":"e_1_2_1_40_1","first-page":"8","article-title":"Measuring calorie and nutrition from food image","volume":"63","author":"Pouladzadeh Parisa","year":"2014","unstructured":"Parisa Pouladzadeh , Shervin Shirmohammadi , and Rana Almaghrabi . 2014 . Measuring calorie and nutrition from food image . IEEE Transactions on Instrumentation and Measurement 63 , 8 (Aug. 2014), 1947\u20131956. https:\/\/doi.org\/10.1109\/TIM.2014.2303533 10.1109\/TIM.2014.2303533 Parisa Pouladzadeh, Shervin Shirmohammadi, and Rana Almaghrabi. 2014. Measuring calorie and nutrition from food image. IEEE Transactions on Instrumentation and Measurement 63, 8 (Aug. 2014), 1947\u20131956. https:\/\/doi.org\/10.1109\/TIM.2014.2303533","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1016\/j.jada.2010.03.023","article-title":"The relationship of breakfast skipping and type of breakfast consumption with nutrient intake and weight status in children and adolescents: The national health and nutrition examination survey 1999-2006","volume":"110","author":"Deshmukh-Taskar P. R.","year":"2010","unstructured":"P. R. Deshmukh-Taskar , T. A. Nicklas , C. E. O\u2019Neil , D. R. Keast , J. D. Radcliffe , and S. Cho . 2010 . The relationship of breakfast skipping and type of breakfast consumption with nutrient intake and weight status in children and adolescents: The national health and nutrition examination survey 1999-2006 . Journal of the American Dietetic Association 110 , 6 (June 2010), 869\u2013878. https:\/\/doi.org\/10.1016\/j.jada.2010.03.023 10.1016\/j.jada.2010.03.023 P. R. Deshmukh-Taskar, T. A. Nicklas, C. E. O\u2019Neil, D. R. Keast, J. D. Radcliffe, and S. Cho. 2010. The relationship of breakfast skipping and type of breakfast consumption with nutrient intake and weight status in children and adolescents: The national health and nutrition examination survey 1999-2006. Journal of the American Dietetic Association 110, 6 (June 2010), 869\u2013878. https:\/\/doi.org\/10.1016\/j.jada.2010.03.023","journal-title":"Journal of the American Dietetic Association"},{"key":"e_1_2_1_42_1","first-page":"11","article-title":"SLIC superpixels compared to state-of-the-art superpixel methods","volume":"34","author":"Radhakrishna Achanta","year":"2012","unstructured":"Achanta Radhakrishna , Appu Shaji , Kevin Smith , Aurelien Lucchi , Pascal Fua , and Sabine Susstrunk . 2012 . SLIC superpixels compared to state-of-the-art superpixel methods . IEEE Transactions on Pattern Analysis and Machine Intelligence 34 , 11 (Nov. 2012). https:\/\/doi.org\/10.1109\/TPAMI.2012.120 10.1109\/TPAMI.2012.120 Achanta Radhakrishna, Appu Shaji, Kevin Smith, Aurelien Lucchi, Pascal Fua, and Sabine Susstrunk. 2012. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 11 (Nov. 2012). https:\/\/doi.org\/10.1109\/TPAMI.2012.120","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. 3135\u20133144","author":"Ramanishka Vasili","year":"2017","unstructured":"Vasili Ramanishka , Abir Das , Jianming Zhang , and Kate Saenko . 2017 . Top-down visual saliency guided by captions . In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. 3135\u20133144 . https:\/\/doi.org\/10.1109\/CVPR.2017.334 10.1109\/CVPR.2017.334 Vasili Ramanishka, Abir Das, Jianming Zhang, and Kate Saenko. 2017. Top-down visual saliency guided by captions. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. 3135\u20133144. https:\/\/doi.org\/10.1109\/CVPR.2017.334"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2014.55"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 2015 British Machine Vision Conference. Article 61","author":"Sakurada Ken","year":"2015","unstructured":"Ken Sakurada and Takayuki Okatani . 2015 . Change detection from a street image pair using CNN features and superpixel segmentation . In Proceedings of the 2015 British Machine Vision Conference. Article 61 , 12 pages. https:\/\/doi.org\/10.5244\/C.29.61 10.5244\/C.29.61 Ken Sakurada and Takayuki Okatani. 2015. Change detection from a street image pair using CNN features and superpixel segmentation. In Proceedings of the 2015 British Machine Vision Conference. Article 61, 12 pages. https:\/\/doi.org\/10.5244\/C.29.61"},{"key":"e_1_2_1_46_1","volume-title":"Dietary assessment methods in epidemiologic studies. Epidemiology and Health 36 (July","author":"Shim Jee-Seon","year":"2014","unstructured":"Jee-Seon Shim , Kyungwon Oh , and Hyeon Chang Kim . 2014. Dietary assessment methods in epidemiologic studies. Epidemiology and Health 36 (July 2014 ), e2014009\u2013e2014009. https:\/\/doi.org\/10.4178\/epih\/e2014009 10.4178\/epih Jee-Seon Shim, Kyungwon Oh, and Hyeon Chang Kim. 2014. Dietary assessment methods in epidemiologic studies. Epidemiology and Health 36 (July 2014), e2014009\u2013e2014009. https:\/\/doi.org\/10.4178\/epih\/e2014009"},{"key":"e_1_2_1_47_1","volume-title":"New Trends in Image Analysis and Processing\u2014ICIAP","author":"Shimoda Wataru","year":"2015","unstructured":"Wataru Shimoda and Keiji Yanai . 2015. CNN-based food image segmentation without pixel-wise annotation . In New Trends in Image Analysis and Processing\u2014ICIAP 2015 . Lecture Notes in Computer Science, Vol. 9281 . Springer , 449\u2013457. https:\/\/doi.org\/10.1007\/978-3-319-23222-5_55 10.1007\/978-3-319-23222-5_55 Wataru Shimoda and Keiji Yanai. 2015. CNN-based food image segmentation without pixel-wise annotation. In New Trends in Image Analysis and Processing\u2014ICIAP 2015. Lecture Notes in Computer Science, Vol. 9281. Springer, 449\u2013457. https:\/\/doi.org\/10.1007\/978-3-319-23222-5_55"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 2015 International Conference on Learning Representations.","author":"Simonyan Karen","year":"2015","unstructured":"Karen Simonyan and Andrew Zisserman . 2015 . Very deep convolutional networks for large-scale image recognition . In Proceedings of the 2015 International Conference on Learning Representations. Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In Proceedings of the 2015 International Conference on Learning Representations."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2818\u20132826","author":"Szegedy C.","unstructured":"C. Szegedy , V. Vanhoucke , S. Ioffe , J. Shlens , and Z. Wojna . 2016. Rethinking the inception architecture for computer vision . In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2818\u20132826 . C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. 2016. Rethinking the inception architecture for computer vision. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2818\u20132826."},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","first-page":"741","DOI":"10.3390\/nu10060741","article-title":"A comparative study on carbohydrate estimation: GoCARB vs","volume":"10","author":"Vasiloglou Maria F.","year":"2018","unstructured":"Maria F. Vasiloglou , Stavroula Mougiakakou , Emilie Aubry , Anika Bokelmann , Rita Fricker , Filomena Gomes , Cathrin Guntermann , Alexa Meyer , Diana Studerus , and Zeno Stanga . 2018 . A comparative study on carbohydrate estimation: GoCARB vs . Dietitians. Nutrients 10 , 6 (2018), 741 . Maria F. Vasiloglou, Stavroula Mougiakakou, Emilie Aubry, Anika Bokelmann, Rita Fricker, Filomena Gomes, Cathrin Guntermann, Alexa Meyer, Diana Studerus, and Zeno Stanga. 2018. A comparative study on carbohydrate estimation: GoCARB vs. Dietitians. Nutrients 10, 6 (2018), 741.","journal-title":"Dietitians. Nutrients"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the 2017 IEEE International Conference on Image Processing. 1277\u20131281","author":"Wang Yu","year":"2017","unstructured":"Yu Wang , Fengqing Zhu , Carol J. Boushey , and Edward J. Delp . 2017. Weakly supervised food image segmentation using class activation maps . In Proceedings of the 2017 IEEE International Conference on Image Processing. 1277\u20131281 . https:\/\/doi.org\/10.1109\/ICIP. 2017 .8296487 10.1109\/ICIP.2017.8296487 Yu Wang, Fengqing Zhu, Carol J. Boushey, and Edward J. Delp. 2017. Weakly supervised food image segmentation using class activation maps. In Proceedings of the 2017 IEEE International Conference on Image Processing. 1277\u20131281. https:\/\/doi.org\/10.1109\/ICIP.2017.8296487"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the 2017 IEEE International Conference on Computer Vision. 202\u2013211","author":"Zhang Pingping","year":"2017","unstructured":"Pingping Zhang , Dong Wang , Huchuan Lu , Hongyu Wang , and Xiang Ruan . 2017 . Amulet: Aggregating multi-level convolutional features for salient object detection . In Proceedings of the 2017 IEEE International Conference on Computer Vision. 202\u2013211 . https:\/\/doi.org\/10.1109\/ICCV.2017.31 10.1109\/ICCV.2017.31 Pingping Zhang, Dong Wang, Huchuan Lu, Hongyu Wang, and Xiang Ruan. 2017. Amulet: Aggregating multi-level convolutional features for salient object detection. In Proceedings of the 2017 IEEE International Conference on Computer Vision. 202\u2013211. https:\/\/doi.org\/10.1109\/ICCV.2017.31"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the 2017 IEEE International Conference on Computer Vision. 212\u2013221","author":"Zhang Pingping","year":"2017","unstructured":"Pingping Zhang , Dong Wang , Huchuan Lu , Hongyu Wang , and Baocai Yi . 2017 . Learning uncertain convolutional features for accurate saliency detection . In Proceedings of the 2017 IEEE International Conference on Computer Vision. 212\u2013221 . https:\/\/doi.org\/10.1109\/ICCV.2017.32 10.1109\/ICCV.2017.32 Pingping Zhang, Dong Wang, Huchuan Lu, Hongyu Wang, and Baocai Yi. 2017. Learning uncertain convolutional features for accurate saliency detection. In Proceedings of the 2017 IEEE International Conference on Computer Vision. 212\u2013221. https:\/\/doi.org\/10.1109\/ICCV.2017.32"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1177\/1932296815582222"},{"key":"e_1_2_1_56_1","first-page":"1","article-title":"Multiple hypotheses image segmentation and classification with application to dietary assessment","volume":"19","author":"Zhu Fengqing","year":"2015","unstructured":"Fengqing Zhu , Marc Bosch , Insoo Woo , SungYe Kim , Carol J. Boushey , David S. Ebert , and Edward J. Delp . 2015 . Multiple hypotheses image segmentation and classification with application to dietary assessment . IEEE Journal of Biomedical and Health Informatics 19 , 1 (Jan. 2015), 377\u2013388. https:\/\/doi.org\/10.1109\/JBHI.2014.2304925 10.1109\/JBHI.2014.2304925 Fengqing Zhu, Marc Bosch, Insoo Woo, SungYe Kim, Carol J. Boushey, David S. Ebert, and Edward J. Delp. 2015. Multiple hypotheses image segmentation and classification with application to dietary assessment. IEEE Journal of Biomedical and Health Informatics 19, 1 (Jan. 2015), 377\u2013388. https:\/\/doi.org\/10.1109\/JBHI.2014.2304925","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"key":"e_1_2_1_57_1","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/JSTSP.2010.2051471","article-title":"The use of mobile devices in aiding dietary assessment and evaluation","volume":"4","author":"Zhu Fengqing","year":"2010","unstructured":"Fengqing Zhu , Marc Bosch , Insoo Woo , SungYe Kim , Carol J. Boushey , David S. Ebert , and Edward J. Delp . 2010 . The use of mobile devices in aiding dietary assessment and evaluation . IEEE Journal of Selected Topics in Signal Processing 4 , 4 (Aug. 2010), 756\u2013766. https:\/\/doi.org\/10.1109\/JSTSP.2010.2051471 10.1109\/JSTSP.2010.2051471 Fengqing Zhu, Marc Bosch, Insoo Woo, SungYe Kim, Carol J. Boushey, David S. Ebert, and Edward J. Delp. 2010. The use of mobile devices in aiding dietary assessment and evaluation. IEEE Journal of Selected Topics in Signal Processing 4, 4 (Aug. 2010), 756\u2013766. https:\/\/doi.org\/10.1109\/JSTSP.2010.2051471","journal-title":"IEEE Journal of Selected Topics in Signal Processing"}],"container-title":["ACM Transactions on Computing for Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3440274","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3440274","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3440274","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:18Z","timestamp":1750195698000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3440274"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,15]]},"references-count":56,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,7,31]]}},"alternative-id":["10.1145\/3440274"],"URL":"https:\/\/doi.org\/10.1145\/3440274","relation":{},"ISSN":["2691-1957","2637-8051"],"issn-type":[{"value":"2691-1957","type":"print"},{"value":"2637-8051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,15]]},"assertion":[{"value":"2019-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}