{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T07:13:16Z","timestamp":1775891596250,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":32,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,12,6]],"date-time":"2023-12-06T00:00:00Z","timestamp":1701820800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"JST AIP","award":["JPMJCR22U4"],"award-info":[{"award-number":["JPMJCR22U4"]}]},{"name":"JSPS KAKENHI","award":["22H03993, 20H04210"],"award-info":[{"award-number":["22H03993, 20H04210"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,12,6]]},"DOI":"10.1145\/3595916.3626452","type":"proceedings-article","created":{"date-parts":[[2024,1,1]],"date-time":"2024-01-01T16:34:41Z","timestamp":1704126881000},"page":"1-7","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Open-Vocabulary Segmentation Approach for Transformer-Based Food Nutrient Estimation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-7410-2743","authenticated-orcid":false,"given":"Satayu","family":"Parinayok","sequence":"first","affiliation":[{"name":"The University of Tokyo, JP"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2752-6179","authenticated-orcid":false,"given":"Yoko","family":"Yamakata","sequence":"additional","affiliation":[{"name":"The University of Tokyo, JP"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2146-6275","authenticated-orcid":false,"given":"Kiyoharu","family":"Aizawa","sequence":"additional","affiliation":[{"name":"The University of Tokyo, JP"}]}],"member":"320","published-online":{"date-parts":[[2024,1]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3347448.3357172"},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Dosovitskiy Alexey","year":"2020","unstructured":"Alexey Dosovitskiy , Lucas Beyer , Alexander Kolesnikov , Dirk Weissenborn , Xiaohua Zhai , Thomas Unterthiner , Mostafa Dehghani , Matthias Minderer , Georg Heigold , Sylvain Gelly , 2020 . An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale . In Proceedings of the International Conference on Learning Representations. Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, 2020. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3347448.3357162"},{"key":"e_1_3_2_1_4_1","first-page":"1240","article-title":"Simultaneous estimation of dish locations and calories with multi-task learning","volume":"102","author":"Ege Takumi","year":"2019","unstructured":"Takumi Ege and Keiji Yanai . 2019 . Simultaneous estimation of dish locations and calories with multi-task learning . IEICE TRANSACTIONS on Information and Systems 102 , 7 (2019), 1240 \u2013 1246 . Takumi Ege and Keiji Yanai. 2019. Simultaneous estimation of dish locations and calories with multi-task learning. IEICE TRANSACTIONS on Information and Systems 102, 7 (2019), 1240\u20131246.","journal-title":"IEICE TRANSACTIONS on Information and Systems"},{"key":"e_1_3_2_1_5_1","first-page":"e3105","article-title":"Online dietary intake estimation: the Food4Me food frequency questionnaire","volume":"16","author":"Forster Hannah","year":"2014","unstructured":"Hannah Forster , Rosalind Fallaize , Caroline Gallagher , Clare\u00a0 B O\u2019Donovan , Clara Woolhead , Marianne\u00a0 C Walsh , Anna\u00a0 L Macready , Julie\u00a0 A Lovegrove , John\u00a0 C Mathers , Michael\u00a0 J Gibney , 2014 . Online dietary intake estimation: the Food4Me food frequency questionnaire . Journal of Medical Internet Research 16 , 6 (2014), e3105 . Hannah Forster, Rosalind Fallaize, Caroline Gallagher, Clare\u00a0B O\u2019Donovan, Clara Woolhead, Marianne\u00a0C Walsh, Anna\u00a0L Macready, Julie\u00a0A Lovegrove, John\u00a0C Mathers, Michael\u00a0J Gibney, 2014. Online dietary intake estimation: the Food4Me food frequency questionnaire. Journal of Medical Internet Research 16, 6 (2014), e3105.","journal-title":"Journal of Medical Internet Research"},{"key":"e_1_3_2_1_6_1","volume-title":"Validity of the 24-hr. dietary recall and seven-day record for group comparisons.Journal of the American Dietetic Association 73, 1","author":"Gersovitz Mitchell","year":"1978","unstructured":"Mitchell Gersovitz , J\u00a0Patrick Madden , and Helen Smiciklas-Wright . 1978. Validity of the 24-hr. dietary recall and seven-day record for group comparisons.Journal of the American Dietetic Association 73, 1 ( 1978 ), 48\u201355. Mitchell Gersovitz, J\u00a0Patrick Madden, and Helen Smiciklas-Wright. 1978. Validity of the 24-hr. dietary recall and seven-day record for group comparisons.Journal of the American Dietetic Association 73, 1 (1978), 48\u201355."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1038\/s43016-020-0073-2","article-title":"Uncertainty in human nutrition research","volume":"1","author":"Gibney Mike","year":"2020","unstructured":"Mike Gibney , David Allison , Dennis Bier , and Johanna Dwyer . 2020 . Uncertainty in human nutrition research . Nature Food 1 , 5 (2020), 247 \u2013 249 . Mike Gibney, David Allison, Dennis Bier, and Johanna Dwyer. 2020. Uncertainty in human nutrition research. Nature Food 1, 5 (2020), 247\u2013249.","journal-title":"Nature Food"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.322"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/dys105"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","first-page":"1656","DOI":"10.3390\/s23031656","article-title":"Health to Eat: A Smart Plate with Food Recognition, Classification, and Weight Measurement for Type-2 Diabetic Mellitus Patients\u2019 Nutrition Control","volume":"23","author":"Joshua Salaki\u00a0Reynaldo","year":"2023","unstructured":"Salaki\u00a0Reynaldo Joshua , Seungheon Shin , Je-Hoon Lee , and Seong\u00a0Kun Kim . 2023 . Health to Eat: A Smart Plate with Food Recognition, Classification, and Weight Measurement for Type-2 Diabetic Mellitus Patients\u2019 Nutrition Control . Sensors 23 , 3 (2023), 1656 . Salaki\u00a0Reynaldo Joshua, Seungheon Shin, Je-Hoon Lee, and Seong\u00a0Kun Kim. 2023. Health to Eat: A Smart Plate with Food Recognition, Classification, and Weight Measurement for Type-2 Diabetic Mellitus Patients\u2019 Nutrition Control. Sensors 23, 3 (2023), 1656.","journal-title":"Sensors"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","first-page":"233","DOI":"10.3945\/ajcn.114.083238","article-title":"Performance of the Automated Self-Administered 24-hour Recall relative to a measure of true intakes and to an interviewer-administered 24-h recall","volume":"100","author":"Kirkpatrick I","year":"2014","unstructured":"Sharon\u00a0 I Kirkpatrick , Amy\u00a0 F Subar , Deirdre Douglass , Thea\u00a0 P Zimmerman , Frances\u00a0 E Thompson , Lisa\u00a0 L Kahle , Stephanie\u00a0 M George , Kevin\u00a0 W Dodd , and Nancy Potischman . 2014 . Performance of the Automated Self-Administered 24-hour Recall relative to a measure of true intakes and to an interviewer-administered 24-h recall . The American Journal of Clinical Nutrition 100 , 1 (2014), 233 \u2013 240 . Sharon\u00a0I Kirkpatrick, Amy\u00a0F Subar, Deirdre Douglass, Thea\u00a0P Zimmerman, Frances\u00a0E Thompson, Lisa\u00a0L Kahle, Stephanie\u00a0M George, Kevin\u00a0W Dodd, and Nancy Potischman. 2014. Performance of the Automated Self-Administered 24-hour Recall relative to a measure of true intakes and to an interviewer-administered 24-h recall. The American Journal of Clinical Nutrition 100, 1 (2014), 233\u2013240.","journal-title":"The American Journal of Clinical Nutrition"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1016\/j.jand.2013.11.017","article-title":"Evaluation of web-based, self-administered, graphical food frequency questionnaire","volume":"114","author":"Kristal R","year":"2014","unstructured":"Alan\u00a0 R Kristal , Ann\u00a0 S Kolar , James\u00a0 L Fisher , Jesse\u00a0 J Plascak , Phyllis\u00a0 J Stumbo , Rick Weiss , and Electra\u00a0 D Paskett . 2014 . Evaluation of web-based, self-administered, graphical food frequency questionnaire . Journal of the Academy of Nutrition and Dietetics 114 , 4 (2014), 613 \u2013 621 . Alan\u00a0R Kristal, Ann\u00a0S Kolar, James\u00a0L Fisher, Jesse\u00a0J Plascak, Phyllis\u00a0J Stumbo, Rick Weiss, and Electra\u00a0D Paskett. 2014. Evaluation of web-based, self-administered, graphical food frequency questionnaire. Journal of the Academy of Nutrition and Dietetics 114, 4 (2014), 613\u2013621.","journal-title":"Journal of the Academy of Nutrition and Dietetics"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1056\/NEJMsr1606602","article-title":"Body fatness and cancer\u2014viewpoint of the IARC Working Group","volume":"375","author":"Lauby-Secretan B\u00e9atrice","year":"2016","unstructured":"B\u00e9atrice Lauby-Secretan , Chiara Scoccianti , Dana Loomis , Yann Grosse , Franca Bianchini , and Kurt Straif . 2016 . Body fatness and cancer\u2014viewpoint of the IARC Working Group . New England Journal of Medicine 375 , 8 (2016), 794 \u2013 798 . B\u00e9atrice Lauby-Secretan, Chiara Scoccianti, Dana Loomis, Yann Grosse, Franca Bianchini, and Kurt Straif. 2016. Body fatness and cancer\u2014viewpoint of the IARC Working Group. New England Journal of Medicine 375, 8 (2016), 794\u2013798.","journal-title":"New England Journal of Medicine"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.106"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3230519.3230593"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20154283"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.foodres.2021.110437"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.146"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.3390\/nu9070657"},{"key":"e_1_3_2_1_22_1","volume-title":"Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems 28","author":"Ren Shaoqing","year":"2015","unstructured":"Shaoqing Ren , Kaiming He , Ross Girshick , and Jian Sun . 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems 28 ( 2015 ). Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems 28 (2015)."},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention. 234\u2013241","author":"Ronneberger Olaf","year":"2015","unstructured":"Olaf Ronneberger , Philipp Fischer , and Thomas Brox . 2015 . U-net: Convolutional networks for biomedical image segmentation . In Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention. 234\u2013241 . Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention. 234\u2013241."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3390\/foods11213429"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.foodchem.2023.136309"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.308"},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8903\u20138911","author":"Thames Quin","year":"2021","unstructured":"Quin Thames , Arjun Karpur , Wade Norris , Fangting Xia , Liviu Panait , Tobias Weyand , and Jack Sim . 2021 . Nutrition5k: Towards automatic nutritional understanding of generic food . In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8903\u20138911 . Quin Thames, Arjun Karpur, Wade Norris, Fangting Xia, Liviu Panait, Tobias Weyand, and Jack Sim. 2021. Nutrition5k: Towards automatic nutritional understanding of generic food. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8903\u20138911."},{"key":"e_1_3_2_1_29_1","volume-title":"Attention is all you need. Advances in Neural Information Processing Systems 30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan\u00a0 N Gomez , \u0141ukasz Kaiser , and Illia Polosukhin . 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 ( 2017 ). Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan\u00a0N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017)."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tifs.2022.02.017"},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of the 30th ACM International Conference on Multimedia. 6898\u20136904","author":"Yamakata Yoko","year":"2022","unstructured":"Yoko Yamakata , Akihisa Ishino , Akiko Sunto , Sosuke Amano , and Kiyoharu Aizawa . 2022 . Recipe-oriented Food Logging for Nutritional Management . In Proceedings of the 30th ACM International Conference on Multimedia. 6898\u20136904 . Yoko Yamakata, Akihisa Ishino, Akiko Sunto, Sosuke Amano, and Kiyoharu Aizawa. 2022. Recipe-oriented Food Logging for Nutritional Management. In Proceedings of the 30th ACM International Conference on Multimedia. 6898\u20136904."},{"key":"e_1_3_2_1_32_1","volume-title":"A simple framework for open-vocabulary segmentation and detection. arXiv preprint arXiv:2303.08131","author":"Zhang Hao","year":"2023","unstructured":"Hao Zhang , Feng Li , Xueyan Zou , Shilong Liu , Chunyuan Li , Jianfeng Gao , Jianwei Yang , and Lei Zhang . 2023. A simple framework for open-vocabulary segmentation and detection. arXiv preprint arXiv:2303.08131 ( 2023 ). Hao Zhang, Feng Li, Xueyan Zou, Shilong Liu, Chunyuan Li, Jianfeng Gao, Jianwei Yang, and Lei Zhang. 2023. A simple framework for open-vocabulary segmentation and detection. arXiv preprint arXiv:2303.08131 (2023)."}],"event":{"name":"MMAsia '23: ACM Multimedia Asia","location":"Tainan Taiwan","acronym":"MMAsia '23","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["ACM Multimedia Asia 2023"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3595916.3626452","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3595916.3626452","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:35:56Z","timestamp":1750178156000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3595916.3626452"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,6]]},"references-count":32,"alternative-id":["10.1145\/3595916.3626452","10.1145\/3595916"],"URL":"https:\/\/doi.org\/10.1145\/3595916.3626452","relation":{},"subject":[],"published":{"date-parts":[[2023,12,6]]},"assertion":[{"value":"2024-01-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}