{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,27]],"date-time":"2026-07-27T14:57:52Z","timestamp":1785164272535,"version":"3.55.0"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,2,28]],"date-time":"2021-02-28T00:00:00Z","timestamp":1614470400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Project of New Generation Artificial Intelligence","award":["2018AAA0102502"],"award-info":[{"award-number":["2018AAA0102502"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61772310 and U1936203"],"award-info":[{"award-number":["61772310 and U1936203"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100007129","name":"Shandong Provincial Natural Science Foundation","doi-asserted-by":"crossref","award":["ZR2019JQ23"],"award-info":[{"award-number":["ZR2019JQ23"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Innovation Teams in Colleges and Universities in Jinan","award":["2018GXRC014"],"award-info":[{"award-number":["2018GXRC014"]}]},{"name":"Shandong Provincial Key Research and Development Program","award":["2019JZZY010118"],"award-info":[{"award-number":["2019JZZY010118"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2021,2,28]]},"abstract":"<jats:p>With the rising incidence of some diseases, such as obesity and diabetes, the healthy diet is arousing increasing attention. However, most existing food-related research efforts focus on recipe retrieval, user-preference-based food recommendation, cooking assistance, or the nutrition and calorie estimation of dishes, ignoring the personalized health-aware food recommendation. Therefore, in this work, we present a personalized health-aware food recommendation scheme, namely, Market2Dish, mapping the ingredients displayed in the market to the healthy dishes eaten at home. The proposed scheme comprises three components, namely, recipe retrieval, user health profiling, and health-aware food recommendation. In particular, recipe retrieval aims to acquire the ingredients available to the users and then retrieve recipe candidates from a large-scale recipe dataset. User health profiling is to characterize the health conditions of users by capturing the textual health-related information crawled from social networks. Specifically, to solve the issue that the health-related information is extremely sparse, we incorporate a word-class interaction mechanism into the proposed deep model to learn the fine-grained correlations between the textual tweets and pre-defined health concepts. For the health-aware food recommendation, we present a novel category-aware hierarchical memory network\u2013based recommender to learn the health-aware user-recipe interactions for better food recommendation. Moreover, extensive experiments demonstrate the effectiveness of the health-aware food recommendation scheme.<\/jats:p>","DOI":"10.1145\/3418211","type":"journal-article","created":{"date-parts":[[2021,4,16]],"date-time":"2021-04-16T12:42:08Z","timestamp":1618576928000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["Market2Dish: Health-aware Food Recommendation"],"prefix":"10.1145","volume":"17","author":[{"given":"Wenjie","family":"Wang","sequence":"first","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ling-Yu","family":"Duan","sequence":"additional","affiliation":[{"name":"Peking University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Jiang","sequence":"additional","affiliation":[{"name":"Shandong University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peiguang","family":"Jing","sequence":"additional","affiliation":[{"name":"Tianjin University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuemeng","family":"Song","sequence":"additional","affiliation":[{"name":"Shandong University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liqiang","family":"Nie","sequence":"additional","affiliation":[{"name":"Shandong University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,4,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702153"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3126490"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/MLSP.2016.7738886"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052694"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the International Conference on Case-based Reasoning Workshop. 189\u2013198","author":"Blansch\u00e9 Alexandre","year":"2010","unstructured":"Alexandre Blansch\u00e9 , Julien Cojan , Valmi Dufour-Lussier , Jean Lieber , Pascal Molli , Emmanuel Nauer , Hala Skaf-Molli , and Yannick Toussaint . 2010 . Taaable 3: Adaptation of ingredient quantities and of textual preparations . In Proceedings of the International Conference on Case-based Reasoning Workshop. 189\u2013198 . Alexandre Blansch\u00e9, Julien Cojan, Valmi Dufour-Lussier, Jean Lieber, Pascal Molli, Emmanuel Nauer, Hala Skaf-Molli, and Yannick Toussaint. 2010. Taaable 3: Adaptation of ingredient quantities and of textual preparations. In Proceedings of the International Conference on Case-based Reasoning Workshop. 189\u2013198."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210036"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-51811-4_48"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the International Conference on Multimedia. ACM, 1771\u20131779","author":"Ngo Chong-Wah","year":"2017","unstructured":"Jing-jing Chen, Chong-Wah Ngo , and Tat-Seng Chua . 2017 . Cross-modal recipe retrieval with rich food attributes . In Proceedings of the International Conference on Multimedia. ACM, 1771\u20131779 . Jing-jing Chen, Chong-Wah Ngo, and Tat-Seng Chua. 2017. Cross-modal recipe retrieval with rich food attributes. In Proceedings of the International Conference on Multimedia. ACM, 1771\u20131779."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240508.3240627"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2578726.2578751"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2846092"},{"key":"e_1_2_1_12_1","first-page":"2493","article-title":"Natural language processing (almost) from scratch","author":"Collobert Ronan","year":"2011","unstructured":"Ronan Collobert , Jason Weston , L\u00e9on Bottou , Michael Karlen , Koray Kavukcuoglu , and Pavel Kuksa . 2011 . Natural language processing (almost) from scratch . J. Mach. Learn. Res. 12 , Aug. (2011), 2493 \u2013 2537 . Ronan Collobert, Jason Weston, L\u00e9on Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, Aug. (2011), 2493\u20132537.","journal-title":"J. Mach. Learn. Res. 12"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the International AAAI Conference on Artificial Intelligence. AAAI Press, 6359\u20136366","author":"Cunxiao Du","year":"2019","unstructured":"Du Cunxiao , Chen Zhaozheng , Feng Fuli , Zhu Lei , Gan Tian , and Nie Liqiang . 2019 . Explicit interaction model towards text classification . In Proceedings of the International AAAI Conference on Artificial Intelligence. AAAI Press, 6359\u20136366 . Du Cunxiao, Chen Zhaozheng, Feng Fuli, Zhu Lei, Gan Tian, and Nie Liqiang. 2019. Explicit interaction model towards text classification. In Proceedings of the International AAAI Conference on Artificial Intelligence. AAAI Press, 6359\u20136366."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819956"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080826"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3086676"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186064"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1720021"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750511.2750528"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2792838.2796554"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080686"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-02432-5_19"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052569"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911489"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/312624.312682"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.17"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3350594"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-2068"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654970"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1181"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1459359.1459548"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742752"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the International AAAI Conference on Artificial Intelligence. AAAI Press, 2267\u20132273","author":"Lai Siwei","year":"2015","unstructured":"Siwei Lai , Liheng Xu , Kang Liu , and Jun Zhao . 2015 . Recurrent convolutional neural networks for text classification . In Proceedings of the International AAAI Conference on Artificial Intelligence. AAAI Press, 2267\u20132273 . Siwei Lai, Liheng Xu, Kang Liu, and Jun Zhao. 2015. Recurrent convolutional neural networks for text classification. In Proceedings of the International AAAI Conference on Artificial Intelligence. AAAI Press, 2267\u20132273."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3350950"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750511.2750524"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the International Conference on Advances in Neural Information Processing Systems. The MIT Press, 3111\u20133119","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov , Ilya Sutskever , Kai Chen , Greg S. Corrado , and Jeff Dean . 2013 . Distributed representations of words and phrases and their compositionality . In Proceedings of the International Conference on Advances in Neural Information Processing Systems. The MIT Press, 3111\u20133119 . Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. The MIT Press, 3111\u20133119."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2759499"},{"key":"e_1_2_1_38_1","volume-title":"A survey on food computing. arXiv preprint arXiv:1808.07202","author":"Min Weiqing","year":"2018","unstructured":"Weiqing Min , Shuqiang Jiang , Linhu Liu , Yong Rui , and Ramesh Jain . 2018. A survey on food computing. arXiv preprint arXiv:1808.07202 ( 2018 ). Weiqing Min, Shuqiang Jiang, Linhu Liu, Yong Rui, and Ramesh Jain. 2018. A survey on food computing. arXiv preprint arXiv:1808.07202 (2018)."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3123272"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3350948"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3350923"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the International Conference on World Wide Web. ACM, 509\u2013518","author":"Ofli Ferda","year":"2017","unstructured":"Ferda Ofli , Yusuf Aytar , Ingmar Weber , Raggi Al Hammouri , and Antonio Torralba . 2017 . The food perception gap on Instagram and its relation to health . In Proceedings of the International Conference on World Wide Web. ACM, 509\u2013518 . Ferda Ofli, Yusuf Aytar, Ingmar Weber, Raggi Al Hammouri, and Antonio Torralba. 2017. The food perception gap on Instagram and its relation to health. In Proceedings of the International Conference on World Wide Web. ACM, 509\u2013518."},{"key":"e_1_2_1_43_1","first-page":"3s","article-title":"Mobile multi-food recognition using deep learning","volume":"13","author":"Pouladzadeh Parisa","year":"2017","unstructured":"Parisa Pouladzadeh and Shervin Shirmohammadi . 2017 . Mobile multi-food recognition using deep learning . Trans. Multimedia Comput. Commun. Applic. 13 , 3s (Aug. 2017), 36:1\u201336:21. Parisa Pouladzadeh and Shervin Shirmohammadi. 2017. Mobile multi-food recognition using deep learning. Trans. Multimedia Comput. Commun. Applic. 13, 3s (Aug. 2017), 36:1\u201336:21.","journal-title":"Trans. Multimedia Comput. Commun. Applic."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-2025"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the International Conference on Web and Social Media. AAAI Press, 310\u2013319","author":"Rokicki Markus","year":"2018","unstructured":"Markus Rokicki , Christoph Trattner , and Eelco Herder . 2018 . The impact of recipe features, social cues and demographics on estimating the healthiness of online recipes . In Proceedings of the International Conference on Web and Social Media. AAAI Press, 310\u2013319 . Markus Rokicki, Christoph Trattner, and Eelco Herder. 2018. The impact of recipe features, social cues and demographics on estimating the healthiness of online recipes. In Proceedings of the International Conference on Web and Social Media. AAAI Press, 310\u2013319."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.327"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3133137"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1630995.1630998"},{"key":"e_1_2_1_49_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 ( 2014 ). Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.308"},{"key":"e_1_2_1_51_1","volume-title":"Food recommender systems: Important contributions, challenges and future research directions. arXiv preprint arXiv:1711.02760","author":"Trattner Christoph","year":"2017","unstructured":"Christoph Trattner and David Elsweiler . 2017. Food recommender systems: Important contributions, challenges and future research directions. arXiv preprint arXiv:1711.02760 ( 2017 ). Christoph Trattner and David Elsweiler. 2017. Food recommender systems: Important contributions, challenges and future research directions. arXiv preprint arXiv:1711.02760 (2017)."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052573"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367629"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1170"},{"key":"e_1_2_1_55_1","volume-title":"Denoising implicit feedback for recommendation. arXiv preprint arXiv:2006.04153","author":"Wang Wenjie","year":"2020","unstructured":"Wenjie Wang , Fuli Feng , Xiangnan He , Liqiang Nie , and Tat-Seng Chua . 2020. Denoising implicit feedback for recommendation. arXiv preprint arXiv:2006.04153 ( 2020 ). Wenjie Wang, Fuli Feng, Xiangnan He, Liqiang Nie, and Tat-Seng Chua. 2020. Denoising implicit feedback for recommendation. arXiv preprint arXiv:2006.04153 (2020)."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210061"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331267"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the International Conference on Multimedia. ACM, 172\u2013176","author":"Wu Hui","unstructured":"Hui Wu , Michele Merler , Rosario Uceda-Sosa , and John R. Smith . 2016. Learning to make better mistakes: Semantics-aware visual food recognition . In Proceedings of the International Conference on Multimedia. ACM, 172\u2013176 . Hui Wu, Michele Merler, Rosario Uceda-Sosa, and John R. Smith. 2016. Learning to make better mistakes: Semantics-aware visual food recognition. In Proceedings of the International Conference on Multimedia. ACM, 172\u2013176."},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE, 2249\u20132256","author":"Yang Shulin","year":"2010","unstructured":"Shulin Yang , Mei Chen , Dean Pomerleau , and Rahul Sukthankar . 2010 . Food recognition using statistics of pairwise local features . In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE, 2249\u20132256 . Shulin Yang, Mei Chen, Dean Pomerleau, and Rahul Sukthankar. 2010. Food recognition using statistics of pairwise local features. In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE, 2249\u20132256."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009982220290"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1174"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2912748"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2569096"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3418211","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3418211","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:36Z","timestamp":1750195896000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3418211"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,28]]},"references-count":63,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,2,28]]}},"alternative-id":["10.1145\/3418211"],"URL":"https:\/\/doi.org\/10.1145\/3418211","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,28]]},"assertion":[{"value":"2019-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}