{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T16:59:50Z","timestamp":1791046790228,"version":"4.1.0"},"reference-count":31,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2024,6,21]],"date-time":"2024-06-21T00:00:00Z","timestamp":1718928000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1834620"],"award-info":[{"award-number":["1834620"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2137791"],"award-info":[{"award-number":["2137791"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>In an era where dietary habits significantly impact health, technological interventions can offer personalized and accessible food choices. This paper introduces Chef Dalle, a recipe recommendation system that leverages multi-model and multimodal human-computer interaction (HCI) techniques to provide personalized cooking guidance. The application integrates voice-to-text conversion via Whisper and ingredient image recognition through GPT-Vision. It employs an advanced recipe filtering system that utilizes user-provided ingredients to fetch recipes, which are then evaluated through multi-model AI through integrations of OpenAI, Google Gemini, Claude, and\/or Anthropic APIs to deliver highly personalized recommendations. These methods enable users to interact with the system using voice, text, or images, accommodating various dietary restrictions and preferences. Furthermore, the utilization of DALL-E 3 for generating recipe images enhances user engagement. User feedback mechanisms allow for the refinement of future recommendations, demonstrating the system\u2019s adaptability. Chef Dalle showcases potential applications ranging from home kitchens to grocery stores and restaurant menu customization, addressing accessibility and promoting healthier eating habits. This paper underscores the significance of multimodal HCI in enhancing culinary experiences, setting a precedent for future developments in the field.<\/jats:p>","DOI":"10.3390\/computers13070156","type":"journal-article","created":{"date-parts":[[2024,6,21]],"date-time":"2024-06-21T08:50:08Z","timestamp":1718959808000},"page":"156","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Chef Dalle: Transforming Cooking with Multi-Model Multimodal AI"],"prefix":"10.3390","volume":"13","author":[{"given":"Brendan","family":"Hannon","sequence":"first","affiliation":[{"name":"Department of Computer Science and Technology, Kean University, Union, NJ 07083, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7621-2734","authenticated-orcid":false,"given":"Yulia","family":"Kumar","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Kean University, Union, NJ 07083, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J. Jenny","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Kean University, Union, NJ 07083, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7954-2122","authenticated-orcid":false,"given":"Patricia","family":"Morreale","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Kean University, Union, NJ 07083, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,21]]},"reference":[{"key":"ref_1","unstructured":"(2024, March 15). Facts Sheet\u2014Malnutrition. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/malnutrition."},{"key":"ref_2","unstructured":"(2024, March 15). API Reference\u2014OpenAI API. Available online: https:\/\/platform.openai.com\/docs\/api-reference."},{"key":"ref_3","unstructured":"(2024, March 15). Speech to Text\u2014OpenAI API. Available online: https:\/\/platform.openai.com\/docs\/guides\/speech-to-text\/quickstart."},{"key":"ref_4","unstructured":"(2024, March 15). Vision\u2014OpenAI API. Available online: https:\/\/platform.openai.com\/docs\/guides\/vision."},{"key":"ref_5","unstructured":"(2024, March 15). Image Generation\u2014OpenAI API. Available online: https:\/\/platform.openai.com\/docs\/guides\/images."},{"key":"ref_6","unstructured":"(2024, March 15). SuperCook\u2014Zero Waste Recipe Generator. Available online: https:\/\/www.supercook.com\/#\/desktop."},{"key":"ref_7","unstructured":"(2024, March 24). Yummly: Personalized Recipe Recommendation and Search. Available online: https:\/\/www.yummly.com\/."},{"key":"ref_8","unstructured":"(2024, March 15). 1,000,000+ Recipes, Meal Planner and Grocery List|BigOven. Available online: https:\/\/www.bigoven.com\/."},{"key":"ref_9","unstructured":"(2024, March 24). ChatGPT. Available online: https:\/\/chatgpt.com\/."},{"key":"ref_10","unstructured":"(2024, March 24). Gemini. Available online: https:\/\/gemini.google.com\/app."},{"key":"ref_11","unstructured":"(2024, March 24). Claude. Available online: https:\/\/claude.ai\/chats."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kumar, Y., Delgado, J., Kupershtein, E., Hannon, B., Gordon, Z., Li, J.J., and Morreale, P. (2023, January 23\u201326). AssureAIDoctor\u2014A Bias-Free AI Bot. Proceedings of the 2023 International Symposium on Networks, Computers and Communications (ISNCC), Doha, Qatar.","DOI":"10.1109\/ISNCC58260.2023.10323978"},{"key":"ref_13","unstructured":"Villalobos, W., Kumar, Y., Li, J.J., and Morreale, P. (2024, January 19\u201322). The Multilingual Eyes Multimodal Traveler\u2019s App. Proceedings of the 9th International Congress on Information and Communication (ICICT 2024), London, UK. Available online: https:\/\/9thinternationalcongressoni.sched.com\/event\/1aGPZ\/the-multilingual-eyes-multimodal-travelers-app."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kupershtein, E., Kumar, Y., Manikandan, A., Morreale, P., and Li, J.J. (2023, January 24\u201327). ChatGPT as a Game-Changer for Embedding Emojis in Faculty Feedback. Proceedings of the 2023 Congress in Computer Science, Computer Engineering & Applied Computing (CSCE), Las Vegas, NV, USA.","DOI":"10.1109\/CSCE60160.2023.00173"},{"key":"ref_15","unstructured":"(2024, March 15). Plant Jammer\u2014Inspiration Google Play Page. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.plantjammer.plantjammer&hl=en_US."},{"key":"ref_16","unstructured":"(2024, March 15). AI Recipe Generator (100% Free)|Lets Foodie. Available online: https:\/\/letsfoodie.com\/ai-recipe-generator\/."},{"key":"ref_17","unstructured":"(2024, March 15). DishGen|AI Recipes|AI Recipe Generator. Available online: https:\/\/www.dishgen.com\/."},{"key":"ref_18","unstructured":"(2024, March 15). ChefGPT\u2014Your AI-Powered Personal Chef. Available online: https:\/\/www.chefgpt.xyz\/."},{"key":"ref_19","unstructured":"(2024, March 24). Ray-Ban Meta Smart Glasses|Meta Store|Meta Store. Available online: https:\/\/www.meta.com\/smart-glasses\/."},{"key":"ref_20","unstructured":"(2024, March 24). Galaxy AI|Mobile AI on Galaxy S24 Ultra|Samsung, US. Available online: https:\/\/www.samsung.com\/us\/smartphones\/galaxy-s24-ultra\/galaxy-ai\/."},{"key":"ref_21","unstructured":"Hwang, A., Badreddine, S., Gifford, F., and Besold, T.R. (2023, January 19\u201323). Recipe 2.0: Information Presentation for AI-Supported Culinary Idea Generation. Proceedings of the 14th International Conference on Computational Creativity (ICCC), Waterloo, ON, Canada."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2028","DOI":"10.1016\/j.procs.2023.10.193","article-title":"Smart cuisine: Generative recipe & chatgpt powered nutrition assistance for sustainable cooking","volume":"225","author":"Kansaksiri","year":"2023","journal-title":"Procedia Comput. Sci."},{"key":"ref_23","first-page":"2658","article-title":"Cooking with ChatGPT and Bard: A Study on Competencies of AI Tools on Recipe Correction, Adaption, Time Management and Presentation","volume":"11","author":"Tatlisu","year":"2024","journal-title":"J. Tour. Gastron. Stud."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"112076","DOI":"10.1016\/j.nut.2023.112076","article-title":"The credibility of dietary advice formulated by CHATGPT: Robo-diets for people with food allergies","volume":"112","author":"Niszczota","year":"2023","journal-title":"Nutrition"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.3390\/clinpract13050104","article-title":"AI-powered renal diet support: Performance of CHATGPT, Bard Ai, and Bing Chat","volume":"13","author":"Qarajeh","year":"2023","journal-title":"Clin. Pract."},{"key":"ref_26","first-page":"49","article-title":"Integrating Artificial Intelligence in food systems: Future trends, innovations, and prospects for sustainable development and enhanced culinary experiences","volume":"2","author":"Pravin","year":"2024","journal-title":"Int. J. Multidimens. Res. Perspect."},{"key":"ref_27","unstructured":"Chen, Z., Deng, Y., Wu, Y., Gu, Q., and Li, Y. (2022). Towards understanding a mixture of experts in deep learning. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1007\/s10462-012-9338-y","article-title":"Mixture of experts: A literature survey","volume":"42","author":"Masoudnia","year":"2014","journal-title":"Artif. Intell. Rev."},{"key":"ref_29","unstructured":"Wu, X., Huang, S., Wang, W., and Wei, F. (2024). Multi-Head Mixture-of-Experts. arXiv."},{"key":"ref_30","unstructured":"Krishnamurthy, Y., Watkins, C., and Gaertner, T. (2023). Improving Expert Specialization in Mixture of Experts. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yang, J.C., Korecki, M., Dailisan, D., Hausladen, C.I., and Helbing, D. (2024). LLM Voting: Human Choices and AI Collective Decision Making. arXiv.","DOI":"10.1609\/aies.v7i1.31758"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/13\/7\/156\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:02:24Z","timestamp":1760108544000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/13\/7\/156"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,21]]},"references-count":31,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["computers13070156"],"URL":"https:\/\/doi.org\/10.3390\/computers13070156","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,21]]}}}