Automated Household Food Management and Recipe Recommendation System Based on Visual Recognition and LLM Knowledge Base
DOI:
https://doi.org/10.61173/zweskj40Keywords:
Visual recognition, large language models (LLM), knowledge base, food management, automationAbstract
With continuous economic development and intensifying competition, individuals increasingly face the conflict between the pursuit of a better life and the demand for efficiency. This conflict is particularly pronounced in the realm of dietary habits. A healthy and well-balanced diet often requires significant time investment in planning and decision-making, yet people frequently lack sufficient time for such considerations. As a result, the need for an efficient system to assist with meal planning and food management has become more apparent. To address this challenge and help individuals achieve a balance between healthy eating and lifestyle efficiency, we have developed an easy-to-use, natural language-based automated household food management system leveraging visual recognition technology, large language models (LLM), and knowledge base technologies. The system automates household food management tasks, including inventory input, stock display, expiration monitoring, and food output. Additionally, it customizes personalized recipes based on factors such as the current time, number of family members, taste preferences, special dietary needs, and available ingredients. According to user surveys, over 70% of respondents recognized the necessity of the system, and its recipe design received an average rating of 3.75 out of 5, indicating that the majority of users found the system’s recipe recommendations acceptable.References
[1] Chaudhary, Smriti, et al. ChefAI.IN: Generating Indian Recipes with AI Algorithm. 13 Oct. 2022, https://doi. org/10.1109/tqcebt54229.2022.10041463.
[2] Faisal. “Diet-Right: A Smart Food Recommendation System.” KSII Transactions on Internet and Information Systems, vol. 11, no. 6, 30 June 2017, https://doi.org/10.3837/ tiis.2017.06.006.
[3] Freyne, Jill, and Shlomo Berkovsky. “Intelligent Food Planning.” Proceedings of the 15th International Conference on Intelligent User Interfaces - IUI ’10, 2010, https://doi. org/10.1145/1719970.1720021.
[4] Luca Anselma, et al. Automatic Reasoning Evaluation in Diet Management Based on an Italian Cookbook. 15 July 2018, https://doi.org/10.1145/3230519.3230595. Accessed 17 Aug. 2023.
[5] Khan, Muhammad Asad, et al. “IoT Based Grocery Management System: Smart Refrigerator and Smart Cabinet.” 2019 International Conference on Systems of Collaboration Big Data, Internet of Things & Security (SysCoBIoTS), Dec. 2019, https://doi.org/10.1109/syscobiots48768.2019.9028031.
[6] Fujiwara, Masashi, et al. “A Smart Fridge for Efficient Foodstuff Management with Weight Sensor and Voice Interface.” Proceedings of the 47th International Conference on Parallel Processing Companion, 13 Aug. 2018, https://doi. org/10.1145/3229710.3229727.
[7] Goel, Mansi, et al. “Ratatouille: A Tool for Novel Recipe Generation.” IEEE Xplore, 1 May 2022, ieeexplore.ieee.org/ stamp/stamp.jsp?arnumber=9814641.
[8] Vassányi, I., et al. “A Novel Artificial Intelligence Method for Weekly Dietary Menu Planning.” Methods of Information in Medicine, vol. 44, no. 05, 2005, pp. 655–664, https://doi. org/10.1055/s-0038-1634022.
[9] Wang, Wenjie, et al. “Market2Dish: Health-Aware Food Recommendation.” ACM Transactions on Multimedia Computing, Communications, and Applications, vol. 17, no. 1, 16 Apr. 2021, pp. 1–19, https://doi.org/10.1145/3418211.
[10] Min, W., et al. “Food Recommendation: Framework, Existing Solutions, and Challenges.” IEEE Transactions on Multimedia, vol. 22, no. 10, 2020, pp. 2659–2671, ieeexplore. ieee.org/document/8930090, https://doi.org/10.1109/ TMM.2019.2958761.
[11] Marvin, Ggaliwango, et al. “Prompt Engineering in Large Language Models.” Algorithms for Intelligent Systems, 1 Jan. 2024, pp. 387–402, https://doi.org/10.1007/978-981-99-7962- 2_30.
[12] Giray, Louie. “Prompt Engineering with ChatGPT: A Guide for Academic Writers.” Annals of Biomedical Engineering, vol. 51, 7 June 2023, pp. 2629–2633, https://doi.org/10.1007/s10439- 023-03272-4.
[13] Taberko, V, et al. “NLP and LLM Based Approach to Enterprise Knowledge Base Construction.” Bsuir.by, 2024, libeldoc.bsuir.by/handle/123456789/55618, https://libeldoc. bsuir.by/handle/123456789/55618. Accessed 11 Sept. 2024.
[14] Li, Zhenyu, et al. “FlexKBQA: A Flexible LLM- Powered Framework for Few-Shot Knowledge Base Question Answering.” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 17, 24 Mar. 2024, pp. 18608–18616, ojs.aaai.org/index.php/AAAI/article/view/29823, https://doi. org/10.1609/aaai.v38i17.29823.
[15] jeinlee1991. “GitHub - Jeinlee1991/Chinese-Llm- Benchmark.” GitHub, 13 Apr. 2024, github.com/jeinlee1991/ chinese-llm-benchmark. Accessed 11 Sept. 2024.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 by the authors.

This work is licensed under a Creative Commons Attribution 4.0 International License.
