Integration of AR Technology and Gamification: An Exploration of Cooking Guide Devices

Authors

  • Daiyao Lin
  • Ruo Shen

DOI:

https://doi.org/10.61173/6jsw1x30

Keywords:

Augmented Reality (AR), Cooking Guid-ance, Gamification, Kitchen Technology

Abstract

With the rapid development of augmented reality (AR) technology, its application in educational has become prevalent. Nevertheless, research in the domain of cooking guidance remains relatively limited. This study aims to address the gap by comparing and analysing the three existing AR-based cooking guide device - Magic Leap 1, AREasyCooking, and Pic2Dish, as well as the virtual reality (VR) cooking games. Based on these insights, the study proposes CulinARy, an innovative cooking guide tool that employs AR technology to provide real-time cooking step-by-step instructions, gamified challenges and a multi-platform experience. The objective of CulinARy is to improve the users’ cooking ability and make cooking more accessible and enjoyable.

References

[1] F. M. Dinis, A. S. Guimaraes, B. R. Carvalho, and J. P. P. Martins, “Virtual and augmented reality game-based applications to civil engineering education,” in IEEE Global Engineering Education Conference, EDUCON, 2017. doi: 10.1109/ EDUCON.2017.7943075.

[2] P. H. Wu et al., “Biology Learning using Augmented Reality and Gaming Techniques,” Public Understanding of Science, vol. 20, no. 1, 2016.

[3] C. Ferguson, P. M. Davidson, P. J. Scott, D. Jackson, and L. D. Hickman, “Augmented reality, virtual reality and gaming: An integral part of nursing,” Contemp Nurse, vol. 51, no. 1, 2015, doi: 10.1080/10376178.2015.1130360.

[4] S. C.-Y. Yuen, G. Yaoyuneyong, and E. Johnson, “Augmented Reality: An Overview and Five Directions for AR in Education,” Journal of Educational Technology Development and Exchange, vol. 4, no. 1, 2011, doi: 10.18785/jetde.0401.10.

[5] I. Majil, M. T. Yang, and S. Yang, “Augmented Reality Based Interactive Cooking Guide,” Sensors, vol. 22, no. 21, 2022, doi: 10.3390/s22218290.

[6] A. Iftene, D. Trandabat, and V. Radulescu, “Eye and voice control for an augmented reality cooking experience,” in Procedia Computer Science, 2020. doi: 10.1016/ j.procs.2020.09.157.

[7] Y. An et al., “PIC2DISH: A customized cooking assistant system,” in MM 2017 - Proceedings of the 2017 ACM Multimedia Conference, 2017. doi: 10.1145/3123266.3126490.

[8] G. C. Utami, C. R. Widiawati, and P. Subarkah, “Detection of Indonesian Food to Estimate Nutritional Information Using YOLOv5,” Teknika, vol. 12, no. 2, 2023, doi: 10.34148/teknika. v12i2.636.

[9] A. Wang et al., “YOLOv10: Real-Time End-to-End Object Detection,” May 2024, [Online]. Available: http://arxiv.org/ abs/2405.14458

[10] R. Guan, Xi. Xu, Y. Luo, J. Miao, and S. Qiu, “Gesture detection and recognition technology based on computer vision,” Jan. 2023. doi: 10. 3969/j. issn. 1000-386x. 2013. 01. 038.

[11] Guo Wang, “Research and implementation of containerization for virtual instrumentation measurement system,” May 2022.

[12] X. Mao, Q. Zhang, H. Ruan, and Y. Yang, “Multitask Collaborative Multi-modal Remote Sensing Target Segmentation Algorithm,” Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, vol. 46, no. 8, pp. 3363–3371, Aug. 2024, doi: 10.11999/JEIT231267.

Downloads

Published

2025-10-24