Real-Time Neural Style Transfer in Game Engines: A Comprehensive Review
DOI:
https://doi.org/10.61173/3wkzg191Keywords:
Real-Time Rendering, Game Engines, 2D Image Transformation, 3D Mesh StylizationAbstract
Neural Style Transfer (NST) has evolved into a transformative technique in computer vision and computer graphics, enabling the integration of artistic styles into digital media. In recent years, the application of NST in real-time scenarios—especially within game engines—has attracted significant academic and industrial interest. This paper provides a comprehensive review of the development of NST from its origins in 2D image transformation to its extension in video, 3D meshes, and real-time rendering. We further examine the role of modern game engines in supporting NST pipelines, summarize key advances in integrating stylization within interactive environments, and analyze both the benefits and limitations of such approaches. In addition, the paper highlights the existing research gaps, challenges, and possible future directions for advancing real-time NST in games.
References
[1] Gatys, L. A., Ecker, A. S., & Bethge, M. (2015). A neural algorithm of artistic style. arXiv preprint arXiv:1508.06576.
[2] Johnson, J., Alahi, A., & Fei-Fei, L. (2016). Perceptual losses for real-time style transfer and super-resolution. ECCV.
[3] Huang, X., & Belongie, S. (2017). Arbitrary style transfer in real-time with adaptive instance normalization. ICCV.
[4] Ruder, M., Dosovitskiy, A., & Brox, T. (2016). Artistic style transfer for videos. German Conference on Pattern Recognition.
[5] [Author(s)]. Neural Style Transfer for 3D Meshes. Graphical Models, vol. 129, p. 101198, 2023.
[6] Chen, Y., Shao, G., Shum, K. C., Hua, B.-S., & Yeung, S.-K. (2025). Advances in 3D Neural Stylization: A Survey. Preprint.
[7] Ioannou, E., & Maddock, S. (2025). Towards real-time G-buffer-guided style transfer in computer games. ACM TOG, 41(6), 1–15.
[8] Ahmad, F. N. (2013). An overview study of game engines. Int. J. Eng. Res. Appl., 3(5), 1673–1693.
[9] Andrade, A. (2015). Game Engines: A Survey. EAI Endorsed Transactions on Serious Games, 1(1).
[10] Jing, Y., Yang, Y., Feng, Z., Ye, J., Yu, Y., & Song, M. (2020). Neural style transfer: A review. IEEE TPAMI, 42(10), 2970–2987.
[11] Singh, A., Jaiswal, V., Joshi, G., Sanjeeve, A., Gite, S., & Kotecha, K. (2021). Neural Style Transfer: A Critical Review. IEEE Access, 9, 126086–126106.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 by the authors.
This work is licensed under a Creative Commons Attribution 4.0 International License.
