Research and Analysis of Prompt Engineering Technology Systems Based on Large Language Model Generation Tasks
DOI:
https://doi.org/10.61173/xmhcfp96Keywords:
Prompt engineering, Large language model, Chain of thought, Correcting illusion, Automated optimizationAbstract
Due to the rapid development of artificial intelligence, prompt engineering technology has become a key technology for the development of Large Language Models in the field of generation tasks. Although the existing reviews have listed various technologies in detail, they still lack an analysis of the inherent logic and evolution laws among the technologies. Therefore, this article classifies the core issues that the technology solves, namely the functional goals, establishes the connection between the technology and the core issues, and presents the development path of the technology. First, let’s introduce the basic prompt class to achieve something from nothing and solve the problem of task understanding. Then elaborate on how structured reasoning classes deal with logical reasoning problems. In this category, it is further divided into two subcategories: linear reasoning and nonlinear reasoning. Then, it discusses how the hallucination-correcting category overcomes the problems of knowledge deficiency and hallucinations. Finally, it explores how the automation optimization category can focus on the efficiency of manual design and promote the evolution of technology towards scale and industrialization. In the future, engineering technology will move towards a more intelligent direction, achieving a paradigm shift in human-computer interaction.
References
[1] Sahoo P, Singh AK, et al. A systematic survey of prompt engineering in large language models: Techniques and applications. arxiv preprint arxiv:2402.07927. 2024 Feb 5.
[2] Chen B, Zhang Z, et al. Unleashing the potential of prompt engineering for large language models. Patterns. 2025 May 8.
[3] Oppenlaender J, Linder R, et al. Prompting AI art: An investigation into the creative skill of prompt engineering. International journal of human–computer interaction. 2025 Aug 18;41(16):10207-29.
[4] Cain W. Prompting change: Exploring prompt engineering in large language model AI and its potential to transform education. TechTrends 68.1 2024: 47-57.
[5] Radford A, Wu J, et al. Language models are unsupervised multitask learners. OpenAI blog. 2019 Feb 24;1(8):9.
[6] Brown T, Mann B, et al. Language models are few-shot learners. Advances in neural information processing systems. 2020;33:1877-901.
[7] Wei J, Wang X, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems. 2022 Dec 6;35:24824-37.
[8] Yao, Shunyu, et al. Tree of thoughts: Deliberate problem solving with large language models. Advances in neural information processing systems 36 2023: 11809-11822.
[9] Yao S, Yu D, et al. Tree of thoughts: Deliberate problem solving with large language models. Advances in neural information processing systems. 2023 Dec 15;36:11809-22.
[10] Wang Z, Zhang H, et al. Chain-of-table: Evolving tables in the reasoning chain for table understanding. arxiv preprint arxiv:2401.04398. 2024 Jan 9.
[11] Dhuliawala S, Komeili M, et al. Chain-of-verification reduces hallucination in large language models. arxiv preprint arxiv:2309.11495. 2023 Sep 20.
[12] Zhou Y, Muresanu AI, et al. Large language models are human-level prompt engineers. InThe eleventh international conference on learning representations 2022 Nov 3.
[13] Yang C, Wang X, et al. Large language models as optimizers. InThe Twelfth International Conference on Learning Representations 2023 Sep 7.
[14] Sprague Z, Yin F, et al. To cot or not to cot? chain-ofthought helps mainly on math and symbolic reasoning. arxiv preprint arxiv:2409.12183. 2024 Sep 18.
[15] Yao S, Zhao J, et al. React: Synergizing reasoning and acting in language models. InInternational Conference on Learning Representations (ICLR) 2023 Jan.
[16] Murthy R, Zhu M, et al. Promptomatix: An Automatic Prompt Optimization Framework for Large Language Models. arxiv preprint arxiv:2507.14241. 2025 Jul 17.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 by the authors.

This work is licensed under a Creative Commons Attribution 4.0 International License.
