AI-Powered Coding Tools: A Study of Advancements, Challenges, and Future Directions

Authors

  • Dingyi Zhang

DOI:

https://doi.org/10.61173/n7m7qa37

Keywords:

Artificial intelligence, large language model, machine learning

Abstract

This review examines the effects of AI-assisted programming in contemporary software development, paying particular attention to tools driven by Large Language Models (LLMs), such as GPT-4o and GitHub Copilot. Starting with data processing and ending with model deployment, the review describes the standard workflow for training machine learning models and how programmers use these models to improve their coding processes. GitHub Copilot, an AI-powered code generator, and GPT-4o, a general-purpose LLM, are compared in terms of accuracy, usability, and efficiency when assisting with programming tasks. The results show that although both tools greatly facilitate coding, they each have particular advantages and disadvantages. GitHub Copilot is excellent at integrating with IDEs, providing contextual code recommendations and streamlining processes. In contrast, GPT-4o shows better accuracy when creating code from scratch, but it does not have Copilot’s seamless IDE integration. The review also identifies some of the current drawbacks of AI-powered coding tools, including the possibility of producing faulty or vulnerable code as a result of training on unreliable datasets and the inability to comprehend context, which can occasionally result in functionally correct but practically incorrect code. In order to filter and fix problematic code before training, the review recommends using advanced algorithms for data pre-processing. It also suggests improving the interpretability of code generated by AI to help developers better comprehend and trust the results.

References

[1] Wermelinger M. Using github copilot to solve simple programming problems. In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1; 2023 Mar; 172-178.

[2] Dakhel AM, Majdinasab V, Nikanjam A, Khomh F, Desmarais MC, Jiang ZMJ. Github copilot ai pair programmer: Asset or liability? J Syst Softw. 2023;203:111734.

[3] Pearce H, Ahmad B, Tan B, Dolan-Gavitt B, Karri R. Asleep at the keyboard? assessing the security of github copilot’s code contributions. In: 2022 IEEE Symposium on Security and Privacy (SP); 2022 May; 754-768.

[4] Nguyen N, Nadi S. An empirical evaluation of GitHub copilot’s code suggestions. In: Proceedings of the 19th International Conference on Mining Software Repositories; 2022 May; 1-5.

[5] Finnie-Ansley J, Denny P, Becker BA, Luxton-Reilly A, Prather J. The robots are coming: Exploring the implications of openai codex on introductory programming. In: Proceedings of the 24th Australasian Computing Education Conference; 2022 Feb; 10-19.

[6] Wiggers K. OpenAI debuts GPT-4o ‘omni’ model now powering ChatGPT. TechCrunch. 2024 Aug 5. Available from: https://techcrunch.com/2024/05/13/openais-newest-model-isgpt-4o/

[7] Achiam J, Adler S, Agarwal S, Ahmad L, Akkaya I, Aleman FL, et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774. 2023.

[8] Becker BA, Denny P, Finnie-Ansley J, Luxton-Reilly A, Prather J, Santos EA. Programming is hard-or at least it used to be: Educational opportunities and challenges of ai code generation. In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1; 2023 Mar; 500-506.

[9] Yetiştiren B, Özsoy I, Ayerdem M, Tüzün E. Evaluating the code quality of ai-assisted code generation tools: An empirical study on github copilot, amazon codewhisperer, and chatgpt. arXiv preprint arXiv:2304.10778. 2023.

[10] Wang H, Lei Z, Zhang X, Zhou B, Peng J. Machine learning basics. Deep learning. 2016;98-164.

[11] GitHub copilot documentation. GitHub Docs. Available from: https://docs.github.com/en/copilot/, 2024.

[12] Poldrack RA, Lu T, Beguš G. AI-assisted coding: Experiments with GPT-4. arXiv preprint arXiv:2304.13187. 2023.

[13] Zhang S, Zhao H, Liu X, Zheng Q, Qi Z, Gu X, et al. NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Prompts. arXiv preprint arXiv:2405.04520. 2024.

[14] Gitbito. Gitbito/Bitoai: Bito’s AI helps developers dramatically accelerate their impact. it’s a Swiss army knife of capabilities that can 10x your developer productivity and save you an hour a day, using the same models as chatgpt!. GitHub. Available from: https://github.com/gitbito/bitoai, 2024.

[15] Ismailkasan. Ismailkasan/chat-GPT-vscode-extension: CHATGPT assistant completion for vscode extension. GitHub. Available from: https://github.com/ismailkasan/chat-gpt-vscodeextension, 2024.

[16] Silasnevstad. Silasnevstad/GPT-extension-vscode: An extension bringing OpenAI’s API to your fingertips inside of Visual Studio Code. GitHub. 2024. Available from: https:// github.com/silasnevstad/GPT-Extension-VSCode, 2024.

[17] Atkinson CF. ChatGPT and computational-based research: benefits, drawbacks, and machine learning applications. Discover Artificial Intelligence. 2023;3(1):42.

Downloads

Published

2024-12-31