Research and Analysis of 3D Reconstruction Technology under the Influence of Deep Learning

Authors

  • Ce Gao

DOI:

https://doi.org/10.61173/6gwpvq80

Keywords:

3D Reconstruction, Deep Learning, Neural Implicit Fields, 3D Gaussian Splatting, Simultaneous Localization and Mapping

Abstract

As a key technology connecting the physical world and the digital world, 3D reconstruction has wide-ranging applications in fields such as autonomous driving, virtual reality, and industrial inspection. Traditional methods rely on handcrafted features and geometric constraints, and suffer from limitations like poor robustness and low integrity in complex scenarios. In recent years, deep learning technology, with its powerful feature learning and context modeling capabilities, has brought about revolutionary advancements to 3D reconstruction. This paper systematically reviews the research progress of deep learning-driven 3D reconstruction technology, focuses on analyzing core innovations including fusion architectures, attention mechanisms, and lightweight networks, and conducts an in-depth discussion on the breakthroughs and integration trends of cutting-edge representation technologies such as neural implicit fields and 3D Gaussian splatting. Furthermore, the paper points out that current technologies still face challenges such as generalization capability, dynamic scene processing, and computational overhead, and looks forward to future development directions including unified implicit-explicit modeling, lightweight deployment, and general-purpose 3D vision foundation models. It provides important references for in-depth understanding and promotion of the development of 3D reconstruction technology.

References

[1] Zhou Q H. Research on 3D reconstruction based on multiple end-to-end deep learning model. Beijing: Beijing University of Posts and Telecommunications, 2022.

[2] Feng Y J. Research of MVS 3D Reconstruction Algorithm Based on Deep Learning. Taiyuan: Shanxi University, 2023.

[3] Yang S. Research and Implementation of 3D Reconstruction Algorithm Based on Deep Learning. Guiyang: Guizhou Normal University, 2022.

[4] Deng X. Research on Deep Learning Based Monocular 3D Reconstruction. Mianyang: Southwest University of Science and Technology, 2023.

[5] Tan Z, Niu Z Y, Zhang J P, et al. New opportunities in SLAM-Gaussian splatting technology. Journal of Image and Graphics, 2025, 30(6): 1792-1807.

[6] Im S, Jeon H G, Lin S, Kweon I S. DPSNet: End-to-end Deep Plane Sweep Stereo. arXiv preprint arXiv:1905.00538, 2019.

[7] Nguyen H, Wang Y Z, Wang Z Y. Single-Shot 3D Shape Reconstruction Using Structured Light and Deep Convolutional Neural Networks. Sensors, 2020, 20(13): 3718.

[8] Schonberger J L, Frahm J M. Structure-from-Motion Revisited. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016: 4104-4113.

[9] Zhu J, Peng B, Li W Q, et al. Multi-View Stereo with Dean&Francis ISSN 2959-6157 Transformer. arXiv preprint arXiv:2112.00336, 2021.

[10] Müller T, Evans A, Schied C, et al. Instant Neural Graphics Primitives with a Multiresolution Hash Encoding. ACM Transactions on Graphics, 2022, 41(4): Article 102.

[11] Li M R, Zhou Y M, Jiang G A, et al. DDN-SLAM: Realtime Dense Dynamic Neural Implicit SLAM. arXiv preprint arXiv:2401.01545, 2024.

[12] Ji X S, Zhu Y, Yang J L, et al. Three-Dimensional Reconstruction Method Based on Multiscale S-Density Strategy. Laser & Optoelectronics Progress, 2025, 62(4): 0411002.

[13] Xu Z H, Deng B L, Zhang J Y. Neural Implicit Surface Parameterization and Texture Reconstruction. Journal of Computer-Aided Design & Computer Graphics, 2024, 3(*): Article ID 10.3724/SFJ.1089.2024-00606.

[14] Ying W, Hu K W, Ahmed A, et al. Accurate Fruit Phenotype Reconstruction via Geometry-Smooth Neural Implicit Surface. Agriculture, 2024, 14(12): 2325.

[15] Pumarola A, Corona E, Pons-Moll G, et al. D-NeRF: Neural Radiance Fields for Dynamic Scenes. Proceedings of the IEEE/ CVF Conference on Computer Vision and Pattern Recognition. 2021: 1-10.

[16] Keetha N, Karhade J, Jatavallabhula K M, et al. SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2024: 1-10.

[17] Luiten J, Kopanas G, Leibe B, et al. Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, Early Access. DOI: 10.1109/TPAMI.2024.3421209.

Downloads

Published

2025-12-19