Research on Collaborative Optimization of OCR Semantic Correction under Adversarial Interference: An Empirical Study on Multimodal Enhancement Based on PaddleOCR and BERT

Authors

  • Yiting Chen

DOI:

https://doi.org/10.61173/8b950109

Keywords:

BERT, OCR-Corrector, PaddleOCR, OCR semantic correction

Abstract

In complex-scene OCR recognition, semantic deviations caused by local interference seriously threaten system reliability. This study constructs a correction framework integrating PaddleOCR and BERT. Through controlled interference experiments (semi-transparent occlusion + stroke misdirection), 15 multi-scene samples are generated to verify the collaborative optimization efficiency. The experiment shows that the character-level accuracy of the original OCR drops to 26.67% (4/15), and increases to 60.00% (9/15) after semantic correction, with an absolute gain of 33.33%, and there is no negative correction. Typical successful cases include shape-similar character correction (e.g., "生减" → "生成") and semantic completion (e.g., "如暑" → "如果"). However, technical limitations are still exposed in connected characters ("自自" not corrected) and domain terms ("¥5,000.00" not standardized). This study proposes a multimodal enhancement strategy and open-sources a toolchain to support interference parameterization adjustment, providing a reproducible robustness benchmark for industrial scenarios.

References

[1] Tiantian91091317. OCR-Corrector: Using Language Models to Correct OCR Recognition Errors [EB/OL]. GitHub, 2023. https://github.com/tiantian91091317/OCR-Corrector

[2] Y. Piao and W. Y. Dong, “Chinese Named Entity Recognition Method Based on BERT Embedding,” Computer Engineering, vol. 46, no. 4, pp. 40-45, 52, Apr. 2020. DOI: 10.19678/ j.issn.1000-3428.0056920.

[3] Gitblog_00087, “OCR-Corrector Project Usage Tutorial,” CSDN Blog, Aug. 20, 2024. [Online]. Available: https://blog. csdn.net/gitblog_00087/article/details/142195256. [Accessed: Mar. 25, 2025].

[4] PaddleOCR Contributors, “Text Recognition Model Training - PaddleOCR Documentation,” PaddlePaddle, 2025. [Online]. Available: https://paddlepaddle.github.io/PaddleOCR/v2.10.0/ ppocr/model_train/recognition.html. [Accessed: Mar. 20, 2025].

[5] R. Ilango, “Using NLP (BERT) to Improve OCR Accuracy,” Medium: Doma, Dec. 19, 2019. [Online]. Available: https:// medium.com/doma/using-nlp-bert-to-improve-ocr-accuracy- 385c98ae174c. [Accessed: Mar. 20, 2025].

[6] Gitblog_00029. “Bert_for_Corrector: A Text Error Correction Artifact Based on BERT,” CSDN Blog, Mar. 24, 2025. [Online]. Available: https://blog.csdn.net/gitblog_00029/ article/details/137101974. [Accessed: Mar. 24, 2025].

Downloads

Published

2025-06-17