Ancient poetry generation based on bidirectional LSTM model neural network

Authors

  • Haosen Fang

DOI:

https://doi.org/10.61173/6524yg68

Keywords:

automatic generation of ancient poems, neural network model, attention mechanism, two-way LSTM model

Abstract

Automatic generation of ancient poems has been a research hotspot in the field of artificial intelligence, which is of great significance in cultural inheritance and literary creation. Due to the strict tonal patterns and complex structural rules of classical Chinese poetry, generating classical Chinese poetry has been a challenging task for both human poets and computer programs. In this paper, we propose a neural network model based on the introduction of an attention mechanism, which combines a bidirectional LSTM model and an attention mechanism to solve some problems in the traditional automatic generation model of ancient poems. The model is trained using the dataset of ancient poems studied by previous researchers, and the performance of the model is evaluated and analyzed by evaluating the metrics BLEU, Perplexity, Generation Effect and Linguistic Coherence. The experimental results show that the model exhibits good performance and excellent results on the task of automatic generation of ancient poems.

References

[1] Tosa, N., Obara, H., & Minoh, M. (2008). Hitch haiku: An interactive supporting system for composing haiku poem. Lecture Notes in Computer Science, 209–216. https://doi. org/10.1007/978-3-540-89222-9_26

[2] Netzer, Y. D., Gabay, D., Goldberg, Y., et al. (2009). Gaiku: Generating Haiku with Word Associations Norms. Association for Computational Linguistics.

[3] Oliveira, H. G. (2012). Poetryme: a versatile platform for poetry generation. In Proceedings of the ECAI, 21.

[4] ZHOU, C.-L., YOU, W., & DING, X.-J. (2010). Genetic algorithm and its implementation of automatic generation of Chinese songci. Journal of Software, 21(3), 427–437. https://doi. org/10.3724/sp.j.1001.2010.03596

[5] Jiang, L., & Zhou, M. (2008a). Generating Chinese couplets using a statistical Mt Approach. Proceedings of the 22nd International Conference on Computational Linguistics - COLING ’08. https://doi.org/10.3115/1599081.1599129 Dean&Francis

[6] Manurung, R., Ritchie, G., & Thompson, H. (2012). Using genetic algorithms to create meaningful poetic text. Journal of Experimental & Theoretical Artificial Intelligence, 24(1), 43–64. https://doi.org/10.1080/0952813x.2010.539029

[7] He, J., Zhou, M., & Jiang, L. (2021). Generating Chinese classical poems with Statistical Machine Translation models. Proceedings of the AAAI Conference on Artificial Intelligence, 26(1), 1650–1656. https://doi.org/10.1609/aaai.v26i1.8344

[8] Greene, E., Bodrumlu, T., & Knight, K. (2010). Automatic analysis of rhythmic poetry with applications to generation and translation. In Proceedings of the EMNLP, 524–533.

[9] Yan, R., Jiang, H., Lapata, M., Lin, S.-D., Lv, X., & Li, X. (2013). I, poet: Automatic Chinese poetry composition through a generative summarization framework under constrained optimization. In Proceedings of the IJCAI.

[10] Liu, J.-W., Liu, J.-W., & Luo, X.-L. (2021). Research progress in attention mechanism in deep learning. Chinese Journal of Engineering, 43(11), 1499-1511. https://doi. org/10.13374/j.issn2095-9389.2021.01.30.005

[11] Yu, L., Zhang, W., Wang, J., & Yu, Y. (2017). Seqgan: Sequence generative adversarial nets with policy gradient. Proceedings of the AAAI Conference on Artificial Intelligence, 31(1). https://doi.org/10.1609/aaai.v31i1.10804

[12] Yi, X., Sun, M., Li, R., & Yang, Z. (2018). Chinese poetry generation with a working memory model. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. https://doi.org/10.24963/ijcai.2018/633

[13] Liu, Z., Fu, Z., Cao, J., de Melo, G., Tam, Y.-C., Niu, C., & Zhou, J. (2019). Rhetorically controlled encoder-decoder for modern Chinese poetry generation. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. https://doi.org/10.18653/v1/p19-1192

[14] Chen, H., Yi, X., Sun, M., Li, W., Yang, C., & Guo, Z. (2019). Sentiment-controllable Chinese poetry generation. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. https://doi.org/10.24963/ijcai.2019/684

[15] Qingyun, Z., Yuansheng, F., Zhenlei, S., & Wanli, Z. (2020). Keyword extraction method for complex nodes based on TextRank algorithm. 2020 International Conference on Computer Engineering and Application (ICCEA). https://doi. org/10.1109/iccea50009.2020.00084

[16] Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780. https://doi. org/10.1162/neco.1997.9.8.1735

Downloads

Published

2024-04-16