Financial Time Series Forecasting Based on Long-Short Term Memory, Complete Ensemble Empirical Mode Decomposition with Adaptive Noise and Batch Normalization.

Authors

  • Yixuan Xu

DOI:

https://doi.org/10.61173/ejykaa29

Keywords:

Financial, time series forecasting, long-short term memory, batch normalization, complete ensemble empirical mode decomposition with adaptive noise

Abstract

Long-short term memory (LSTM) is a state-of-art and widely used model to forecast financial time series. However, primitive LSTM networks do not perform well due to over-fitting problems of the deep learning model and nonlinear and non-stationary characteristics of financial time series data. In addition, complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) is an outstanding data frequency decomposition technique that can decompose original time series into several intrinsic mode functions and a residue. Thus, this paper proposed a novel hybrid network CEEMDAN-LSTM-BN based on LSTM. Specifically, to avoid over-fitting, the modified LSTM-BN network consists of two LSTM layers, two Batch Normalization (BN) layers following each LSTM layer, and a dropout layer. Each of the intrinsic mode functions and the residue would be processed by CEEMDAN-LSTM-BN and the final prediction results are obtained by reconstructing each predictive series. The advantages of the proposed CEEMDANLSTM-BN networks are verified by comparing them to primitive LSTM, other hybrid models, and some famous machine learning models. Moreover, the robustness of the networks is assessed by numerical experiments on different stock indices datasets.

References

[1] Introduction to time series and forecasting [M]. New York, NY: Springer New York, 2002.

[2] Poon S H, Granger C W J. Forecasting volatility in financial markets: A review [J]. Journal of economic literature, 2003, 41(2): 478-539.

[3] Abu-Mostafa Y S, Atiya A F. Introduction to financial forecasting [J]. Applied intelligence, 1996, 6: 205-213.

[4] Qin S J, Chiang L H. Advances and opportunities in machine learning for process data analytics [J]. Computers & Chemical Engineering, 2019, 126: 465-473.

[5] Chen Y, Hao Y. A feature weighted support vector machine and K-nearest neighbor algorithm for stock market indices prediction [J]. Expert Systems with Applications, 2017, 80: 340- 355.

[6] Guresen E, Kayakutlu G, Daim T U. Using artificial neural network models in stock market index prediction [J]. Expert systems with Applications, 2011, 38(8): 10389-10397.

[7] Rezaei H, Faaljou H, Mansourfar G. Stock price prediction using deep learning and frequency decomposition [J]. Expert Systems with Applications, 2021, 169: 114332.

[8] Guresen E, Kayakutlu G, Daim T U. Using artificial neural network models in stock market index prediction [J]. Expert systems with Applications, 2011, 38(8): 10389-10397.

[9] Kim K, Han I. Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index [J]. Expert systems with Applications, 2000, 19(2): 125-132.

[10] Kamijo K, Tanigawa T. Stock price pattern recognition-a recurrent neural network approach [C]//1990 IJCNN international joint conference on neural networks. IEEE, 1990: 215-221.

[11] Fischer T, Krauss C. Deep learning with long short-term memory networks for financial market predictions [J]. European journal of operational research, 2018, 270(2): 654-669.

[12] Nelson D M Q, Pereira A C M, De Oliveira R A. Stock market’s price movement prediction with LSTM neural networks [C]//2017 International joint conference on neural networks (IJCNN). Ieee, 2017: 1419-1426.

[13] Wu Z, Huang N E. Ensemble empirical mode decomposition: a noise-assisted data analysis method [J]. Advances in adaptive data analysis, 2009, 1(01): 1-41.

[14] Colominas M A, Schlotthauer G, Torres M E. Improved complete ensemble EMD: A suitable tool for biomedical signal processing [J]. Biomedical Signal Processing and Control, 2014, 14: 19-29.

[15] Hochreiter S, Schmidhuber J. Long short-term memory [J]. Neural computation, 1997, 9(8): 1735-1780.

[16] Hinton G E, Srivastava N, Krizhevsky A, et al. Improving neural networks by preventing co-adaptation of feature detectors [J]. arXiv preprint arXiv:1207.0580, 2012.

[17] Ioffe S, Szegedy C. Batch normalization: Accelerating deep network training by reducing internal covariate shift [C]// International conference on machine learning. pmlr, 2015: 448- 456.

[18] Sapankevych N I, Sankar R. Time series prediction using support vector machines: a survey [J]. IEEE computational intelligence magazine, 2009, 4(2): 24-38.

Downloads

Published

2024-09-15