Intelligence-driven Quantitative Trading Strategies and Practices

Authors

  • Yujun Lu

DOI:

https://doi.org/10.61173/zx3nde82

Keywords:

machine learning, quantitative trading, reinforcement learning, portfolio optimization, ensemble learning

Abstract

 Modern financial markets generate high-volume and high-speed data. Although machine learning has improved prediction and decision-making, guidelines for implementation considering costs, governance, and robustness against regime changes remain limited. This study comprehensively summarizes how supervised learning, unsupervised learning, deep learning, ensemble learning, and reinforcement learning align with the pipeline of quantitative trading in signal generation, portfolio construction, execution, and market making. Representative models, such as support vector machines, gradient boosting trees, and long short-term memory (LSTM) networks, are associated with traditional frameworks for allocation, execution, and inventory management, forming a decision-making centered approach. A structured review and a comparative mapping under realistic constraints are used. Evaluation methods to mitigate leakage and overfitting are summarized, and backtesting with pre-screening that explicitly considers trading costs and market impact is also included. The results reveal complementary strengths: ensemble trees and support vector machines provide a robust baseline, sequential models with attention improve temporal representation, reinforcement learning aligns with the goals of sequential trading but requires careful reward design and reliable offline training, and unsupervised tools reveal patterns that support diversification.

References

[1] Gu S., Kelly B., Xiu D. Empirical asset pricing via machine learning. The Review of Financial Studies, 2020, 33(5): 2223- 2273.

[2] Carta S., Ferreira A., Podda A. S., et al. Multi-DQN: An ensemble of Deep Q-learning agents for stock market forecasting. Expert Systems with Applications, 2021, 164: 113820.

[3] Markowitz H. Portfolio Selection. Journal of Finance, 1952, 7(1): 77-91.

[4] Almgren R., Chriss N. Optimal execution of portfolio transactions. Journal of Risk, 2000, 3(2): 5-39.

[5] Avellaneda M., Stoikov S. High-frequency trading in a limit order book. Quantitative Finance, 2008, 8(3): 217-224.

[6] James G., Witten D., Hastie T., Tibshirani R., et al. An Introduction to Statistical Learning: with Applications in Python. Cham: Springer, 2023.

[7] Cortes C., Vapnik V. Support-vector networks. Machine Learning, 1995, 20(3): 273-297.

[8] Chen T., Guestrin C. XGBoost: A Scalable Tree Boosting System. In: KDD ’16. 2016: 785-794.

[9] Hochreiter S., Schmidhuber J. Long Short-Term Memory. Neural Computation, 1997, 9(8): 1735-1780.

[10] Chan E. P. Quantitative Trading: How to Build Your Own Algorithmic Trading Business. 2nd ed. Wiley, 2021.

[11] Black F., Litterman R. Global Portfolio Optimization. Financial Analysts Journal, 1992, 48(5): 28-43.

[12] Acerbi C., Tasche D. Expected Shortfall: A natural coherent alternative to Value at Risk. Economic Notes, 2002, 31(2): 379- 388.

[13] Kamara A. F., Chen E., Pan Z. An ensemble of a boosted hybrid of deep learning models and technical analysis for forecasting stock prices. Information Sciences, 2022, 594: 1-19.

[14] Yun K. K., Yoon S. W., Won D. Prediction of stock price direction using a hybrid GA-XGBoost algorithm with a three-stage feature engineering process. Expert Systems with Applications, 2021, 186: 115716.

[15] Barradas A., Canton-Croda R. M., Gibaja-Romero D. E. Identification of patterns in the stock market through unsupervised algorithms. Analytics, 2023, 2(3): 592-603.

[16] Han C., He Z., Toh A. J. W. Pairs trading via unsupervised learning. European Journal of Operational Research, 2023, 307(2): 929-947.

[17] Koratamaddi P., Wadhwani K., Gupta M., et al. Market sentiment-aware deep reinforcement learning approach for stock portfolio allocation. Engineering Science and Technology, an International Journal, 2021, 24(4): 848-859.

[18] Alameer A., Saleh H., Alshehri K. Reinforcement learning in quantitative trading: A survey. Authorea Preprints, 2022.

[19] Deepika N., Nirupama Bhat M. An efficient stock market prediction method based on Kalman filter. Journal of The Institution of Engineers (India): Series B, 2021, 102(4): 629- 644.

[20] Sunny M. A. I., Maswood M. M. S., Alharbi A. G. Deep learning-based stock price prediction using LSTM and bidirectional LSTM model. In: 2020 2nd Novel Intelligent and Leading Emerging Sciences Conference (NILES). IEEE, 2020: 87-92.

[21] Zhao Y., Yang G. Deep learning-based integrated framework for stock price movement prediction. Applied Soft Computing, 2023, 133: 109921.

[22] Jing N., Wu Z., Wang H. A hybrid model integrating deep learning with investor sentiment analysis for stock price prediction. Expert Systems with Applications, 2021, 178: 115019.

[23] Cao B., Wang S., Lin X., et al. From deep learning to LLMs: a survey of AI in quantitative investment. arXiv preprint arXiv:2503.21422, 2025.

[24] Polamuri S. R., Srinivas K., Mohan A. K. Multi-model generative adversarial network hybrid prediction algorithm for stock market prices prediction. Journal of King Saud University - Computer and Information Sciences, 2022, 34(9): 7433-7444.

[25] Sun Z., Harit A., Cristea A. I., et al. Money: Ensemble learning for stock price movement prediction via a convolutional network with adversarial hypergraph model. AI Open, 2023, 4: 165-174.

Downloads

Published

2025-10-23