Application of Markov Chain in Information Retrieval

Authors

  • Kecan Zhu

DOI:

https://doi.org/10.61173/xtvf2774

Keywords:

Markov chain, information retrieval, personalized recommendation

Abstract

This paper introduces the fundamental role of Markov chain algorithm in recommendation system, especially its “memory-free” property, that is the future state only depends on the current state and has nothing to do with historical data. This feature is useful for simulating user behavior on the platform. The researchers defined the concept of “status” and selected key metrics based on how users interact with search results (like likes, favorites, time spent watching videos, etc.). These indicators are crucial for building predictive models. The paper also discusses the application of Markov chains in recommendation systems, including how transfer probabilities are used to guide information retrieval behavior and population retrieval history is used to weigh these probabilities. In addition, the potential of combining Markov chains with other algorithms and models is also explored. Finally, the abstract emphasizes the importance of considering user data and privacy ethics when developing software and concludes that Markov chain algorithms are an important foundation of recommendation systems, capable of predicting user preferences and enhancing user experience. The paper will show how to use Markov chains to make more accurate predictions.

References

[1] Afeng Wang, Yiming Zhao, Yijin Chen Information Search Trail Recommendation Based on Markov Chain Model and Case-based Reasoning. Pages 228-241. In 2020 ASIS&T Asia- Pacific Regional Conference (Virtual Conference), 2021, 12-13.

[2] Gerald Benoît. Application of Markov chains in an interactive information retrieval system. Information Processing and Management, 2005, 843-857.

[3] Alexander G. Nikolaev, Sheldon H. Jacobson. Using Markov chains to analyze the effectiveness of local search algorithms. Journal of Heuristics, 2011, 160-173.

[4] Fatma Mlika, Wafa Karoui. Proposed Model to Intelligent Recommendation System based on Markov Chains and Grouping of Genres. Procedia Computer Science, 2020, 868- 877.

[5] Guihong Cao, Jian-Yun Nie, and Jing Bai. Using Markov Chains to Exploit Word Relationships in Information Retrieval. University of Montreal, 2005.

[6] Yeongwook Yang; Hong-Jun Jang; Byoungwook Kim. A Hybrid Recommender System for Sequential Recommendation: Combining Similarity Models With Markov Chains. IEEE Access (Volume: 8), 2020, 2169-3536.

[7] Green P J. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 1995, 82(4): 711-732.

[8] Yang Z, Rannala B. Bayesian phylogenetic inference using DNA sequences: a Markov Chain Monte Carlo Method. Molecular Biology & Evolution, 1997, 7: 717-724.

[9] Roberts A F M S O. Bayesian Computation Via the Gibbs Sampler and Related Markov Chain Monte Carlo Methods. Journal of the Royal Statistical Society, 1993, 55(1): 3-23.

[10] Neal Radford M. Markov Chain Sampling Methods for Dirichlet Process Mixture Models. Journal of Computational & Graphical Statistics, 2000.

Downloads

Published

2024-12-31