Exploring Fixed Points in Markov Chains: A Mathematical Perspective
DOI:
https://doi.org/10.62054/ijdm/0203.03Abstract
Markov chains play a crucial role in modeling stochastic processes across mathematics, computer science and the applied sciences. This study investigates the relationship between fixed-point theory and Markov chains. The objectives are threefold: to analyze how stationary distributions in Markov chains can be interpreted as fixed points, to illustrate the connection between stochastic
iterative methods and Page Rank type algorithms and fixed-point theorems and to provide concrete examples that demonstrate these links. The methodology adopted involves a literature-based review of fixed point theory and Markov chains, followed
by mathematical formulation and worked examples. The results show that stationary distributions of Markov chains satisfy fixed-point equations and can be computed iteratively under contraction-type conditions. A numerical case study demonstrates convergence of an iterative scheme to the stationary distribution. These findings reinforce the role of fixed-point theory in stochastic analysis and provide tools for practical applications such as PageRank and Monte Carlo simulations
References
Adewale, O. K., Ayodele, S. O., Loyinmi, A. C., Oyelade, B. E., Iluno, C., Oyem, A., & Adewale, G. A. (2025). Metric Space with binary operation, Advances in Mathematics: Scientific Journal, 4(2), 211-225.
Ayodele, S. O., Adewale, O. K., Oyelade, B. E., Adeyemi, V. O., Aribike, E. E., Raji, S. A., & Adewale, G. A. (2025). Fixed Point Theorems on Convex Sb-Metric Space, Advances in Mathematics: Scientific Journal, 14(2), 123-140.
Adewale, O. Kayode., Ayodele, S. Olusola., Oyelade, B. Eriwa., Akintunde, O. Victoria., E. E. Aribike, Raji, S. Adedoyin., & Adewale, G. Adedayo. (2024). Some Fixed Point Theorems in Convex S-Metric Space, International Journal of Development Mathematics, 1(3), (2024), 101-111.
Adewale, O. K.& Akinremi, B. V. (2013). Fixed point theorem of Zamfirescu’s type in generalized cone metric spaces, International Journal of Advanced Mathematical Science, 1, 104-108.
Agarwal, R. P., Meehan, D. & O’Regan, D. (2001). Fixed point theory and applications, Cambridge University Press, 141.
Agarwal, R. P., O’Regan, D.& Sahu, D. R. (2009). Fixed point theory for Lipschitzian type mappings with applications, Springer Science& Business Media. LLC.
Zhou, M., Liu, XL. & Randenovi´c, S. (2017). S-contractive type mappings in S-metric spaces. Journal of Nonlinear Sciences and Applications, 10, 1613-1639.
Banach, S. (1922). Sur les op´erations dans les ensembles abstraits et leur application aux ´equations int´egrales. Fundamenta Mathematicae, 3(1), 133–181.
Fr´echet, M. (1906). Sur quelques points du calcul fonctionnel. Rendiconti del Circolo Matematico di Palermo, 22(1), 1–74.
Ege, I. (2015). Fixed point theorems in cone metric spaces. Fixed Point Theory and Applications, 2015(1).
Ege, I. (2016). New generalizations in metric fixed point theory. Journal of Mathematics, 2016(1).
Ege, I. (2017). Recent advances in S-metric and cone metric spaces. Turkish Journal of Mathematics, 41(5), 1233–1245.
Ege, I., & Karaca, I. (2018). S-multiplicative metric spaces and fixed point results. Journal of Nonlinear Science, 28(2), 357–374.
Adewale, A., & Iluno, E. (2022). Generalized contraction mappings in new metric-type spaces. African Journal of Mathematics, 13(4), 200–215.
Adewale, A., Ege, I., & Karaca, I. (2019). Some fixed point theorems in generalized metric spaces. Applied Mathematics Letters, 94, 82–89.
Norris, J. R. (1998). Markov Chains. Cambridge University Press.
Granas, A., & Dugundji, J. (2003). Fixed Point Theory. Springer.
Meyn, S. P.,& Tweedie, R. L. (2009). Markov Chains and Stochastic
Stability. Cambridge University Press
Downloads
Published
Data Availability Statement
Not applicable
Issue
Section
License
Copyright (c) 2025 International Journal of Development Mathematics (IJDM)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors are solely responsible for obtaining permission to reproduce any copyrighted material contained in the manuscript as submitted. Any instance of possible prior publication in any form must be disclosed at the time the manuscript is submitted and a
copy or link to the publication must be provided.
The Journal articles are open access and are distributed under the terms of the Creative
Commons Attribution-NonCommercial-NoDerivs 4.0 IGO License, which permits use,
distribution, and reproduction in any medium, provided the original work is properly cited.
No modifications or commercial use of the articles are permitted.
