Computation and applications of limits of certain non-stationary Markov chains

2023/09/20 by Samuel Awoniyi, Awoniyi, Samuel
Health Professions · #65C20 #65C50 #FOS: Mathematics #Probability (math.PR) #Quality and Safety in Healthcare

paper · pdf · doi:10.48550/arxiv.2309.10974

openalex publication_date 2023/09/20 · openalex created_date 2023/09/22 · openalex updated_date 2026/07/28

Abstract

This article describes a method for computing limits of a class of non-stationary Markov chains motivated by healthcare sojourn-time cycles. A mathematical validation of the computation method is also given. Applications are described that include predicting cycles in healthcare and very large system maintenance. An objective of this article is to hopefully foster some investigation and teaching of practical non-stationary Markov chains.

Related

• Markov chains revisited
• Approximating Performance Measures for Slowly Changing Non-stationary Markov Chains
• Algorithms for Markov Binomial Chains
• Constructing Markov chains with given dependence and marginal stationary distributions
• Accurate calculations of stationary distributions and mean first passage times in Markov renewal processes and Markov chains