Markov Renewal Processes: Definitions and Preliminary Properties

1961/12/01 by Ronald Pyke · 3 citations
Engineering · Decision Sciences · #Scheduling and Optimization Algorithms #Resource-Constrained Project Scheduling

paper · pdf · doi:10.1214/aoms/1177704863

Abstract

This paper contains the definition of and some preliminary results on Markov Renewal processes and Semi-Markov processes. The close relationship between these two types of processes is described. The concept of regularity is introduced and characterized. A classification of the states of a Markov Renewal process is described and studied.

Cited by

• Markov Renewal Processes with Finitely Many States
• The two-state random walk
• Revisiting the forward equations for inhomogeneous semi-Markov processes

Related

• Markov Renewal Processes with Finitely Many States
• Limit Theorems for Markov Renewal Processes
• Renewal and Regenerative Processes: short review
• Accurate calculations of stationary distributions and mean first passage times in Markov renewal processes and Markov chains
• On the tail decay of M/G/1-type Markov renewal processes