vix.ing · top · new · best · stats · spec

Absorbing Markov Decision Processes: Geometric Properties and Sufficiency of Finite Mixtures of Deterministic Policies

2025/12/19 by Francois Dufour, Dufour, Francois, Tomás Prieto-Rumeau +1
Business, Management and Accounting · Economics, Econometrics and Finance · #Advanced Queuing Theory Analysis #Economic Policies and Impacts #FOS: Mathematics #Optimization and Control (math.OC) #Supply Chain and Inventory Management

paper · doi:10.48550/arxiv.2512.17511

openalex publication_date 2025/12/19 · openalex created_date 2025/12/23 · openalex updated_date 2026/07/28

Abstract

In this paper we investigate several geometric properties of the set of occupancy measures. In particular, we analyse the structure of the faces generated by a given occupancy measure, together with their relative algebraic interior. We also determine the affine hulls of these faces and describe the associated parallel linear subspaces. It is shown that these structures can be fully characterised in terms of the parameters that define the underlying Markov decision process (MDP). Moreover, we establish that the class of finite mixtures of deterministic stationary policies constitutes a sufficient class of policies for uniformly absorbing MDPs with a measurable state space and multiple criteria. We also provide a characterisation of the minimal order required for a finite mixture of deterministic stationary policies to represent the performance vector of an arbitrary policy.

Citations

Related