The Value Functions of Markov Decision Processes

2015/11/07 by Ehud Lehrer, Lehrer, Ehud, Eilon Solan +3
Mathematics · #90C40 #FOS: Mathematics #Probability (math.PR) #math.PR #msc:90C40

paper · pdf · doi:10.48550/arxiv.1511.02377

arxiv created 2015/11/07 · arxiv updated 2015/11/10

Abstract

We provide a full characterization of the set of value functions of Markov decision processes.

Related

• A Notation for Markov Decision Processes
• A Note on Optimization Formulations of Markov Decision Processes
• Partially Observed Markov Decision Processes. Problem Sets and Internet Supplement
• On the Expressivity of Multidimensional Markov Reward
• Multiplicative Rewards in Markovian Models