vix.ing · top · new · best · stats · spec

An escape time criterion for queueing networks: Asymptotic risk-sensitive control via differential games

2005/01/03 by Rami Atar, Paul Dupuis, Adam Shwartz
Mathematics · #math.PR #msc:60F10 #msc:60K25 #msc:93E20 #msc:60F17

paper · pdf

published as Math. Op. Res., 28 no. 4 p. 801-835 (2003)

arxiv created 2005/01/03 · arxiv updated 2009/12/01

Abstract

We consider the problem of risk-sensitive control of a stochastic network. In controlling such a network, an escape time criterion can be useful if one wishes to regulate the occurrence of large buffers and buffer overflow. In this paper a risk-sensitive escape time criterion is formulated, which in comparison to the ordinary escape time criteria penalizes exits which occur on short time intervals more heavily. The properties of the risk-sensitive problem are studied in the large buffer limit, and related to the value of a deterministic differential game with constrained dynamics. We prove that the game has value, and that the value is the (viscosity) solution of a PDE. For a simple network, the value is computed, demonstrating the applicability of the approach.

Related