KIT | KIT-Bibliothek | Impressum | Datenschutz

Optimal control of piecewise deterministic Markov processes with finite time horizon

Bäuerle, N.; Rieder, U.

In this paper we study controlled Piecewise Deterministic Markov Processes with finite time horizon and unbounded rewards. Using an embedding procedure we reduce these problems to discrete-time Markov Decision Processes. Under some continuity and compactness conditions we establish the existence of an optimal policy and show that the value function is the unique solution of the Bellman equation. It is remarkable that this statement is true for unbounded rewards and without any contraction assumptions. Further conditions imply the existence of optimal nonrelaxed controls. We highlight our findings by two examples from financial mathematics.

Open Access Logo

Volltext §
DOI: 10.5445/IR/1000032908
Zugehörige Institution(en) am KIT Institut für Stochastik (STOCH)
Publikationstyp Buchaufsatz
Jahr 2010
Sprache Englisch
Identifikator ISBN: 978-1-905986-30-9
KITopen-ID: 1000032908
Erschienen in Modern Trends in Controlled Stochastic - Processes - Theory and Applications. Ed.: A. B. Piunovskiy
Verlag Luniver, Bristol
Seiten 123-143
Schlagworte Piecewise Deterministic Markov Processes, Markov Decision Process, Bellman Equation, Portfolio Problems
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page