Open Access
July, 1990 Partially Observed Control of Markov Processes. III
Omar Hijab
Ann. Probab. 18(3): 1099-1125 (July, 1990). DOI: 10.1214/aop/1176990737

Abstract

Let $\nu$ denote the value function of a partially observed control problem. If $\nu$ is once differentiable in a certain direction $\hat{B}$, then optimal controls are characterized by a feedback involving the directional derivative $\hat{B}\nu$. It is also shown that $\nu$ satisfies the corresponding Bellman equation, an infinite-dimensional PDE on the space of measures, in the viscosity sense of Crandall and Lions.

Citation

Download Citation

Omar Hijab. "Partially Observed Control of Markov Processes. III." Ann. Probab. 18 (3) 1099 - 1125, July, 1990. https://doi.org/10.1214/aop/1176990737

Information

Published: July, 1990
First available in Project Euclid: 19 April 2007

zbMATH: 0727.60043
MathSciNet: MR1062060
Digital Object Identifier: 10.1214/aop/1176990737

Subjects:
Primary: 60G35
Secondary: 49A10 , 93E11 , 93E20

Keywords: Filtering , Markov processes , Martingale problem , measure-valued diffusion , partially observed control

Rights: Copyright © 1990 Institute of Mathematical Statistics

Vol.18 • No. 3 • July, 1990
Back to Top