Time-Average Control of Martingale Problems: Existence of a Stationary Solution

Abstract

This paper studies the average cost for controlled systems via the martingale problem for their generator. The stationary distributions for these processes on the product of the state and control spaces are characterized in terms of integration of the generator and existence of a stationary solution is established. This gives existence of a stationary control.