Recurrence Conditions in Denumerable State Markov Decision Processes

This paper considers an undiscounted semi-Markov decision problem with denumerable state space and compact metric action spaces. Recurrence conditions on the transition probability matrices associated with the stationary policies are considered and relations between these conditions are established. Also it is shown that under each of these conditions the optimality equation for the average costs has a bounded solution.