Overview

This book presents the second part of a two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes. As in Volume I (AM 30 Discrete-Time Markov Control Processes: Basic Optimality Criteria), interest is mainly confined to MCPs with Borel state and control spaces. However, an important feature of the present volume is that is it essentially self-contained and can be read independently of Volume I, because the assumptions on the control models are usually different.