Introduction to Stochastic Dynamic Programming

Review of the book
In this book, the preliminary theory and practical applications of probabilistic dynamic programming are reviewed. In the first part of this book, a study on the types of models with the number of stages and their applications has been examined. In the next sections, models with an infinite number of steps will be examined. In the second part, the discount rate of return is discussed, in the third part, the minimization of non-negative costs, in the 4th part, the maximization of the return rate, and in the 5th part, the long-term average rate of return is examined. In each of the desired sections, the method of checking the existence of the optimal policy is first analyzed, and then the order of finding the optimal policy is presented. In the last two sections, two very specific models are discussed. In section 6, types of dynamic scheduling models and in section 7, one of the branched types of Multiproject bandit are examined. To read this book, the reader is expected to have a basic knowledge of dynamic programming.

Table of Contents
The things that are stated in this book are as follows:
1- Models with limited stages
2- Discounted dynamic planning
3- negative dynamic planning – minimizing costs
4- Positive dynamic planning – profit maximization
5- Profit criteria
6- Possible timing
7- Bandit process