A successive approximation algorithm for stochastic control problems

摘要

We consider optimal stochastic control problems in which the state variables are governed by Itô equations. A successive approximation algorithm for optimal stochastic control is obtained. This algorithm, together with the existing numerical methods for parabolic or elliptic PDEs, provides numerical schemes for the solution of Bellman equations.