A theory of existence and uniqueness is developed for general stochastic differential mean field games with common noise. The concepts of strong and weak solutions are introduced in analogy with the theory of stochastic differential equations, and ex
istence of weak solutions for mean field games is shown to hold under very general assumptions. Examples and counter-examples are provided to enlighten the underpinnings of the existence theory. Finally, an analog of the famous result of Yamada and Watanabe is derived, and it is used to prove existence and uniqueness of a strong solution under additional assumptions.
We use a simple N-player stochastic game with idiosyncratic and common noises to introduce the concept of Master Equation originally proposed by Lions in his lectures at the Coll`ege de France. Controlling the limit N tends to the infinity of the exp
licit solution of the N-player game, we highlight the stochastic nature of the limit distributions of the states of the players due to the fact that the random environment does not average out in the limit, and we recast the Mean Field Game (MFG) paradigm in a set of coupled Stochastic Partial Differential Equations (SPDEs). The first one is a forward stochastic Kolmogorov equation giving the evolution of the conditional distributions of the states of the players given the common noise. The second is a form of stochastic Hamilton Jacobi Bellman (HJB) equation providing the solution of the optimization problem when the flow of conditional distributions is given. Being highly coupled, the system reads as an infinite dimensional Forward Backward Stochastic Differential Equation (FBSDE). Uniqueness of a solution and its Markov property lead to the representation of the solution of the backward equation (i.e. the value function of the stochastic HJB equation) as a deterministic function of the solution of the forward Kolmogorov equation, function which is usually called the decoupling field of the FBSDE. The (infinite dimensional) PDE satisfied by this decoupling field is identified with the textit{master equation}. We also show that this equation can be derived for other large populations equilibriums like those given by the optimal control of McKean-Vlasov stochastic differential equations. The paper is written more in the style of a review than a technical paper, and we spend more time and energy motivating and explaining the probabilistic interpretation of the Master Equation, than identifying the most general set of assumptions under which our claims are true.
The purpose of this paper is to provide a detailed probabilistic analysis of the optimal control of nonlinear stochastic dynamical systems of the McKean Vlasov type. Motivated by the recent interest in mean field games, we highlight the connection an
d the differences between the two sets of problems. We prove a new version of the stochastic maximum principle and give sufficient conditions for existence of an optimal control. We also provide examples for which our sufficient conditions for existence of an optimal solution are satisfied. Finally we show that our solution to the control problem provides approximate equilibria for large stochastic games with mean field interactions.
The purpose of this note is to provide an existence result for the solution of fully coupled Forward Backward Stochastic Differential Equations (FBSDEs) of the mean field type. These equations occur in the study of mean field games and the optimal control of dynamics of the McKean Vlasov type.
The purpose of this paper is to provide a complete probabilistic analysis of a large class of stochastic differential games for which the interaction between the players is of mean-field type. We implement the Mean-Field Games strategy developed anal
ytically by Lasry and Lions in a purely probabilistic framework, relying on tailor-made forms of the stochastic maximum principle. While we assume that the state dynamics are affine in the states and the controls, our assumptions on the nature of the costs are rather weak, and surprisingly, the dependence of all the coefficients upon the statistical distribution of the states remains of a rather general nature. Our probabilistic approach calls for the solution of systems of forward-backward stochastic differential equations of a McKean-Vlasov type for which no existence result is known, and for which we prove existence and regularity of the corresponding value function. Finally, we prove that solutions of the mean-field game as formulated by Lasry and Lions do indeed provide approximate Nash equilibriums for games with a large number of players, and we quantify the nature of the approximation.
Motivated by earlier work on the use of fully-coupled Forward-Backward Stochastic Differential Equations (henceforth FBSDEs) in the analysis of mathematical models for the CO2 emissions markets, the present study is concerned with the analysis of the
se equations when the generator of the forward equation has a conservative degenerate structure and the terminal condition of the backward equation is a non-smooth function of the terminal value of the forward component. We show that a general form of existence and uniqueness result still holds. When the function giving the terminal condition is binary, we also show that the flow property of the forward component of the solution can fail at the terminal time. In particular, we prove that a Dirac point mass appears in its distribution, exactly at the location of the jump of the binary function giving the terminal condition. We provide a detailed analysis of the breakdown of the Markovian representation of the solution at the terminal time.
