No Arabic abstract
We consider a class of stochastic control problems where the state process is a probability measure-valued process satisfying an additional martingale condition on its dynamics, called measure-valued martingales (MVMs). We establish the `classical results of stochastic control for these problems: specifically, we prove that the value function for the problem can be characterised as the unique solution to the Hamilton-Jacobi-Bellman equation in the sense of viscosity solutions. In order to prove this result, we exploit structural properties of the MVM processes. Our results also include an appropriate version of It^os lemma for controlled MVMs. We also show how problems of this type arise in a number of applications, including model-independent derivatives pricing, the optimal Skorokhod embedding problem, and two player games with asymmetric information.
The large-time behavior of a nonlinearly coupled pair of measure-valued transport equations with discontinuous boundary conditions, parameterized by a positive real-valued parameter $lambda$, is considered. These equations describe the hydrodynamic or fluid limit of many-server queues with reneging (with traffic intensity $lambda$), which model phenomena in diverse disciplines, including biology and operations research. For a broad class of reneging distributions with finite mean and service distributions with finite mean and hazard rate function that is either decreasing or bounded away from zero and infinity, it is shown that if the fluid equations have a unique invariant state, then the Dirac measure at this state is the unique random fixed point of the fluid equations, which implies that the stationary distributions of scaled $N$-server systems converge to the unique invariant state of the corresponding fluid equations. Moreover, when $lambda e 1$, it is shown that the solution to the fluid equation starting from any initial condition converges to this unique invariant state in the large time limit. The proof techniques are different under the two sets of assumptions on the service distribution. When the hazard rate function is decreasing, a reformulation of the dynamics in terms of a certain renewal equation is used, in conjunction with recursive asymptotic estimates. When the hazard rate function is bounded away from zero and infinity, the proof uses an extended relative entropy functional as a Lyapunov function. Analogous large-time convergence results are also established for a system of coupled measure-valued equations modeling a multiclass queue.
This paper investigates sufficient conditions for a Feynman-Kac functional up to an exit time to be the generalized viscosity solution of a Dirichlet problem. The key ingredient is to find out the continuity of exit operator under Skorokhod topology, which reveals the intrinsic connection between overfitting Dirichlet boundary and fine topology. As an application, we establish the sub and supersolutions for a class of non-stationary HJB (Hamilton-Jacobi-Bellman) equations with fractional Laplacian operator via Feynman-Kac functionals associated to $alpha$-stable processes, which help verify the solvability of the original HJB equation.
The non-exponential Schilder-type theorem in Backhoff-Veraguas, Lacker and Tangpi [Ann. Appl. Probab., 30 (2020), pp. 1321-1367] is expressed as a convergence result for path-dependent partial differential equations with appropriate notions of generalized solutions. This entails a non-Markovian counterpart to the vanishing viscosity method. We show uniqueness of maximal subsolutions for path-dependent viscous Hamilton-Jacobi equations related to convex super-quadratic backward stochastic differential equations. We establish well-posedness for the Hamilton-Jacobi-Bellman equation associated to a Bolza problem of the calculus of variations with path-dependent terminal cost. In particular, uniqueness among lower semi-continuous solutions holds and state constraints are admitted.
We present novel martingale concentration inequalities for martingale differences with finite Orlicz-$psi_alpha$ norms. Such martingale differences with weak exponential-type tails scatters in many statistical applications and can be heavier than sub-exponential distributions. In the case of one dimension, we prove in general that for a sequence of scalar-valued supermartingale difference, the tail bound depends solely on the sum of squared Orlicz-$psi_alpha$ norms instead of the maximal Orlicz-$psi_alpha$ norm, generalizing the results of Lesigne & Volny (2001) and Fan et al. (2012). In the multidimensional case, using a dimension reduction lemma proposed by Kallenberg & Sztencel (1991) we show that essentially the same concentration tail bound holds for vector-valued martingale difference sequences.
In this paper we address an open question formulated in [17]. That is, we extend the It{^o}-Tanaka trick, which links the time-average of a deterministic function f depending on a stochastic process X and F the solution of the Fokker-Planck equation associated to X, to random mappings f. To this end we provide new results on a class of adpated and non-adapted Fokker-Planck SPDEs and BSPDEs.