Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userStability of two-dimensional Markov processes, with an application to QBD processes with an infinite number of phases
89
0
0.0
(
0
)
Ask ChatGPT about the research
No Arabic abstract
In this paper, we derive a simple drift condition for the stability of a class of two-dimensional Markov processes, for which one of the coordinates (also referred to as the {em phase} for convenience) has a well understood behaviour dependent on the other coordinate (also referred as {em level}). The first (phase) components transitions may depend on the second component and are only assumed to be eventually independent. The second (level) component has partially bounded jumps and it is assumed to have a negative drift given that the first one is in its stationary distribution. The results presented in this work can be applied to processes of the QBD (quasi-birth-and-death) type on the quarter- and on the half-plane, where the phase and level are interdependent. Furthermore, they provide an off-the-shelf technique to tackle stability issues for a class of two-dimensional Markov processes. These results set the stepping stones towards closing the existing gap in the literature of deriving easily verifiable conditions/criteria for two-dimensional processes with unbounded jumps and interdependence between the two components.
rate research
Read More
We present a central limit theorem for stationary random fields that are short-range dependent and asymptotically independent. As an application, we present a central limit theorem for an infinite family of interacting It^o-type diffusion processes.
Starting from a sequence of independent Wright-Fisher diffusion processes on $[0,1]$, we construct a class of reversible infinite dimensional diffusion processes on $DD_infty:= {{bf x}in [0,1]^N: sum_{ige 1} x_i=1}$ with GEM distribution as the reversible measure. Log-Sobolev inequalities are established for these diffusions, which lead to the exponential convergence to the corresponding reversible measures in the entropy. Extensions are made to a class of measure-valued processes over an abstract space $S$. This provides a reasonable alternative to the Fleming-Viot process which does not satisfy the log-Sobolev inequality when $S$ is infinite as observed by W. Stannat cite{S}.
We introduce and treat a class of Multi Objective Risk-Sensitive Markov Decision Processes (MORSMDPs), where the optimality criteria are generated by a multivariate utility function applied on a finite set of emph{different running costs}. To illustrate our approach, we study the example of a two-armed bandit problem. In the sequel, we show that it is possible to reformulate standard Risk-Sensitive Partially Observable Markov Decision Processes (RSPOMDPs), where risk is modeled by a utility function that is a emph{sum of exponentials}, as MORSMDPs that can be solved with the methods described in the first part. This way, we extend the treatment of RSPOMDPs with exponential utility to RSPOMDPs corresponding to a qualitatively bigger family of utility functions.
In this paper we consider the completely resonant beam equation on T^2 with cubic nonlinearity on a subspace of L^2 (T^2) which will be explained later. We establish an abstract infinite dimensional KAM theorem and apply it to the completely resonant beam equation. We prove the existence of a class of Whitney smooth small amplitude quasi-periodic solutions corresponding to finite dimensional tori.
The paper deals with a certain class of random evolutions. We develop a construction that yields an invariant measure for a continuous-time Markov process with random transitions. The approach is based on a particular way of constructing the combined process, where the generator is defined as a sum of two terms: one responsible for the evolution of the environment and the second representing generators of processes with a given state of environment. (The two operators are not assumed to commute.) The presentation includes fragments of a general theory and pays a particular attention to several types of examples: (1) a queueing system with a random change of parameters (including a Jackson network and, as a special case: a single-server queue with a diffusive behavior of arrival and service rates), (2) a simple-exclusion model in presence of a special `heavy` particle, (3) a diffusion with drift-switching, and (4) a diffusion with a randomly diffusion-type varying diffusion coefficient (including a modification of the Heston random volatility model).
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
