No Arabic abstract
This paper is concerned with exponential moments of integral-of-quadratic functions of quantum processes with canonical commutation relations of position-momentum type. Such quadratic-exponential functionals (QEFs) arise as robust performance criteria in control problems for open quantum harmonic oscillators (OQHOs) driven by bosonic fields. We develop a randomised representation for the QEF using a Karhunen-Loeve expansion of the quantum process on a bounded time interval over the eigenbasis of its two-point commutator kernel, with noncommuting position-momentum pairs as coefficients. This representation holds regardless of a particular quantum state and employs averaging over an auxiliary classical Gaussian random process whose covariance operator is specified by the commutator kernel. This allows the QEF to be related to the moment-generating functional of the quantum process and computed for multipoint Gaussian states. For stationary Gaussian quantum processes, we establish a frequency-domain formula for the QEF rate in terms of the Fourier transform of the quantum covariance kernel in composition with trigonometric functions. A differential equation is obtained for the QEF rate with respect to the risk sensitivity parameter for its approximation and numerical computation. The QEF is also applied to large deviations and worst-case mean square cost bounds for OQHOs in the presence of statistical uncertainty with a quantum relative entropy description.
This paper is concerned with quadratic-exponential functionals (QEFs) as risk-sensitive performance criteria for linear quantum stochastic systems driven by multichannel bosonic fields. Such costs impose an exponential penalty on quadratic functions of the quantum system variables over a bounded time interval, and their minimization secures a number of robustness properties for the system. We use an integral operator representation of the QEF, obtained recently, in order to compute its asymptotic infinite-horizon growth rate in the invariant Gaussian state when the stable system is driven by vacuum input fields. The resulting frequency-domain formulas express the QEF growth rate in terms of two spectral functions associated with the real and imaginary parts of the quantum covariance kernel of the system variables. We also discuss the computation of the QEF growth rate using homotopy and contour integration techniques and provide two illustrations including a numerical example with a two-mode oscillator.
This paper is concerned with multimode open quantum harmonic oscillators and quadratic-exponential functionals (QEFs) as quantum risk-sensitive performance criteria. Such systems are described by linear quantum stochastic differential equations driven by multichannel bosonic fields. We develop a finite-horizon expansion for the system variables using the eigenbasis of their two-point commutator kernel with noncommuting position-momentum pairs as coefficients. This quantum Karhunen-Loeve expansion is used in order to obtain a Girsanov type representation for the quadratic-exponential functions of the system variables. This representation is valid regardless of a particular system-field state and employs the averaging over an auxiliary classical Gaussian random process whose covariance operator is defined in terms of the quantum commutator kernel. We use this representation in order to relate the QEF to the moment-generating functional of the system variables. This result is also specified for the invariant multipoint Gaussian quantum state when the oscillator is driven by vacuum fields.
This paper is concerned with a risk-sensitive optimal control problem for a feedback connection of a quantum plant with a measurement-based classical controller. The plant is a multimode open quantum harmonic oscillator driven by a multichannel quantum Wiener process, and the controller is a linear time invariant system governed by a stochastic differential equation. The control objective is to stabilize the closed-loop system and minimize the infinite-horizon asymptotic growth rate of a quadratic-exponential functional (QEF) which penalizes the plant variables and the controller output. We combine a frequency-domain representation of the QEF growth rate, obtained recently, with variational techniques and establish first-order necessary conditions of optimality for the state-space matrices of the controller.
This brief article gives an overview of quantum mechanics as a {em quantum probability theory}. It begins with a review of the basic operator-algebraic elements that connect probability theory with quantum probability theory. Then quantum stochastic processes is formulated as a generalization of stochastic processes within the framework of quantum probability theory. Quantum Markov models from quantum optics are used to explicitly illustrate the underlying abstract concepts and their connections to the quantum regression theorem from quantum optics.
While deep neural networks (DNNs) and Gaussian Processes (GPs) are both popularly utilized to solve problems in reinforcement learning, both approaches feature undesirable drawbacks for challenging problems. DNNs learn complex nonlinear embeddings, but do not naturally quantify uncertainty and are often data-inefficient to train. GPs infer posterior distributions over functions, but popular kernels exhibit limited expressivity on complex and high-dimensional data. Fortunately, recently discovered conjugate and neural tangent kernel functions encode the behavior of overparameterized neural networks in the kernel domain. We demonstrate that these kernels can be efficiently applied to regression and reinforcement learning problems by analyzing a baseline case study. We apply GPs with neural network dual kernels to solve reinforcement learning tasks for the first time. We demonstrate, using the well-understood mountain-car problem, that GPs empowered with dual kernels perform at least as well as those using the conventional radial basis function kernel. We conjecture that by inheriting the probabilistic rigor of GPs and the powerful embedding properties of DNNs, GPs using NN dual kernels will empower future reinforcement learning models on difficult domains.