We describe a computational method for constructing a coarse combinatorial model of some dynamical system in which the macroscopic states are given by elementary cycling motions of the system. Our method is in particular applicable to time series data. We illustrate the construction by a perturbed double well Hamiltonian as well as the Lorenz system.
Deep learning models evolve through training to learn the manifold in which the data exists to satisfy an objective. It is well known that evolution leads to different final states which produce inconsistent predictions of the same test data points. This calls for techniques to be able to empirically quantify the difference in the trajectories and highlight problematic regions. While much focus is placed on discovering what models learn, the question of how a model learns is less studied beyond theoretical landscape characterizations and local geometric approximations near optimal conditions. Here, we present a toolkit for the Dynamical Organization Of Deep Learning Loss Landscapes, or DOODL3. DOODL3 formulates the training of neural networks as a dynamical system, analyzes the learning process, and presents an interpretable global view of trajectories in the loss landscape. Our approach uses the coarseness of topology to capture the granularity of geometry to mitigate against states of instability or elongated training. Overall, our analysis presents an empirical framework to extract the global dynamics of a model and to use that information to guide the training of neural networks.
Since its inception, control of data congestion on the Internet has been based on stochastic models. One of the first such models was Random Early Detection. Later, this model was reformulated as a dynamical system, with the average queue sizes at a routers buffer being the states. Recently, the dynamical model has been generalized to improve global stability. In this paper we review the original stochastic model and both nonlinear models of Random Early Detection with a two-fold objective: (i) illustrate how a random model can be smoothed out to a deterministic one through data aggregation, and (ii) how this translation can shed light into complex processes such as the Internet data traffic. Furthermore, this paper contains new materials concerning the occurrence of chaos, bifurcation diagrams, Lyapunov exponents and global stability robustness with respect to control parameters. The results reviewed and reported here are expected to help design an active queue management algorithm in real conditions, that is, when system parameters such as the number of users and the round-trip time of the data packets change over time. The topic also illustrates the much-needed synergy of a theoretical approach, practical intuition and numerical simulations in engineering.
We investigate methods for learning partial differential equation (PDE) models from spatiotemporal data under biologically realistic levels and forms of noise. Recent progress in learning PDEs from data have used sparse regression to select candidate terms from a denoised set of data, including approximated partial derivatives. We analyze the performance in utilizing previous methods to denoise data for the task of discovering the governing system of partial differential equations (PDEs). We also develop a novel methodology that uses artificial neural networks (ANNs) to denoise data and approximate partial derivatives. We test the methodology on three PDE models for biological transport, i.e., the advection-diffusion, classical Fisher-KPP, and nonlinear Fisher-KPP equations. We show that the ANN methodology outperforms previous denoising methods, including finite differences and polynomial regression splines, in the ability to accurately approximate partial derivatives and learn the correct PDE model.
Even the most simplified models of falling and gliding bodies exhibit rich nonlinear dynamical behavior. Taking a global view of the dynamics of one such model, we find an attracting invariant manifold that acts as the dominant organizing feature of trajectories in velocity space. This attracting manifold captures the final, slowly changing phase of every passive descent, providing a higher-dimensional analogue to the concept of terminal velocity, the terminal velocity manifold. Within the terminal velocity manifold in extended phase space, there is an equilibrium submanifold with equilibria of alternating stability type, with different stability basins. In this work, we present theoretical and numerical methods for approximating the terminal velocity manifold and discuss ways to approximate falling and gliding motion in terms of these underlying phase space structures.
In this work, we investigate the system of three species ecological model involving one predator-prey subsystem coupling with a generalist predator with negative effect on the prey. Without diffusive terms, all global dynamics of its corresponding reaction equations are proved analytically for all classified parameters. With diffusive terms, the transitions of different spatial homogeneous solutions, the traveling wave solutions, are showed by higher dimensional shooting method, the Wazewski method. Some interesting numerical simulations are performed, and biological implications are given.