Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userComparing extremal and thermal Explorations of Energy Landscapes
50
0
0.0
(
0
)
Authors
Stefan Boettcher
Ask ChatGPT about the research
No Arabic abstract
Using a non-thermal local search, called Extremal Optimization (EO), in conjunction with a recently developed scheme for classifying the valley structure of complex systems, we analyze a short-range spin glass. In comparison with earlier studies using a thermal algorithm with detailed balance, we determine which features of the landscape are algorithm dependent and which are inherently geometrical. Apparently a characteristic for any local search in complex energy landscapes, the time series of successive energy records found by EO also is characterized approximately by a log-Poisson statistics. Differences in the results provide additional insights into the performance of EO. In contrast with a thermal search, the extremal search visits dramatically higher energies while returning to more widely separated low-energy configurations. Two important properties of the energy landscape are independent of either algorithm: first, to find lower energy records, progressively higher energy barriers need to be overcome. Second, the Hamming distance between two consecutive low-energy records is linearly related to the height of the intervening barrier.
rate research
Read More
Disconnectivity graphs are used to visualize the minima and the lowest energy barriers between the minima of complex systems. They give an easy and intuitive understanding of the underlying energy landscape and, as such, are excellent tools for understanding the complexity involved in finding low-lying or global minima of such systems. We have developed a classification scheme that categorizes highly-degenerate minima of spin glasses based on similarity and accessibility of the individual states. This classification allows us to condense the information pertained in different dales of the energy landscape to a single representation using color to distinguish its type and a bar chart to indicate the average size of the dales at their respective energy levels. We use this classification to visualize disconnectivity graphs of small representations of different tile-planted models of spin glasses. An analysis of the results shows that different models have distinctly different features in the total number of minima, the distribution of the minima with respect to the ground state, the barrier height and in the occurrence of the different types of minimum energy dales.
Cooperative events requiring anomalously large fluctuations are a defining characteristic for the onset of glassy relaxation across many materials. The importance of such intermittent events has been noted in systems as diverse as superconductors, metallic glasses, gels, colloids, and granular piles. Here, we show that prohibiting the attainment of new record-high energy fluctuations -- by explicitly imposing a ``lid on the fluctuation spectrum -- impedes further relaxation in the glassy phase. This lid allows us to directly measure the impact of record events on the evolving system in extensive simulations of aging in such vastly distinct glass formers as spin glasses and tapped granular piles. Interpreting our results in terms of a dynamics of records succeeds in explaining the ubiquity of both, the logarithmic decay of the energy and the memory effects encoded in the scaling of two-time correlation functions of aging systems.
In this paper we investigate how gradient-based algorithms such as gradient descent, (multi-pass) stochastic gradient descent, its persistent variant, and the Langevin algorithm navigate non-convex loss-landscapes and which of them is able to reach the best generalization error at limited sample complexity. We consider the loss landscape of the high-dimensional phase retrieval problem as a prototypical highly non-convex example. We observe that for phase retrieval the stochastic variants of gradient descent are able to reach perfect generalization for regions of control parameters where the gradient descent algorithm is not. We apply dynamical mean-field theory from statistical physics to characterize analytically the full trajectories of these algorithms in their continuous-time limit, with a warm start, and for large system sizes. We further unveil several intriguing properties of the landscape and the algorithms such as that the gradient descent can obtain better generalization properties from less informed initializations.
Recently, we showed that optimization problems, both in infinite as well as in finite dimensions, for continuous variables and soft excluded volume constraints, can display entire isostatic phases where local minima of the cost function are marginally stable configurations endowed with non-linear excitations [1,2]. In this work we describe an athermal adiabatic algorithm to explore with continuity the corresponding rough high-dimensional landscape. We concentrate on a prototype problem of this kind, the spherical perceptron optimization problem with linear cost function (hinge loss). This algorithm allows to surf between isostatic marginally stable configurations and to investigate some properties of such landscape. In particular we focus on the statistics of avalanches occurring when local minima are destabilized. We show that when perturbing such minima, the system undergoes plastic rearrangements whose size is power law distributed and we characterize the corresponding critical exponent. Finally we investigate the critical properties of the unjamming transition, showing that the linear interaction potential gives rise to logarithmic behavior in the scaling of energy and pressure as a function of the distance from the unjamming point. For some quantities, the logarithmic corrections can be gauged out. This is the case of the number of soft constraints that are violated as a function of the distance from jamming which follows a non-trivial power law behavior.
Complex networks characterized by global transport processes rely on the presence of directed paths from input to output nodes and edges, which organize in characteristic linked components. The analysis of such network-spanning structures in the framework of percolation theory, and in particular the key role of edge interfaces bridging the communication between core and periphery, allow us to shed light on the structural properties of real and theoretical flow networks, and to define criteria and quantities to characterize their efficiency at the interplay between structure and functionality. In particular, it is possible to assess that an optimal flow network should look like a hairy ball, so to minimize bottleneck effects and the sensitivity to failures. Moreover, the thorough analysis of two real networks, the Internet customer-provider set of relationships at the autonomous system level and the nervous system of the worm Caenorhabditis elegans --that have been shaped by very different dynamics and in very different time-scales--, reveals that whereas biological evolution has selected a structure close to the optimal layout, market competition does not necessarily tend toward the most customer efficient architecture.
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
