ترغب بنشر مسار تعليمي؟ اضغط هنا

Unstable Dynamics of Adaptation in Unknown Environment due to Novelty Seeking

89   0   0.0 ( 0 )
 نشر من قبل Arkady Zgonnikov
 تاريخ النشر 2013
  مجال البحث فيزياء
والبحث باللغة English




اسأل ChatGPT حول البحث

Learning and adaptation play great role in emergent socio-economic phenomena. Complex dynamics has been previously found in the systems of multiple learning agents interacting via a simple game. Meanwhile, the single agent adaptation is considered trivially stable. We advocate the idea that adopting a more complex model of the individual behavior may result in a more diverse spectrum of macro-level behaviors. We develop an adaptation model based on the reinforcement learning framework extended by an additional processing channel. We scrutiny the dynamics of the single agent adapting to the unknown environment; the agent is biased by novelty seeking, the intrinsic inclination for exploration. We demonstrate that the behavior of the novelty-seeking agent may be inherently unstable. One of the surprising results is that under certain conditions the increase of the novelty-seeking level may cause the agent to switch from the non-rational to the strictly rational behavior. Our results give evidence to the hypothesis that the intrinsic motives of agents should be paid no less attention than the extrinsic ones in the models of complex socio-economic systems.



قيم البحث

اقرأ أيضاً

The quantitative study of traffic dynamics is crucial to ensure the efficiency of urban transportation networks. The current work investigates the spatial properties of congestion, that is, we aim to characterize the city areas where traffic bottlene cks occur. The analysis of a large amount of real road networks in previous works showed that congestion points experience spatial abrupt transitions, namely they shift away from the city center as larger urban areas are incorporated. The fundamental ingredient behind this effect is the entanglement of central and arterial roads, embedded in separated geographical regions. In this paper we extend the analysis of the conditions yielding abrupt transitions of congestion location. First, we look into the more realistic situation in which arterial and central roads, rather than lying on sharply separated regions, present spatial overlap. It results that this affects the position of bottlenecks and introduces new possible congestion areas. Secondly, we pay particular attention to the role played by the edge distribution, proving that it allows to smooth the transitions profile, and so to control the congestion displacement. Finally, we show that the aforementioned phenomenology may be recovered also as a consequence of a discontinuity in the nodes density, in a domain with uniform connectivity. Our results provide useful insights for the design and optimization of urban road networks, and the management of the daily traffic.
Understanding the social conditions that tend to increase or decrease polarization is important for many reasons. We study a network-structured agent-based model of opinion dynamics, extending a model previously introduced by Flache and Macy (2011), who found that polarization appeared to increased with the introduction of long-range ties but decrease with the number of salient opinions, which they called the populations cultural complexity. We find the following. First, polarization is strongly path dependent and sensitive to stochastic variation. Second, polarization depends strongly on the initial distribution of opinions in the population. In the absence of extremists, polarization may be mitigated. Third, noisy communication can drive a population toward more extreme opinions and even cause acute polarization. Finally, the apparent reduction in polarization under increased cultural complexity arises via a particular property of the polarization measurement, under which a population containing a wider diversity of extreme views is deemed less polarized. This work has implications for understanding the population dynamics of beliefs, opinions, and polarization, as well as broader implications for the analysis of agent-based models of social phenomena.
205 - Ingo Piepers 2014
A finite-time singularity accompanied by log-periodic oscillations shaped the war dynamics and development of the International System during the period 1495 - 1945. The identification of this singularity provides us with a perspective to penetrate a nd decode the dynamics of the International System. Various regularities in the dynamics of the International System can be identified. These regularities are remarkably consistent, and can be attributed to the connectivity and the growth of connectivity of the International System.
Understanding the mechanisms responsible for the emergence and evolution of oscillations in traffic flow has been subject to intensive research by the traffic flow theory community. In our previous work, we proposed a new mechanism to explain the gen eration of traffic oscillations: traffic instability caused by the competition between speed adaptation and the cumulative effect of stochastic factors. In this paper, by conducting a closer examination of car following data obtained in a 25-car platoon experiment, we discovered that the speed difference plays a more important role on car-following dynamics than the spacing, and when its amplitude is small, the growth of oscillations is mainly determined by the stochastic factors that follow the mean reversion process; when its amplitude increases, the growth of the oscillations is determined by the competition between the stochastic factors and the speed difference. An explanation is then provided, based on the above findings, to why the speed variance in the oscillatory traffic grows in a concave way along the platoon. Finally, we proposed a mode-switching stochastic car-following model that incorporates the speed adaptation and spacing indifference behaviors of drivers, which captures the observed characteristics of oscillation and discharge rate. Sensitivity analysis shows that reaction delay only has slight effect but indifference region boundary has significant on oscillation growth rate and discharge rate.
104 - Guy Katriel 2018
We explore simple models aimed at the study of social contagion, in which contagion proceeds through two stages. When coupled with demographic turnover, we show that two-stage contagion leads to nonlinear phenomena which are not present in the basic `classical models of mathematical epidemiology. These include: bistability, critical transitions, endogenous oscillations, and excitability, suggesting that contagion models with stages could account for some aspects of the complex dynamics encountered in social life. These phenomena, and the bifurcations involved, are studied by a combination of analytical and numerical means.
التعليقات
جاري جلب التعليقات جاري جلب التعليقات
سجل دخول لتتمكن من متابعة معايير البحث التي قمت باختيارها
mircosoft-partner

هل ترغب بارسال اشعارات عن اخر التحديثات في شمرا-اكاديميا