ترغب بنشر مسار تعليمي؟ اضغط هنا

Emergence of Complex-Like Cells in a Temporal Product Network with Local Receptive Fields

77   0   0.0 ( 0 )
 نشر من قبل Karol Gregor
 تاريخ النشر 2010
  مجال البحث الهندسة المعلوماتية
والبحث باللغة English




اسأل ChatGPT حول البحث

We introduce a new neural architecture and an unsupervised algorithm for learning invariant representations from temporal sequence of images. The system uses two groups of complex cells whose outputs are combined multiplicatively: one that represents the content of the image, constrained to be constant over several consecutive frames, and one that represents the precise location of features, which is allowed to vary over time but constrained to be sparse. The architecture uses an encoder to extract features, and a decoder to reconstruct the input from the features. The method was applied to patches extracted from consecutive movie frames and produces orientation and frequency selective units analogous to the complex cells in V1. An extension of the method is proposed to train a network composed of units with local receptive field spread over a large image of arbitrary size. A layer of complex cells, subject to sparsity constraints, pool feature units over overlapping local neighborhoods, which causes the feature units to organize themselves into pinwheel patterns of orientation-selective receptive fields, similar to those observed in the mammalian visual cortex. A feed-forward encoder efficiently computes the feature representation of full images.

قيم البحث

اقرأ أيضاً

Multi-strain competition on networks is observed in many contexts, including infectious disease ecology, information dissemination or behavioral adaptation to epidemics. Despite a substantial body of research has been developed considering static, ti me-aggregated networks, it remains a challenge to understand the transmission of concurrent strains when links of the network are created and destroyed over time. Here we analyze how network dynamics shapes the outcome of the competition between an initially endemic strain and an emerging one, when both strains follow a susceptible-infected-susceptible dynamics, and spread at time scales comparable with the network evolution one. Using time-resolved data of close-proximity interactions between patients admitted to a hospital and medical health care workers, we analyze the impact of temporal patterns and initial conditions on the dominance diagram and coexistence time. We find that strong variations in activity volume cause the probability that the emerging strain replaces the endemic one to be highly sensitive to the time of emergence. The temporal structure of the network shapes the dominance diagram, with significant variations in the replacement probability (for a given set of epidemiological parameters) observed from the empirical network and a randomized version of it. Our work contributes towards the description of the complex interplay between competing pathogens on temporal networks.
71 - Yanfei Li , Tong Geng , Ang Li 2021
Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the complex neural networks, in this paper we introduce complex representation i nto the BNNs and propose Binary complex neural network -- a novel network design that processes binary complex inputs and weights through complex convolution, but still can harvest the extraordinary computation efficiency of BNNs. To ensure fast convergence rate, we propose novel BCNN based batch normalization function and weight initialization function. Experimental results on Cifar10 and ImageNet using state-of-the-art network models (e.g., ResNet, ResNetE and NIN) show that BCNN can achieve better accuracy compared to the original BNN models. BCNN improves BNN by strengthening its learning capability through complex representation and extending its applicability to complex-valued input data. The source code of BCNN will be released on GitHub.
Temporal action detection (TAD) is a challenging task which aims to temporally localize and recognize the human action in untrimmed videos. Current mainstream one-stage TAD approaches localize and classify action proposals relying on pre-defined anch ors, where the location and scale for action instances are set by designers. Obviously, such an anchor-based TAD method limits its generalization capability and will lead to performance degradation when videos contain rich action variation. In this study, we explore to remove the requirement of pre-defined anchors for TAD methods. A novel TAD model termed as Selective Receptive Field Network (SRF-Net) is developed, in which the location offsets and classification scores at each temporal location can be directly estimated in the feature map and SRF-Net is trained in an end-to-end manner. Innovatively, a building block called Selective Receptive Field Convolution (SRFC) is dedicatedly designed which is able to adaptively adjust its receptive field size according to multiple scales of input information at each temporal location in the feature map. Extensive experiments are conducted on the THUMOS14 dataset, and superior results are reported comparing to state-of-the-art TAD approaches.
We introduce a continuum model describing data losses in a single node of a packet-switched network (like the Internet) which preserves the discrete nature of the data loss process. {em By construction}, the model has critical behavior with a sharp t ransition from exponentially small to finite losses with increasing data arrival rate. We show that such a model exhibits strong fluctuations in the loss rate at the critical point and non-Markovian power-law correlations in time, in spite of the Markovian character of the data arrival process. The continuum model allows for rather general incoming data packet distributions and can be naturally generalized to consider the buffer server idleness statistics.
We provide estimates of the wave energy reaching the solar chromosphere and corona in a network-like magnetic field topology, including a coronal null point. The waves are excited by an instantaneous strong subphotospheric source and propagate throug h the subphotosphere, photosphere, chromosphere, transition region, and corona with the plasma beta and other atmospheric parameters varying by several orders of magnitude. We compare two regimes of the wave propagation: a linear and nonlinear regime. While the amount of energy reaching the corona is similar in both regimes, this energy is transmitted at different frequencies. In both cases the dominant periods of waves at each height strongly depend on the local magnetic field topology, but this distribution is only in accordance with observations in the nonlinear case.
التعليقات
جاري جلب التعليقات جاري جلب التعليقات
سجل دخول لتتمكن من متابعة معايير البحث التي قمت باختيارها
mircosoft-partner

هل ترغب بارسال اشعارات عن اخر التحديثات في شمرا-اكاديميا