No Arabic abstract
We describe a mathematical models of grounded symbols in the brain. It also serves as a computational foundations for Perceptual Symbol System (PSS). This development requires new mathematical methods of dynamic logic (DL), which have overcome limitations of classical artificial intelligence and connectionist approaches. The paper discusses these past limitations, relates them to combinatorial complexity (exponential explosion) of algorithms in the past, and further to the static nature of classical logic. The new mathematical theory, DL, is a process-logic. A salient property of this process is evolution of vague representations into crisp. The paper first applies it to one aspect of PSS: situation learning from object perceptions. Then we relate DL to the essential PSS mechanisms of concepts, simulators, grounding, productivity, binding, recursion, and to the mechanisms relating grounded and amodal symbols. We discuss DL as a general theory describing the process of cognition on multiple levels of abstraction. We also discuss the implications of this theory for interactions between cognition and language, mechanisms of language grounding, and possible role of language in grounding abstract cognition. The developed theory makes experimental predictions, and will impact future theoretical developments in cognitive science, including knowledge representation, and perception-cognition interaction. Experimental neuroimaging evidence for DL and PSS in brain imaging is discussed as well as future research directions.
The deep neural nets of modern artificial intelligence (AI) have not achieved defining features of biological intelligence, including abstraction, causal learning, and energy-efficiency. While scaling to larger models has delivered performance improvements for current applications, more brain-like capacities may demand new theories, models, and methods for designing artificial learning systems. Here, we argue that this opportunity to reassess insights from the brain should stimulate cooperation between AI research and theory-driven computational neuroscience (CN). To motivate a brain basis of neural computation, we present a dynamical view of intelligence from which we elaborate concepts of sparsity in network structure, temporal dynamics, and interactive learning. In particular, we suggest that temporal dynamics, as expressed through neural synchrony, nested oscillations, and flexible sequences, provide a rich computational layer for reading and updating hierarchical models distributed in long-term memory networks. Moreover, embracing agent-centered paradigms in AI and CN will accelerate our understanding of the complex dynamics and behaviors that build useful world models. A convergence of AI/CN theories and objectives will reveal dynamical principles of intelligence for brains and engineered learning systems. This article was inspired by our symposium on dynamical neuroscience and machine learning at the 6th Annual US/NIH BRAIN Initiative Investigators Meeting.
Sensory feedback is critical to the performance of neural prostheses that restore movement control after neurological injury. Recent advances in direct neural control of paralyzed arms present new requirements for miniaturized, low-power sensor systems. To address this challenge, we developed a fully-integrated wireless sensor-brain-machine interface (SBMI) system for communicating key somatosensory signals, fingertip forces and limb joint angles, to the brain. The system consists of a tactile force sensor, an electrogoniometer, and a neural interface. The tactile force sensor features a novel optical waveguide on CMOS design for sensing. The electrogoniometer integrates an ultra low-power digital signal processor (DSP) for real-time joint angle measurement. The neural interface enables bidirectional neural stimulation and recording. Innovative designs of sensors and sensing interfaces, analog-to-digital converters (ADC) and ultra wide-band (UWB) wireless transceivers have been developed. The prototypes have been fabricated in 180nm standard CMOS technology and tested on the bench and in vivo. The developed system provides a novel solution for providing somatosensory feedback to next-generation neural prostheses.
Deep artificial neural networks have been proposed as a model of primate vision. However, these networks are vulnerable to adversarial attacks, whereby introducing minimal noise can fool networks into misclassifying images. Primate vision is thought to be robust to such adversarial images. We evaluated this assumption by designing adversarial images to fool primate vision. To do so, we first trained a model to predict responses of face-selective neurons in macaque inferior temporal cortex. Next, we modified images, such as human faces, to match their model-predicted neuronal responses to a target category, such as monkey faces. These adversarial images elicited neuronal responses similar to the target category. Remarkably, the same images fooled monkeys and humans at the behavioral level. These results challenge fundamental assumptions about the similarity between computer and primate vision and show that a model of neuronal activity can selectively direct primate visual behavior.
Although perceptual (dis)similarity between sensory stimuli seems akin to distance, measuring the Euclidean distance between vector representations of auditory stimuli is a poor estimator of subjective dissimilarity. In hearing, nonlinear response patterns, interactions between stimulus components, temporal effects, and top-down modulation transform the information contained in incoming frequency-domain stimuli in a way that seems to preserve some notion of distance, but not that of familiar Euclidean space. This work proposes that transformations applied to auditory stimuli during hearing can be modeled as a function mapping stimulus points to their representations in a perceptual space, inducing a Riemannian distance metric. A dataset was collected in a subjective listening experiment, the results of which were used to explore approaches (biologically inspired, data-driven, and combinations thereof) to approximating the perceptual map. Each of the proposed measures achieved comparable or stronger correlations with subjective ratings (r ~ 0.8) compared to state-of-the-art audio quality measures.
Self-organized criticality (SOC) refers to the ability of complex systems to evolve towards a 2nd-order phase transition at which interactions between system components lead to scale-invariant events beneficial for system performance. For the last two decades, considerable experimental evidence accumulated that the mammalian cortex with its diversity in cell types and connections might exhibit SOC. Here we review experimental findings of isolated, layered cortex preparations to self-organize towards four dynamical motifs identified in the cortex in vivo: up-states, oscillations, neuronal avalanches, and coherence potentials. During up-states, the synchronization observed for nested theta/gamma-oscillations embeds scale-invariant neuronal avalanches that exhibit robust power law scaling in size with a slope of -3/2 and a critical branching parameter of 1. This dynamical coordination, tracked in the local field potential (nLFP) and pyramidal neuron activity using 2-photon imaging, emerges autonomously in superficial layers of organotypic cortex cultures and acute cortex slices, is homeostatically regulated, displays separation of time scales, and reveals unique size vs. quiet time dependencies. A threshold operation identifies coherence potentials; avalanches that in addition maintain the precise time course of propagated synchrony. Avalanches emerge under conditions of external driving. Control parameters are established by the balance of excitation and inhibition (E/I) and the neuromodulator dopamine. This rich dynamical repertoire is not observed in dissociated cortex cultures, which lack cortical layers and exhibit dynamics similar to a 1st-order phase transition. The precise interactions between up-states, nested oscillations, avalanches, and coherence potentials in superficial cortical layers provide compelling evidence for SOC in the brain.