We present a high-throughput optogenetic illumination system capable of simultaneous closed-loop light delivery to specified targets in populations of moving Caenorhabditis elegans. The instrument addresses three technical challenges: it delivers tar
geted illumination to specified regions of the animals body such as its head or tail; it automatically delivers stimuli triggered upon the animals behavior; and it achieves high throughput by targeting many animals simultaneously. The instrument was used to optogenetically probe the animals behavioral response to competing mechanosensory stimuli in the the anterior and posterior soft touch receptor neurons. Responses to more than $10^4$ stimulus events from a range of anterior-posterior intensity combinations were measured. The animals probability of sprinting forward in response to a mechanosensory stimulus depended on both the anterior and posterior stimulation intensity, while the probability of reversing depended primarily on the posterior stimulation intensity. We also probed the animals response to mechanosensory stimulation during the onset of turning, a relatively rare behavioral event, by delivering stimuli automatically when the animal began to turn. Using this closed-loop approach, over $10^3$ stimulus events were delivered during turning onset at a rate of 9.2 events per worm-hour, a greater than 25-fold increase in throughput compared to previous investigations. These measurements validate with greater statistical power previous findings that turning acts to gate mechanosensory evoked reversals. Compared to previous approaches, the current system offers targeted optogenetic stimulation to specific body regions or behaviors with many-fold increases in throughput to better constrain quantitative models of sensorimotor processing.
Integration of solid state quantum emitters into nanophotonic circuits is a critical step towards fully on-chip quantum photonic based technologies. Among potential materials platforms, quantum emitters in hexagonal boron nitride have emerged over th
e last years as viable candidate. While the fundamental physical properties have been intensively studied over the last years, only few works have focused on the emitter integration into photonic resonators. Yet, for a potential quantum photonic material platform, the integration with nanophotonic cavities is an important cornerstone, as it enables the deliberate tuning of the spontaneous emission and the improved readout of distinct transitions for that quantum emitter. In this work, we demonstrate the resonant tuning of an integrated monolithic hBN quantum emitter in a photonic crystal cavity through gas condensation at cryogenic temperature. We resonantly coupled the zero phonon line of the emitter to a cavity mode and demonstrate emission enhancement and lifetime reduction, with an estimation for the Purcell factor of ~ 15.
Recent theoretical and experimental advances show that the inertia of magnetization emerges at sub-picoseconds and contributes to the ultrafast magnetization dynamics which cannot be captured intrinsically by the LLG equation. Therefore, as a general
ization, the inertial Landau-Lifshitz-Gilbert (iLLG) equation is proposed to model the ultrafast magnetization dynamics. Mathematically, the LLG equation is a nonlinear system of parabolic type with (possible) degeneracy. However, the iLLG equation is a nonlinear system of mixed hyperbolic-parabolic type with degeneracy, and exhibits more complicated structures. It behaves like a hyperbolic system at the sub-picosecond scale while behaves like a parabolic system at larger timescales. Such hybrid behaviors impose additional difficulties on designing numerical methods for the iLLG equation. In this work, we propose a second-order semi-implicit scheme to solve the iLLG equation. The second temporal derivative of magnetization is approximated by the standard centered difference scheme and the first derivative is approximated by the midpoint scheme involving three time steps. The nonlinear terms are treated semi-implicitly using one-sided interpolation with the second-order accuracy. At each step, the unconditionally unique solvability of the unsymmetric linear system of equations in the proposed method is proved with a detailed discussion on the condition number. Numerically, the second-order accuracy in both time and space is verified. Using the proposed method, the inertial effect of ferromagnetics is observed in micromagnetics simulations at small timescales, in consistency with the hyperbolic property of the model at sub-picoseconds. For long time simulations, the results of the iLLG model are in nice agreements with those of the LLG model, in consistency with the parabolic feature of the iLLG model at larger timescales.
Hexagonal boron nitride (hBN) is gaining interest for potential applications in integrated quantum nanophotonics. Yet, to establish hBN as an integrated photonic platform several cornerstones must be established, including the integration and couplin
g of quantum emitters to photonic waveguides. Supported by simulations, we study the approach of monolithic integration, which is expected to have coupling efficiencies that are 4 times higher than those of a conventional hybrid stacking strategy. We then demonstrate the fabrication of such devices from hBN and showcase the successful integration of hBN single photon emitters with a monolithic waveguide. We demonstrate coupling of single photons from the quantum emitters to the waveguide modes and on-chip detection. Our results build a general framework for monolithically integrated hBN single photon emitter and will facilitate future works towards on-chip integrated quantum photonics with hBN.
We study the stochastic bilinear minimax optimization problem, presenting an analysis of the Stochastic ExtraGradient (SEG) method with constant step size, and presenting variations of the method that yield favorable convergence. We first note that t
he last iterate of the basic SEG method only contracts to a fixed neighborhood of the Nash equilibrium, independent of the step size. This contrasts sharply with the standard setting of minimization where standard stochastic algorithms converge to a neighborhood that vanishes in proportion to the square-root (constant) step size. Under the same setting, however, we prove that when augmented with iteration averaging, SEG provably converges to the Nash equilibrium, and such a rate is provably accelerated by incorporating a scheduled restarting procedure. In the interpolation setting, we achieve an optimal convergence rate up to tight constants. We present numerical experiments that validate our theoretical findings and demonstrate the effectiveness of the SEG method when equipped with iteration averaging and restarting.
Association, aiming to link bounding boxes of the same identity in a video sequence, is a central component in multi-object tracking (MOT). To train association modules, e.g., parametric networks, real video data are usually used. However, annotating
person tracks in consecutive video frames is expensive, and such real data, due to its inflexibility, offer us limited opportunities to evaluate the system performance w.r.t changing tracking scenarios. In this paper, we study whether 3D synthetic data can replace real-world videos for association training. Specifically, we introduce a large-scale synthetic data engine named MOTX, where the motion characteristics of cameras and objects are manually configured to be similar to those in real-world datasets. We show that compared with real data, association knowledge obtained from synthetic data can achieve very similar performance on real-world test sets without domain adaption techniques. Our intriguing observation is credited to two factors. First and foremost, 3D engines can well simulate motion factors such as camera movement, camera view and object movement, so that the simulated videos can provide association modules with effective motion features. Second, experimental results show that the appearance domain gap hardly harms the learning of association knowledge. In addition, the strong customization ability of MOTX allows us to quantitatively assess the impact of motion factors on MOT, which brings new insights to the community.
Blockchain creates a secure environment on top of strict cryptographic assumptions and rigorous security proofs. It permits on-chain interactions to achieve trustworthy properties such as traceability, transparency, and accountability. However, curre
nt blockchain trustworthiness is only confined to on-chain, creating a trust gap to the physical, off-chain environment. This is due to the lack of a scheme that can truthfully reflect the physical world in a real-time and consistent manner. Such an absence hinders further real-world blockchain applications, especially for security-sensitive ones. In this paper, we propose a scheme to extend blockchain trust from on-chain to off-chain, and take trustworthy vaccine transportation as an example. Our scheme consists of 1) a Trusted Execution Environment (TEE)-enabled trusted environment monitoring system built with the Arm Cortex-M33 microcontroller that continuously senses the inside of a vaccine box through trusted sensors and generates anti-forgery data; and 2) a consistency protocol to upload the environment status data from the TEE system to blockchain in a truthful, real-time consistent, continuous and fault-tolerant fashion. Our security analysis indicates that no adversary can tamper with the vaccine in any way without being captured. We carry out an experiment to record the internal status of a vaccine shipping box during transportation, and the results indicate that the proposed system incurs an average latency of 84 ms in local sensing and processing followed by an average latency of 130 ms to have the sensed data transmitted to and available in the blockchain.
Highly constrained manipulation tasks continue to be challenging for autonomous robots as they require high levels of precision, typically less than 1mm, which is often incompatible with what can be achieved by traditional perception systems. This pa
per demonstrates that the combination of state-of-the-art object tracking with passively adaptive mechanical hardware can be leveraged to complete precision manipulation tasks with tight, industrially-relevant tolerances (0.25mm). The proposed control method closes the loop through vision by tracking the relative 6D pose of objects in the relevant workspace. It adjusts the control reference of both the compliant manipulator and the hand to complete object insertion tasks via within-hand manipulation. Contrary to previous efforts for insertion, our method does not require expensive force sensors, precision manipulators, or time-consuming, online learning, which is data hungry. Instead, this effort leverages mechanical compliance and utilizes an object agnostic manipulation model of the hand learned offline, off-the-shelf motion planning, and an RGBD-based object tracker trained solely with synthetic data. These features allow the proposed system to easily generalize and transfer to new tasks and environments. This paper describes in detail the system components and showcases its efficacy with extensive experiments involving tight tolerance peg-in-hole insertion tasks of various geometries as well as open-world constrained placement tasks.
Although deep face recognition benefits significantly from large-scale training data, a current bottleneck is the labelling cost. A feasible solution to this problem is semi-supervised learning, exploiting a small portion of labelled data and large a
mounts of unlabelled data. The major challenge, however, is the accumulated label errors through auto-labelling, compromising the training. This paper presents an effective solution to semi-supervised face recognition that is robust to the label noise aroused by the auto-labelling. Specifically, we introduce a multi-agent method, named GroupNet (GN), to endow our solution with the ability to identify the wrongly labelled samples and preserve the clean samples. We show that GN alone achieves the leading accuracy in traditional supervised face recognition even when the noisy labels take over 50% of the training data. Further, we develop a semi-supervised face recognition solution, named Noise Robust Learning-Labelling (NRoLL), which is based on the robust training ability empowered by GN. It starts with a small amount of labelled data and consequently conducts high-confidence labelling on a large amount of unlabelled data to boost further training. The more data is labelled by NRoLL, the higher confidence is with the label in the dataset. To evaluate the competitiveness of our method, we run NRoLL with a rough condition that only one-fifth of the labelled MSCeleb is available and the rest is used as unlabelled data. On a wide range of benchmarks, our method compares favorably against the state-of-the-art methods.
We tackle the crucial challenge of fusing different modalities of features for multimodal sentiment analysis. Mainly based on neural networks, existing approaches largely model multimodal interactions in an implicit and hard-to-understand manner. We
address this limitation with inspirations from quantum theory, which contains principled methods for modeling complicated interactions and correlations. In our quantum-inspired framework, the word interaction within a single modality and the interaction across modalities are formulated with superposition and entanglement respectively at different stages. The complex-valued neural network implementation of the framework achieves comparable results to state-of-the-art systems on two benchmarking video sentiment analysis datasets. In the meantime, we produce the unimodal and bimodal sentiment directly from the model to interpret the entangled decision.
