Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userLearning Coded Apertures for Time-Division Multiplexing Light Field Display
105
0
0.0
(
0
)
Added by
Chang-Le Liu
Publication date
2021
fields
Electronic Engineering
and research's language is
English
Ask ChatGPT about the research
No Arabic abstract
Conventional stereoscopic displays suffer from vergence-accommodation conflict and cause visual fatigue. Integral-imaging-based displays resolve the problem by directly projecting the sub-aperture views of a light field into the eyes using a microlens array or a similar structure. However, such displays have an inherent trade-off between angular and spatial resolutions. In this paper, we propose a novel coded time-division multiplexing technique that projects encoded sub-aperture views to the eyes of a viewer with correct cues for vergence-accommodation reflex. Given sparse light field sub-aperture views, our pipeline can provide a perception of high-resolution refocused images with minimal aliasing by jointly optimizing the sub-aperture views for display and the coded aperture pattern. This is achieved via deep learning in an end-to-end fashion by simulating light transport and image formation with Fourier optics. To our knowledge, this work is among the first that optimize the light field display pipeline with deep learning. We verify our idea with objective image quality metrics (PSNR and SSIM) and perform an extensive study on various customizable design variables in our display pipeline. Experimental results show that light fields displayed using the proposed technique indeed have higher quality than that of baseline display designs.
rate research
Read More
Reinforcement learning involves decision making in dynamic and uncertain environments and constitutes a crucial element of artificial intelligence. In our previous work, we experimentally demonstrated that the ultrafast chaotic oscillatory dynamics of lasers can be used to solve the two-armed bandit problem efficiently, which requires decision making concerning a class of difficult trade-offs called the exploration-exploitation dilemma. However, only two selections were employed in that research; thus, the scalability of the laser-chaos-based reinforcement learning should be clarified. In this study, we demonstrated a scalable, pipelined principle of resolving the multi-armed bandit problem by introducing time-division multiplexing of chaotically oscillated ultrafast time-series. The experimental demonstrations in which bandit problems with up to 64 arms were successfully solved are presented in this report. Detailed analyses are also provided that include performance comparisons among laser chaos signals generated in different physical conditions, which coincide with the diffusivity inherent in the time series. This study paves the way for ultrafast reinforcement learning by taking advantage of the ultrahigh bandwidths of light wave and practical enabling technologies.
In this paper, we propose a faster-than-Nyquist (FTN) non-orthogonal frequency-division multiplexing (NOFDM) scheme for visible light communications (VLC) where the multiplexing/demultiplexing employs the inverse fractional cosine transform (IFrCT)/FrCT. Different to the common fractional Fourier transform-based NOFDM (FrFT-NOFDM) signal, FrCT-based NOFDM (FrCT-NOFDM) signal is real-valued which can be directly applied to the VLC systems without the expensive upconversion. Thus, FrCT-NOFDM is more suitable for the cost-sensitive VLC systems. Meanwhile, under the same transmission rate, FrCT-NOFDM signal occupies smaller bandwidth compared to OFDM signal. When the bandwidth compression factor $alpha$ is set to $0.8$, $20%$ bandwidth saving can be obtained. Therefore, FrCT-NOFDM has higher spectral efficiency and suffers less high-frequency distortion compared to OFDM, which benefits the bandwidth-limited VLC systems. As the simulation results show, bit error rate (BER) performance of FrCT-NOFDM with $alpha$ of $0.9$ or $0.8$ is better than that of OFDM. Moreover, FrCT-NOFDM has a superior security performance. In conclusion, FrCT-NOFDM shows great potential for application in the future VLC systems.
We demonstrate the code-division multiplexed (CDM) readout of eight transition-edge sensor microcalorimeters. The energy resolution is 3.0 eV (full width at half-maximum) or better at 5.9 keV, with a best resolution of 2.3 eV and a mean of 2.6 eV over the seven modulated detectors. The flux-summing CDM system is described and compared with similar time-division multiplexed (TDM) readout. We show that the sqrt(Npixels) multiplexing disadvantage associated with TDM is not present in CDM. This demonstration establishes CDM as both a simple route to higher performance in existing TDM microcalorimetric experiments and a long-term approach to reaching higher multiplexing factors.
Signal recovery from nonlinear measurements involves solving an iterative optimization problem. In this paper, we present a framework to optimize the sensing parameters to improve the quality of the signal recovered by the given iterative method. In particular, we learn illumination patterns to recover signals from coded diffraction patterns using a fixed-cost alternating minimization-based phase retrieval method. Coded diffraction phase retrieval is a physically realistic system in which the signal is first modulated by a sequence of codes before the sensor records its Fourier amplitude. We represent the phase retrieval method as an unrolled network with a fixed number of layers and minimize the recovery error by optimizing over the measurement parameters. Since the number of iterations/layers are fixed, the recovery incurs a fixed cost. We present extensive simulation results on a variety of datasets under different conditions and a comparison with existing methods. Our results demonstrate that the proposed method provides near-perfect reconstruction using patterns learned with a small number of training images. Our proposed method provides significant improvements over existing methods both in terms of accuracy and speed.
In E-commerce advertising, where product recommendations and product ads are presented to users simultaneously, the traditional setting is to display ads at fixed positions. However, under such a setting, the advertising system loses the flexibility to control the number and positions of ads, resulting in sub-optimal platform revenue and user experience. Consequently, major e-commerce platforms (e.g., Taobao.com) have begun to consider more flexible ways to display ads. In this paper, we investigate the problem of advertising with adaptive exposure: can we dynamically determine the number and positions of ads for each user visit under certain business constraints so that the platform revenue can be increased? More specifically, we consider two types of constraints: request-level constraint ensures user experience for each user visit, and platform-level constraint controls the overall platform monetization rate. We model this problem as a Constrained Markov Decision Process with per-state constraint (psCMDP) and propose a constrained two-level reinforcement learning approach to decompose the original problem into two relatively independent sub-problems. To accelerate policy learning, we also devise a constrained hindsight experience replay mechanism. Experimental evaluations on industry-scale real-world datasets demonstrate the merits of our approach in both obtaining higher revenue under the constraints and the effectiveness of the constrained hindsight experience replay mechanism.
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
