We introduce PowerGym, an open-source reinforcement learning environment for Volt-Var control in power distribution systems. Following OpenAI Gym APIs, PowerGym targets minimizing power loss and voltage violations under physical networked constraints
. PowerGym provides four distribution systems (13Bus, 34Bus, 123Bus, and 8500Node) based on IEEE benchmark systems and design variants for various control difficulties. To foster generalization, PowerGym offers a detailed customization guide for users working with their distribution systems. As a demonstration, we examine state-of-the-art reinforcement learning algorithms in PowerGym and validate the environment by studying controller behaviors.
Thin film lithium niobate (LN) has recently emerged as a playground for chip-scale nonlinear optics and leads to highly efficient frequency
Intelligent reflecting surface (IRS) is an emerging technology that is able to reconfigure the wireless channel via tunable passive signal reflection and thereby enhance the spectral and energy efficiency of wireless networks cost-effectively. In thi
s paper, we study an IRS-aided multiuser multiple-input single-output (MISO) wireless system and adopt the two-timescale (TTS) transmission to reduce the signal processing complexity and channel training overhead as compared to the existing schemes based on the instantaneous channel state information (I-CSI), and at the same time, exploit the multiuser channel diversity in transmission scheduling. Specifically, the long-term passive beamforming is designed based on the statistical CSI (S-CSI) of all links, while the short-term active beamforming is designed to cater to the I-CSI of all users reconfigured channels with optimized IRS phase shifts. We aim to minimize the average transmit power at the access point (AP), subject to the users individual quality of service (QoS) constraints. The formulated stochastic optimization problem is non-convex and difficult to solve since the long-term and short-term design variables are complicatedly coupled in the QoS constraints. To tackle this problem, we propose an efficient algorithm, called the primal-dual decomposition based TTS joint active and passive beamforming (PDD-TJAPB), where the original problem is decomposed into a long-term problem and a family of short-term problems, and the deep unfolding technique is employed to extract gradient information from the short-term problems to construct a convex surrogate problem for the long-term problem. The proposed algorithm is proved to converge to a stationary solution of the original problem almost surely. Simulation results are presented which demonstrate the advantages and effectiveness of the proposed algorithm as compared to benchmark schemes.
In metropolitan areas populated with commercial buildings, electric power supply is stringent especially during business hours. Demand side management using battery is a promising solution to mitigate peak demands, however long payback time creates b
arriers for large scale adoption. In this paper, we have developed a design phase battery life-cycle cost assessment tool and a runtime controller for the building owners, taking into account the degradation of battery. In the design phase, perfect knowledge on building load profile is assumed to estimate ideal payback time. In runtime, stochastic programming and load predictions are applied to address the uncertainties in loads for producing optimal battery operation. For validation, we have performed numerical experiments using the real-life tariff model serves New York City, Zn/MnO2 battery, and state-of-the-art building simulation tool. Experimental results shows a small gap between design phase assessment and runtime control. To further examine the proposed methods, we have applied the same tariff model and performed numerical experiments on nine weather zones and three types of commercial buildings. On contrary to the common practice of shallow discharging battery for preventing phenomenal degradation, experimental results show promising payback time achieved by optimally deep discharge a battery.
