Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userReal time data access log analysis system of EAST tokamak based on spark
104
0
0.0
(
0
)
Ask ChatGPT about the research
No Arabic abstract
The experiment data generated by the EAST device is getting larger and larger, and it is necessary to monitor the MDSplus data storage server on EAST. In order to facilitate the management of users on the MDSplus server, a real-time monitoring log analysis system is needed. The data processing framework adopted by this log analysis system is the Spark Streaming framework in Spark ecosphere, whose real-time streaming data is derived from MDSplus logs. The framework also makes use of key technologies such as log monitoring, aggregation and distribution with framework likes Flume and Kafka which makes it possible for MDSplus mass log data processing power. The system can process tens of millions of unprocessed MDSplus log information at a second level, then model the log information and display it on the web. This report introduces the design and implementation of the overall architecture of real time data access log analysis system based on spark. Experimental results show that the system is proved to be with steady and reliable performance and has an important application value to the management of fusion experiment data. The system has been designed and will be adopted in the next campaign and the system details will be given in the paper.
rate research
Read More
Microwave reflectometry is a non-intrusive plasma diagnostic tool which is widely applied in many fusion devices. In 2014, the microwave reflectometry on Experimental Advanced Superconducting Tokamak (EAST) had been upgraded to measure plasma density profile and fluctuation, which covered the frequency range of Q-band (32-56 GHz), V-band (47-76 GHz) and W-band (71-110 GHz). This paper presented a dedicated data acquisition and control system (DAQC) to meet the measurement requirements of high accuracy and temporal resolution. The DAQC consisted of two control modules, which integrated arbitrary waveform generation block (AWG) and trigger processing block (TP), and two data acquisition modules (DAQ) that was implemented base on the PXIe platform from National Instruments (NI). All the performance parameters had satisfied the requirements of reflectometry. The actual performance will be further examined in the experiments of EAST in 2014.
One of the biggest challenges in the High-Luminosity LHC (HL- LHC) era will be the significantly increased data size to be recorded and analyzed from the collisions at the ATLAS and CMS experiments. ServiceX is a software R&D project in the area of Data Organization, Management and Access of the IRIS- HEP to investigate new computational models for the HL- LHC era. ServiceX is an experiment-agnostic service to enable on-demand data delivery specifically tailored for nearly-interactive vectorized analyses. It is capable of retrieving data from grid sites, on-the-fly data transformation, and delivering user-selected data in a variety of different formats. New features will be presented that make the service ready for public use. An ongoing effort to integrate ServiceX with a popular statistical analysis framework in ATLAS will be described with an emphasis of a practical implementation of ServiceX into the physics analysis pipeline.
A fully digital beam position and phase measurement (BPPM) system was designed for the linear accelerator (LINAC) in Accelerator Driven Sub-critical System (ADS) in China. Phase information is obtained from the summed signals from four pick-ups of the Beam Position Monitor (BPM). Considering that the delay variations of different analog circuit channels would introduce phase measurement errors, we propose a new method to tune the digital waveforms of four channels before summation and achieve real-time error correction. The process is based on the vector rotation method and implemented within one single Field Programmable Gate Array (FPGA) device. Tests were conducted to evaluate this correction method and the results indicate that a phase correction precision better than +/- 0.3 degree over the dynamic range from -60 dBm to 0 dBm is achieved.
Real-time control systems often require dedicated hardware and software, including real-time operating systems, while many systems are available for off-line computing, mainly based on standard system units (PCs), standard network connections (Ethernet), standard operating systems (Linux) and software independent from the particular architecture of the single unit. In order to try to get the advantages of both the technologies, we built an hybrid control system prototype using network based parallel computing architecture within real-time control system. In this paper we describe the architecture of the implemented system, the preliminary tests we performed for its characterization and the architecture of the control system we used for the real-time control tests.
The Advanced LIGO detectors are sophisticated opto-mechanical devices. At the core of their operation is feedback control. The Advanced LIGO project developed a custom digital control and data acquisition system to handle the unique needs of this new breed of astronomical detector. The advligorts is the software component of this system. This highly modular and extensible system has enabled the unprecedented performance of the LIGO instruments, and has been a vital component in the direct detection of gravitational waves.
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
