Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userThe GWAC Data Processing and Management System
71
0
0.0
(
0
)
Ask ChatGPT about the research
No Arabic abstract
GWAC will have been built an integrated FOV of 5,000 $degree^2$ and have already built 1,800 square $degree^2$. The limit magnitude of a 10-second exposure image in the moonless night is 16R. In each observation night, GWAC produces about 0.7TB of raw data, and the data processing pipeline generates millions of single frame alerts. We describe the GWAC Data Processing and Management System (GPMS), including hardware architecture, database, detection-filtering-validation of transient candidates, data archiving, and user interfaces for the check of transient and the monitor of the system. GPMS combines general technology and software in astronomy and computer field, and use some advanced technologies such as deep learning. Practical results show that GPMS can fully meet the scientific data processing requirement of GWAC. It can online accomplish the detection, filtering and validation of millions of transient candidates, and feedback the final results to the astronomer in real-time. During the observation from October of 2018 to December of 2019, we have already found 102 transients.
rate research
Read More
The Dark Energy Survey Data Management (DESDM) system will process and archive the data from the Dark Energy Survey (DES) over the five year period of operation. This paper focuses on a new adaptable processing framework developed to perform highly automated, high performance data parallel processing. The new processing framework has been used to process 45 nights of simulated DECam supernova imaging data, and was extensively used in the DES Data Challenge 4, where it was used to process thousands of square degrees of simulated DES data.
The GWAC-N is an observation network composed of multi-aperture and multi-field of view robotic optical telescopes. The main instruments are the GWAC-A. Besides, several robotic optical telescopes with narrower field of views provide fast follow-up m
ulti-band capabilities to the GWAC-N. The primary scientific goal of the GWAC-N is to search for the optical counterparts of GRB that will be detected by the SVOM. The GWAC-N performs many other observing tasks including the follow-ups of ToO and both the detection and the monitoring of variable/periodic objects as well as optical transients. To handle all of those scientific cases, we designed 10 observation modes and 175 observation strategies, especially, a joint observation strategy with multiple telescopes of the GWAC-N for the follow-up of GW events. To perform these observations, we thus develop an AOM system in charge of the object management, the dynamic scheduling of the observation plan and its automatic broadcasting to the network management and finally the image management. The AOM combines the individual telescopes into a network and smoothly organizes all the associated operations. The system completely meets the requirements of the GWAC-N on all its science objectives. With its good portability, the AOM is scientifically and technically qualified for other general purposed telescope networks. As the GWAC-N extends and evolves, the AOM will greatly enhance the discovery potential for the GWAC-N. In the first paper of a series of publications, we present the scientific goals of the GWAC-N as well as the hardware, the software and the strategy setup to achieve the scientific objectives. The structure, the technical design, the implementation and performances of the AOM will be also described in details. In the end, we summarize the current status of the GWAC-N and prospect for the development plan in the near future.
The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pachon in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide range of astrophysical questions, from discovering killer asteroids to examining the nature of Dark Energy. The LSST will generate on average 15 TB of data per night, and will require a comprehensive Data Management system to reduce the raw data to scientifically useful catalogs and images with minimum human intervention. These reductions will result in a real-time alert stream, and eleven data releases over the 10-year duration of LSST operations. To enable this processing, the LSST project is developing a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys. Prototypes of this stack are already capable of processing data from existing cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline.
The Pan-STARRS Data Processing System is responsible for the steps needed to downloaded, archive, and process all images obtained by the Pan-STARRS telescopes, including real-time detection of transient sources such as supernovae and moving objects including potentially hazardous asteroids. With a nightly data volume of up to 4 terabytes and an archive of over 4 petabytes of raw imagery, Pan-STARRS is solidly in the realm of Big Data astronomy. The full data processing system consists of several subsystems covering the wide range of necessary capabilities. This article describes the Image Processing Pipeline and its connections to both the summit data systems and the outward-facing systems downstream. The latter include the Moving Object Processing System (MOPS) & the public database: the Published Science Products Subsystem (PSPS).
The Dark Energy Survey (DES) is a project with the goal of building, installing and exploiting a new 74 CCD-camera at the Blanco telescope, in order to study the nature of cosmic acceleration. It will cover 5000 square degrees of the southern hemisphere sky and will record the positions and shapes of 300 million galaxies up to redshift 1.4. The survey will be completed using 525 nights during a 5-year period starting in 2012. About O(1 TB) of raw data will be produced every night, including science and calibration images. The DES data management system has been designed for the processing, calibration and archiving of these data. It is being developed by collaborating DES institutions, led by NCSA. In this contribution, we describe the basic functions of the system, what kind of scientific codes are involved and how the Data Challenge process works, to improve simultaneously the Data Management system algorithms and the Science Working Group analysis codes.
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
