اشترك بالحزمة الذهبية واحصل على وصول غير محدود شمرا أكاديميا
تسجيل مستخدم جديدSuperluminal FITS File Processing on Multiprocessors: Zero Time Endian Conversion Technique
58
0
0.0
(
0
)
تأليف
Satoshi Eguchi
اسأل ChatGPT حول البحث
ﻻ يوجد ملخص باللغة العربية
The FITS is the standard file format in astronomy, and it has been extended to agree with astronomical needs of the day. However, astronomical datasets have been inflating year by year. In case of ALMA telescope, a ~ TB scale 4-dimensional data cube may be produced for one target. Considering that typical Internet bandwidth is a few 10 MB/s at most, the original data cubes in FITS format are hosted on a VO server, and the region which a user is interested in should be cut out and transferred to the user (Eguchi et al., 2012). The system will equip a very high-speed disk array to process a TB scale data cube in a few 10 seconds, and disk I/O speed, endian conversion and data processing one will be comparable. Hence to reduce the endian conversion time is one of issues to realize our system. In this paper, I introduce a technique named just-in-time endian conversion, which delays the endian conversion for each pixel just before it is really needed, to sweep out the endian conversion time; by applying this method, the FITS processing speed increases 20% for single threading, and 40% for multi-threading compared to CFITSIO. The speed-up by the method tightly relates to modern CPU architecture to improve the efficiency of instruction pipelines due to break of causality, a programmed instruction code sequence.
قيم البحث
اقرأ أيضاً
This document describes a FITS convention developed by the IRAF Group (D. Tody, R. Seaman, and N. Zarate) at the National Optical Astronomical Observatory (NOAO). This convention is implemented by the fgread/fgwrite tasks in the IRAF fitsutil package
. It was first used in May 1999 to encapsulate preview PNG-format graphics files into FITS files in the NOAO High Performance Pipeline System. A FITS extension of type FOREIGN provides a mechanism for storing an arbitrary file or tree of files in FITS, allowing it to be restored to disk at a later time.
Data archiving is one of the most critical issues for modern astronomical observations. With the development of a new generation of radio telescopes, the transfer and archiving of massive remote data have become urgent problems to be solved. Herein,
we present a practical and robust file-level flow-control approach, called the Unlimited Sliding-Window (USW), by referring to the classic flow-control method in TCP protocol. Basing on the USW and the Next Generation Archive System (NGAS) developed for the Murchison Widefield Array telescope, we further implemented an enhanced archive system (ENGAS) using ZeroMQ middleware. The ENGAS substantially improves the transfer performance and ensures the integrity of transferred files. In the tests, the ENGAS is approximately three to twelve times faster than the NGAS and can fully utilize the bandwidth of network links. Thus, for archiving radio observation data, the ENGAS reduces the communication time, improves the bandwidth utilization, and solves the remote synchronous archiving of data from observatories such as Mingantu spectral radioheliograph. It also provides a better reference for the future construction of the Square Kilometer Array (SKA) Science Regional Center.
Ultrahigh accuracy time synchronization technique based on the optical frequency comb and the GHZ radio frequency spiral scanning deflector is suggested to install on the Moon during the ARTEMIS mission. The comparison with the parameters of an analo
gous device operated in the Earth gravity will enable the testing to high accuracy fundamental physical principles.
A major challenge in modern radio astronomy is dealing with the massive data volumes generated by wide-bandwidth receivers. Such massive data rates are often too great for a single device to cope, and so processing must be split across multiple devic
es working in parallel. These devices must work in unison to process incoming data in real time, reduce the data volume to a manageable size, and output a science-ready data product. The aim of this chapter is to give a broad overview of how digital systems for radio telescopes are commonly implemented, with a focus on real-time stream processing over multiple compute devices.
In this work we explore the possibility of using Recurrence Quantification Analysis (RQA) in astronomical high-contrast imaging to statistically discriminate the signal of faint objects from speckle noise. To this end, we tested RQA on a sequence of
high frame rate (1 kHz) images acquired with the SHARK-VIS forerunner at the Large Binocular Telescope. Our tests show promising results in terms of detection contrasts at angular separations as small as $50$ mas, especially when RQA is applied to a very short sequence of data ($2$ s). These results are discussed in light of possible science applications and with respect to other techniques like, for example, Angular Differential Imaging and Speckle-Free Imaging.
سجل دخول لتتمكن من نشر تعليقات
التعليقات
جاري جلب التعليقات
سجل دخول لتتمكن من متابعة معايير البحث التي قمت باختيارها
