ترغب بنشر مسار تعليمي؟ اضغط هنا

Data engineering for archive evolution

298   0   0.0 ( 0 )
 نشر من قبل Robert Seaman
 تاريخ النشر 2014
والبحث باللغة English
 تأليف Rob Seaman




اسأل ChatGPT حول البحث

From the moment astronomical observations are made the resulting data products begin to grow stale. Even if perfect binary copies are preserved through repeated timely migration to more robust storage media, data standards evolve and new tools are created that require different kinds of data or metadata. The expectations of the astronomical community change even if the data do not. We discuss data engineering to mitigate the ensuing risks with examples from a recent project to refactor seven million archival images to new standards of nomenclature, metadata, format, and compression.



قيم البحث

اقرأ أيضاً

We present IACTalks, a free and open access seminars archive (http://iactalks.iac.es) aimed at promoting astronomy and the exchange of ideas by providing high-quality scientific seminars to the astronomical community. The archive of seminars and talk s given at the Instituto de Astrofiisica de Canarias goes back to 2008. Over 360 talks and seminars are now freely available by streaming over the internet. We describe the user interface, which includes two video streams, one showing the speaker, the other the presentation. A search function is available, and seminars are indexed by keywords and in some cases by series, such as special training courses or the 2011 Winter School of Astrophysics, on secular evolution of galaxies. The archive is made available as an open resource, to be used by scientists and the public.
The recently released Chandra Transmission Grating Catalog and Archive, TGCat, presents a fully dynamic on-line catalog allowing users to browse and categorize Chandra gratings observations quickly and easily, generate custom plots of resulting respo nse corrected spectra on-line without the need for special software and to download analysis ready products from multiple observations in one convenient operation. TGCat has been registered as a VO resource with the NVO providing direct access to the catalogs interface. The catalog is supported by a back-end designed to automatically fetch newly public data, process, archive and catalog them, At the same time utilizing an advanced queue system integrated into the archives MySQL database allowing large processing projects to take advantage of an unlimited number of CPUs across a network for rapid completion. A unique feature of the catalog is that all of the high level functions used to retrieve inputs from the Chandra archive and to generate the final data products are available to the user in an ISIS written library with detailed documentation. Here we present a structural overview of the Systems, Design, and Accessibility features of the catalog and archive.
The Large sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) is the largest optical telescope in China. In last four years, the LAMOST telescope has published four editions data (pilot data release, data release 1, data release 2 and data r elease 3). To archive and release these data (raw data, catalog, spectrum etc), we have set up a data cycle management system, including the transfer of data, archiving, backup. And through the evolution of four softwa
The Parkes pulsar data archive currently provides access to 144044 data files obtained from observations carried out at the Parkes observatory since the year 1991. Around 10^5 files are from surveys of the sky, the remainder are observations of 775 i ndividual pulsars and their corresponding calibration signals. Survey observations are included from the Parkes 70cm and the Swinburne Intermediate Latitude surveys. Individual pulsar observations are included from young pulsar timing projects, the Parkes Pulsar Timing Array and from the PULSE@Parkes outreach program. The data files and access methods are compatible with Virtual Observatory protocols. This paper describes the data currently stored in the archive and presents ways in which these data can be searched and downloaded.
The Parkes Pulsar Data Archive currently provides access to 165,755 data files obtained from observations carried out at the Parkes Observatory since the year 1991. Data files and access methods are compliant with the Virtual Observatory protocol. Th is paper provides a tutorial on how to make use of the Parkes Pulsar Data Archive and provides example queries using on-line interfaces.
التعليقات
جاري جلب التعليقات جاري جلب التعليقات
سجل دخول لتتمكن من متابعة معايير البحث التي قمت باختيارها
mircosoft-partner

هل ترغب بارسال اشعارات عن اخر التحديثات في شمرا-اكاديميا