SPAM: A data reduction recipe for high-resolution, low-frequency radio-interferometric observations

High-resolution astronomical imaging at sub-GHz radio frequencies has been available for more than 15 years, with the VLA at 74 and 330 MHz, and the GMRT at 150, 240, 330 and 610 MHz. Recent developments include wide-bandwidth upgrades for VLA and GMRT, and commissioning of the aperture-array-based, multi-beam telescope LOFAR. A common feature of these telescopes is the necessity to deconvolve the very many detectable sources within their wide fields-of-view and beyond. This is complicated by gain variations in the radio signal path that depend on viewing direction. One such example is phase errors due to the ionosphere. Here I discuss the inner workings of SPAM, a set of AIPS-based data reduction scripts in Python that includes direction-dependent calibration and imaging. Since its first version in 2008, SPAM has been applied to many GMRT data sets at various frequencies. Many valuable lessons were learned, and translated into various SPAM software modifications. Nowadays, semi-automated SPAM data reduction recipes can be applied to almost any GMRT data set, yielding good quality continuum images comparable with (or often better than) hand-reduced results. SPAM is currently being migrated from AIPS to CASA with an extension to handle wide bandwidths. This is aimed at providing users of the VLA low-band system and the upcoming wide-bandwidth GMRT with the necessary data reduction tools.

Deep Low-Frequency Radio Observations of the NOAO Bootes Field: I. Data Reduction and Catalog Construction

In this article we present deep, high-resolution radio interferometric observations at 153 MHz to complement the extensively studied NOAO Bootes field. We provide a description of the observations, data reduction and source catalog construction. From our single pointing GMRT observation of ~12 hours we obtain a high-resolution (26 x 22) image of ~11.3 square degrees, fully covering the Bootes field region and beyond. The image has a central noise level of ~1.0 mJy/beam, which rises to 2.0-2.5 mJy/beam at the field edge, placing it amongst the deepest ~150 MHz surveys to date. The catalog of 598 extracted sources is estimated to be ~92 percent complete for >10 mJy sources, while the estimated contamination with false detections is <1 percent. The low RMS position uncertainty of 1.24 facilitates accurate matching against catalogs at optical, infrared and other wavelengths. Differential source counts are determined down to <~10 mJy. There is no evidence for flattening of the counts towards lower flux densities as observed in deep radio surveys at higher frequencies, suggesting that our catalog is dominated by the classical radio-loud AGN population that explains the counts at higher flux densities. Combination with available deep 1.4 GHz observations yields an accurate determination of spectral indices for 417 sources down to the lowest 153 MHz flux densities, of which 16 have ultra-steep spectra with spectral indices below -1.3. We confirm that flattening of the median spectral index towards low flux densities also occurs at this frequency. The detection fraction of the radio sources in NIR Ks-band is found to drop with radio spectral index, which is in agreement with the known correlation between spectral index and redshift for brighter radio sources.

Ionospheric Calibration of Low Frequency Radio Interferometric Observations using the Peeling Scheme: I. Method Description and First Results

Calibration of radio interferometric observations becomes increasingly difficult towards lower frequencies. Below ~300 MHz, spatially variant refractions and propagation delays of radio waves traveling through the ionosphere cause phase rotations that can vary significantly with time, viewing direction and antenna location. In this article we present a description and first results of SPAM (Source Peeling and Atmospheric Modeling), a new calibration method that attempts to iteratively solve and correct for ionospheric phase errors. To model the ionosphere, we construct a time-variant, 2-dimensional phase screen at fixed height above the Earths surface. Spatial variations are described by a truncated set of discrete Karhunen-Loeve base functions, optimized for an assumed power-law spectral density of free electrons density fluctuations, and a given configuration of calibrator sources and antenna locations. The model is constrained using antenna-based gain phases from individual self-calibrations on the available bright sources in the field-of-view. Application of SPAM on three test cases, a simulated visibility data set and two selected 74 MHz VLA data sets, yields significant improvements in image background noise (5-75 percent reduction) and source peak fluxes (up to 25 percent increase) as compared to the existing self-calibration and field-based calibration methods, which indicates a significant improvement in ionospheric phase calibration accuracy.