All data correlated at the JIVE correlator are placed in the EVN Data Archive. This archive contains the raw FITS format data, calibration tables, various diagnostic plots, calibrated visibility data, and the EVN Pipeline results.
JIVE will ask the Principal Investigator prior to correlation whether to treat each source in the schedule as “public” or “private”. Source-specific pipeline results or data (calibrated visibilities, images, other plots) for the specified “public sources” will also be available immediately after data distribution, but those for the specified “private sources” will remain protected over the proprietary period. The Principal Investigator is also given the option to avoid generating images of the private sources altogether.
Once the proprietary period expires, the calibrated visibilities, images, and other pipeline plots related to the private sources will become publicly available, as will the raw FITS-format data.
The pipeline results for all user experiments can be downloaded from the same EVN Data Archive. You should first find your experiment, then click on the "pipeline" link where you will be able to download:
- A series of plots produced by the pipeline which will be useful in assessing the antenna performance and data quality in each experiment.
- A set of calibration tables (in FITS format) produced by the pipeline. These can be downloaded and applied to the data provided by the EVN correlator (see the EVN Data Reduction Guide for details).
- A history file associated with the data processed by the pipeline and a summary of what the CL/SN tables contain (typically CL table 2 provides the apriori amplitude calibration and CL table 3 provides phase, phase-rate, delay and amp gain solutions from the calibrators). In addition, the original pipeline script is made available, together with final versions of the ancillary data (ANTAB, UVFLG files etc).
- The pipelined images and data for all sources. Note that these data are not science-ready. In many cases further editing, self-calibration, or other refinements may be required to bring out particular features of interest.
EVN Data Access Policy
The policy described below came into force on 1 June 2004. Later revisions treat the cases of Target-of-Opportunity experiments (1 September 2011) and short observations (1 December 2020).
It is the policy of the European VLBI Network's (EVN) Consortium Board of Directors (CBD) that the investigators named on an EVN or global VLBI proposal have the sole right of access to the data obtained for that proposal for 12 months after the distribution of the data to the PI. If the proposal comprises multiple observations (i.e., separately scheduled experiments in one or more network or ad-hoc sessions), then the 12-month period begins from the distribution of the final observation associated with the proposal. For proposals fully distributed prior to 1 June 2004, the 12 month period begins from that date. Special cases are made for:
- Target-of-Opportunity proposals receive a 6-month proprietary period, owing to the time-critical nature of such experiments. This reduced proprietary period will apply to all target-of-opportunity proposals submitted 1 October 2011 or later.
- Short-observation proposals receive no proprietary period (thus their data is public once it appears on the EVN archive). This will apply to all short-obsrvation proposals submitted 1 December 2020 or later.
Following the expiry of the proprietary period for a proposal, all data related to it will be publicly accessible.
One month prior to the public release of data from a proposal, JIVE will inform the PI (at the last known e-mail address) about the impending action. Under exceptional circumstances the PI can request a short delay in the release date. All such requests should be made to the Chairperson of the EVN Programme Committee.
It is the intention of the CBD that all data correlated at the EVN Data Processor at JIVE will be placed into the EVN archive. This archive will contain the raw FITS format data, calibration tables, various diagnostic plots, calibrated visibility data, and pipelined images. The images will be preliminary; in many cases further editing, self-calibration, or other refinements may be required to bring out particular features of interest.
The archive will be populated in two stages:
- Immediately after correlation, the archive for a particular project will include for all sources (including the targets): correlator diagnostic plots, ANTAB & UVFLG files and the a-priori amplitude calibration (CL) table. Plots and further CL (SN) tables generated by the pipeline (including fringe-fitting results) will all be available. JIVE will ask the PI prior to correlation whether to treat each source in the schedule as "public" or "private". Source-specific pipeline results (calibrated visibilities, images, other plots) for the PI-specified "public sources" will also be available immediately, but those for the specified "private sources" will remain protected over the proprietary period. The PI is also given the option to avoid generating images of the private sources altogether.
- Once the proprietary period expires, the calibrated visibilities, images, and other pipeline plots related to the private sources will also become publicly available, as will the raw FITS-format data.
If you or your colleagues subsequently publish or use EVN data, including that obtained from the EVN archive, we request that you use the standard EVN acknowledgment:
The European VLBI Network is a joint facility of independent European, African, Asian, and North American radio astronomy institutes. Scientific results from data presented in this publication are derived from the following EVN project code(s): XXXX.
(Fill in the appropriate project codes at the end of this acknowledgment; in this sense, the "project code" should be the 5-character code, without the final letter that distinguishes between multiple epochs and/or frequency bands, if applicable.)
Please refer to this link for further acknowledgments that may be appropriate.
The EVN pipeline uses the ParselTongue software to provide access to the AIPS tasks from a Python script.
The main pipeline script is evn.py. It uses three Python modules:
evn_aips_tasks.py: Shortcut functions for executing AIPS tasks with most parameters defaulted to sensible values for the EVN. Parameters which must be set are mentioned in the docstring at the beginning, e.g., try: >>> help(evn_aips_tasks.runlwpla)
evn_funcs.py: Other functions used by evn.py. Mostly provide simplified interaction with functions in evn_aips_tasks.py.
crfuncs.py: Generic functions used by evn.py. At the moment this is a limited number of file handling classes to allow better logging of what the pipeline is doing.
The pipeline is driven by an input file. An example can be found here: template.txt
A folder containing all of the above files can be found here: pypeline-4.7.tar.gz
The pipeline can be run using the following input file:
$ ParselTongue EVN.py template.txt