The IDIA processMEERKAT pipeline : fast CASA processing on a cloud-based HPC cluster

Jordan D. Collier; Bradley Frank; Srikrishna Sekhar; Andrew R. Taylor

doi:10.23919/URSIGASS51995.2021.9560276

The IDIA processMEERKAT pipeline : fast CASA processing on a cloud-based HPC cluster

Jordan D. Collier, Bradley Frank, Srikrishna Sekhar, Andrew R. Taylor

Western Sydney University

Research output: Chapter in Book / Conference Paper › Conference Paper › peer-review

3 Citations (Scopus)

Abstract

![CDATA[The IDIA PROCESSMEERKAT pipeline is an efficient, user-friendly pipeline that has been widely tested and documented. It has been used to successfully calibrate and image MeerKAT data down to an RMS of several μJy / beam, and supports continuum, polarisation and spectral-line use cases. It runs on the ilifu cluster, making dynamic use of resources and containers, and presents a good framework for implementing pipelines in a HPC environment. The current version performs full-polarisation a priori calibration and produces quick-look images. The next version, which introduces self-calibration, is currently being tested.]]

Original language	English
Title of host publication	Proceedings of 2021 34th General Assembly and Scientific Symposium of the International Union of Radio Science (URSI GASS 2021), 28th August-4th September, 2021, Rome, Italy
Publisher	IEEE
Number of pages	4
ISBN (Print)	9789463968027
DOIs	https://doi.org/10.23919/URSIGASS51995.2021.9560276
Publication status	Published - 2021
Event	URSI General Assembly and Scientific Symposium - Duration: 28 Aug 2021 → …

Conference

Conference	URSI General Assembly and Scientific Symposium
Period	28/08/21 → …

Access to Document

10.23919/URSIGASS51995.2021.9560276

Cite this

Collier, J. D., Frank, B., Sekhar, S., & Taylor, A. R. (2021). The IDIA processMEERKAT pipeline : fast CASA processing on a cloud-based HPC cluster. In Proceedings of 2021 34th General Assembly and Scientific Symposium of the International Union of Radio Science (URSI GASS 2021), 28th August-4th September, 2021, Rome, Italy IEEE. https://doi.org/10.23919/URSIGASS51995.2021.9560276

@inproceedings{677ebb23864b45129ba0ca7c01d3d505,

title = "The IDIA processMEERKAT pipeline : fast CASA processing on a cloud-based HPC cluster",

abstract = "![CDATA[The IDIA PROCESSMEERKAT pipeline is an efficient, user-friendly pipeline that has been widely tested and documented. It has been used to successfully calibrate and image MeerKAT data down to an RMS of several μJy / beam, and supports continuum, polarisation and spectral-line use cases. It runs on the ilifu cluster, making dynamic use of resources and containers, and presents a good framework for implementing pipelines in a HPC environment. The current version performs full-polarisation a priori calibration and produces quick-look images. The next version, which introduces self-calibration, is currently being tested.]]",

author = "Collier, {Jordan D.} and Bradley Frank and Srikrishna Sekhar and Taylor, {Andrew R.}",

year = "2021",

doi = "10.23919/URSIGASS51995.2021.9560276",

language = "English",

isbn = "9789463968027",

booktitle = "Proceedings of 2021 34th General Assembly and Scientific Symposium of the International Union of Radio Science (URSI GASS 2021), 28th August-4th September, 2021, Rome, Italy",

publisher = "IEEE",

note = "URSI General Assembly and Scientific Symposium ; Conference date: 28-08-2021",

}

Collier, JD, Frank, B, Sekhar, S & Taylor, AR 2021, The IDIA processMEERKAT pipeline : fast CASA processing on a cloud-based HPC cluster. in Proceedings of 2021 34th General Assembly and Scientific Symposium of the International Union of Radio Science (URSI GASS 2021), 28th August-4th September, 2021, Rome, Italy. IEEE, URSI General Assembly and Scientific Symposium, 28/08/21. https://doi.org/10.23919/URSIGASS51995.2021.9560276

The IDIA processMEERKAT pipeline : fast CASA processing on a cloud-based HPC cluster. / Collier, Jordan D.; Frank, Bradley; Sekhar, Srikrishna et al.
Proceedings of 2021 34th General Assembly and Scientific Symposium of the International Union of Radio Science (URSI GASS 2021), 28th August-4th September, 2021, Rome, Italy. IEEE, 2021.

Research output: Chapter in Book / Conference Paper › Conference Paper › peer-review

TY - GEN

T1 - The IDIA processMEERKAT pipeline : fast CASA processing on a cloud-based HPC cluster

AU - Collier, Jordan D.

AU - Frank, Bradley

AU - Sekhar, Srikrishna

AU - Taylor, Andrew R.

PY - 2021

Y1 - 2021

N2 - ![CDATA[The IDIA PROCESSMEERKAT pipeline is an efficient, user-friendly pipeline that has been widely tested and documented. It has been used to successfully calibrate and image MeerKAT data down to an RMS of several μJy / beam, and supports continuum, polarisation and spectral-line use cases. It runs on the ilifu cluster, making dynamic use of resources and containers, and presents a good framework for implementing pipelines in a HPC environment. The current version performs full-polarisation a priori calibration and produces quick-look images. The next version, which introduces self-calibration, is currently being tested.]]

AB - ![CDATA[The IDIA PROCESSMEERKAT pipeline is an efficient, user-friendly pipeline that has been widely tested and documented. It has been used to successfully calibrate and image MeerKAT data down to an RMS of several μJy / beam, and supports continuum, polarisation and spectral-line use cases. It runs on the ilifu cluster, making dynamic use of resources and containers, and presents a good framework for implementing pipelines in a HPC environment. The current version performs full-polarisation a priori calibration and produces quick-look images. The next version, which introduces self-calibration, is currently being tested.]]

UR - https://hdl.handle.net/1959.7/uws:67362

U2 - 10.23919/URSIGASS51995.2021.9560276

DO - 10.23919/URSIGASS51995.2021.9560276

M3 - Conference Paper

SN - 9789463968027

BT - Proceedings of 2021 34th General Assembly and Scientific Symposium of the International Union of Radio Science (URSI GASS 2021), 28th August-4th September, 2021, Rome, Italy

PB - IEEE

T2 - URSI General Assembly and Scientific Symposium

Y2 - 28 August 2021

ER -

The IDIA processMEERKAT pipeline : fast CASA processing on a cloud-based HPC cluster

Abstract

Conference

Access to Document

Other files and links

Fingerprint

Cite this