TY - JOUR
T1 - What will the future of cloud-based astronomical data processing look like?
AU - Green, Andrew W.
AU - Mannering, Elizabeth
AU - Harischandra, Lloyd
AU - Vuong, Minh
AU - O'Toole, Simon
AU - Sealey, K.
AU - Hopkins, Andrew M.
PY - 2016
Y1 - 2016
N2 - Astronomy is rapidly approaching an impasse: very large datasets require remote or cloud-based parallel processing, yet many astronomers still try to download the data and develop serial code locally. Astronomers understand the need for change, but the hurdles remain high. We are developing a data archive designed from the ground up to simplify and encourage cloud-based parallel processing. While the volume of data we host remains modest by some standards, it is still large enough that download and processing times are measured in days and even weeks. We plan to implement a python based, notebook-like interface that automatically parallelises execution. Our goal is to provide an interface sufficiently familiar and user-friendly that it encourages the astronomer to run their analysis on our system in the cloud - astroinformatics as a service. We describe how our system addresses the approaching impasse in astronomy using the SAMI Galaxy Survey as an example.
AB - Astronomy is rapidly approaching an impasse: very large datasets require remote or cloud-based parallel processing, yet many astronomers still try to download the data and develop serial code locally. Astronomers understand the need for change, but the hurdles remain high. We are developing a data archive designed from the ground up to simplify and encourage cloud-based parallel processing. While the volume of data we host remains modest by some standards, it is still large enough that download and processing times are measured in days and even weeks. We plan to implement a python based, notebook-like interface that automatically parallelises execution. Our goal is to provide an interface sufficiently familiar and user-friendly that it encourages the astronomer to run their analysis on our system in the cloud - astroinformatics as a service. We describe how our system addresses the approaching impasse in astronomy using the SAMI Galaxy Survey as an example.
UR - https://hdl.handle.net/1959.7/uws:67420
U2 - 10.1017/S1743921317001363
DO - 10.1017/S1743921317001363
M3 - Article
SN - 1743-9213
VL - 12
SP - 27
EP - 31
JO - Proceedings of the International Astronomical Union
JF - Proceedings of the International Astronomical Union
IS - S325
ER -