2013/12/24 by G. Bruce Berriman, Berriman, G. Bruce, Ewa Deelman +11
Computer Science · Engineering · Physics and Astronomy · #Astronomical Observations and Instrumentation #Astronomy and Astrophysical Research #Distributed #FOS: Computer and information sciences #FOS: Physical sciences #Instrumentation and Methods for Astrophysics (astro-ph.IM) #Parallel #and Cluster Computing (cs.DC) #astro-ph.IM #cs.DC
paper · pdf · doi:10.48550/arxiv.1312.6723
7 pages, 1 table, 2 figures. Submitted to IEEE Special Edition on Computing in Astronomy
arxiv created 2013/12/24 · openalex publication_date 2013/12/24 · arxiv updated 2013/12/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
This paper describes by example how astronomers can use cloud-computing resources offered by Amazon Web Services (AWS) to create new datasets at scale. We have created from existing surveys an atlas of the Galactic Plane at 16 wavelengths from 1 μm to 24 μm with pixels co-registered at spatial sampling of 1 arcsec. We explain how open source tools support management and operation of a virtual cluster on AWS platforms to process data at scale, and describe the technical issues that users will need to consider, such as optimization of resources, resource costs, and management of virtual machine instances.