vix.ing · top · new · best · stats · spec

Data Mining the SDSS SkyServer Database

2002/02/12 by Jim Gray, Gray, Jim, Alex S. Szalay +14 · 1 citation
Computer Science · #Advanced Database Systems and Queries #Data Management and Algorithms #Data Visualization and Analytics #Databases (cs.DB) #Digital Libraries (cs.DL) #FOS: Computer and information sciences #H.2.8 #H.3.3 #H.3.5 #H.4.2 #cs.DB #cs.DL #h.3.7

paper · pdf · doi:10.48550/arxiv.cs/0202014

40 pages, Original source is at http://research.microsoft.com/~gray/Papers/MSR_TR_O2_01_20_queries.doc

arxiv created 2002/02/12 · openalex publication_date 2002/02/12 · arxiv updated 2009/11/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

An earlier paper (Szalay et. al. "Designing and Mining MultiTerabyte Astronomy Archives: The Sloan Digital Sky Survey," ACM SIGMOD 2000) described the Sloan Digital Sky Survey's (SDSS) data management needs by defining twenty database queries and twelve data visualization tasks that a good data management system should support. We built a database and interfaces to support both the query load and also a website for ad-hoc access. This paper reports on the database design, describes the data loading pipeline, and reports on the query implementation and performance. The queries typically translated to a single SQL statement. Most queries run in less than 20 seconds, allowing scientists to interactively explore the database. This paper is an in-depth tour of those queries. Readers should first have studied the companion overview paper Szalay et. al. "The SDSS SkyServer, Public Access to the Sloan Digital Sky Server Data" ACM SIGMOND 2002.

Cited by

Related