DashQL -- Complete Analysis Workflows with SQL

2023/06/06 by André Kohn, Dominik Moritz, Kohn, André +3 · 1 citation
Decision Sciences · Computer Science · #Scientific Computing and Data Management #Advanced Database Systems and Queries #Data Visualization and Analytics

paper · pdf · doi:10.48550/arxiv.2306.03714

Abstract

We present DashQL, a language that describes complete analysis workflows in self-contained scripts. DashQL combines SQL, the grammar of relational database systems, with a grammar of graphics in a grammar of analytics. It supports preparing and visualizing arbitrarily complex SQL statements in a single coherent language. The proximity to SQL facilitates holistic optimizations of analysis workflows covering data input, encoding, transformations, and visualizations. These optimizations use model and query metadata for visualization-driven aggregation, remote predicate pushdown, and adaptive materialization. We introduce the DashQL language as an extension of SQL and describe the efficient and interactive processing of text-based analysis workflows.

Cited by

• Mosaic Selections: Managing and Optimizing User Selections for Scalable Data Visualization Systems

Related

• End-to-end Text-to-SQL Generation within an Analytics Insight Engine
• DB-Explore: Automated Database Exploration and Instruction Synthesis for Text-to-SQL
• SQLFlow: A Bridge between SQL and Machine Learning
• Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows
• Query and Conquer: Execution-Guided SQL Generation