2023/08/10 by Jacopo Tagliabue, Tagliabue, Jacopo, Ciro Greco +3 · 2 voices · 3 citations
Business, Management and Accounting · Computer Science · Decision Sciences · #Big Data and Business Intelligence #Data Quality and Management #Databases (cs.DB) #Distributed #FOS: Computer and information sciences #Parallel #Scientific Computing and Data Management #Software Engineering (cs.SE) #and Cluster Computing (cs.DC) #cs.DB #cs.DC #cs.SE
paper · pdf · doi:10.48550/arxiv.2308.05368
openalex publication_date 2023/08/10 · arxiv published 2023/08/10 · arxiv updated 2023/08/10 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
The recently proposed Data Lakehouse architecture is built on open file formats, performance, and first-class support for data transformation, BI and data science: while the vision stresses the importance of lowering the barrier for data work, existing implementations often struggle to live up to user expectations. At Bauplan, we decided to build a new serverless platform to fulfill the Lakehouse vision. Since building from scratch is a challenge unfit for a startup, we started by re-using (sometimes unconventionally) existing projects, and then investing in improving the areas that would give us the highest marginal gains for the developer experience. In this work, we review user experience, high-level architecture and tooling decisions, and conclude by sharing plans for future development.