vix.ing · top · new · best · stats · spec

Not Every Dependency Is Worth Discovering: Toward Value-Driven Data Dependency Discovery

2026/07/24 by Xiaolong Wan, Xixian Han
#cs.DB

paper · pdf

Abstract

Data dependency discovery has traditionally focused on identifying dependencies that hold in the data or are statistically strong. Yet a dependency may be valid without being valuable: it may be irrelevant to the governance task, redundant given existing knowledge, or too costly to discover, validate, maintain, and apply. We call for a shift from validity-driven to value-driven dependency discovery. We define dependency use value decision-theoretically as the expected reduction in task-specific loss from incorporating a dependency into the governance process, and define net value by further accounting for lifecycle costs. Building on this framework, we outline principles for value-aware search, validation, dependency-set selection, and maintenance, and identify a research agenda spanning value estimation before full discovery, loss and cost learning, budgeted set selection, lifecycle monitoring, and benchmarking.

Citations

Related