vix.ing · top · new · best · stats · spec

To Collaborate or Not in Distributed Statistical Estimation with Resource Constraints?

2022/05/31 by Yu-Zhen Janice Chen, Chen, Yu-Zhen Janice, Daniel Sadoc Menasché +3
Computer Science · Decision Sciences · #Advanced Statistical Process Monitoring #Distributed #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #Machine Learning (stat.ML) #Parallel #Target Tracking and Data Fusion in Sensor Networks #and Cluster Computing (cs.DC)

paper · pdf · doi:10.48550/arxiv.2206.00111

openalex publication_date 2022/05/31 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We study how the amount of correlation between observations collected by distinct sensors/learners affects data collection and collaboration strategies by analyzing Fisher information and the Cramer-Rao bound. In particular, we consider a simple setting wherein two sensors sample from a bivariate Gaussian distribution, which already motivates the adoption of various strategies, depending on the correlation between the two variables and resource constraints. We identify two particular scenarios: (1) where the knowledge of the correlation between samples cannot be leveraged for collaborative estimation purposes and (2) where the optimal data collection strategy involves investing scarce resources to collaboratively sample and transfer information that is not of immediate interest and whose statistics are already known, with the sole goal of increasing the confidence on an estimate of the parameter of interest. We discuss two applications, IoT DDoS attack detection and distributed estimation in wireless sensor networks, that may benefit from our results.

Related