vix.ing · top · new · best · stats · spec

Dimensionally Distributed Learning: Models and Algorithm

2008/07/18 by Haipeng Zheng, Zheng, Haipeng, Sanjeev R. Kulkarni +3
Computer Science · #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #Face and Expression Recognition #Information Theory (cs.IT) #Neural Networks and Applications

paper · pdf · doi:10.48550/arxiv.0807.3050

openalex publication_date 2008/07/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper introduces a framework for regression with dimensionally distributed data with a fusion center. A cooperative learning algorithm, the iterative conditional expectation algorithm (ICEA), is designed within this framework. The algorithm can effectively discover linear combinations of individual estimators trained by each agent without transferring and storing large amount of data amongst the agents and the fusion center. The convergence of ICEA is explored. Specifically, for a two agent system, each complete round of ICEA is guaranteed to be a non-expansive map on the function space of each agent. The advantages and limitations of ICEA are also discussed for data sets with various distributions and various hidden rules. Moreover, several techniques are also designed to leverage the algorithm to effectively learn more complex hidden rules that are not linearly decomposable.

Related