vix.ing · top · new · best · stats · spec

Local2Global: A distributed approach for scaling representation learning on graphs

2022/01/12 by Lucas G. S. Jeub, Jeub, Lucas G. S., Giovanni Colavizza +7
Computer Science · Physics and Astronomy · #Anomaly Detection Techniques and Applications #Complex Network Analysis Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Security and Intrusion Detection

paper · pdf · doi:10.48550/arxiv.2201.04729

openalex publication_date 2022/01/12 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We propose a decentralised "local2global"' approach to graph representation learning, that one can a-priori use to scale any embedding technique. Our local2global approach proceeds by first dividing the input graph into overlapping subgraphs (or "patches") and training local representations for each patch independently. In a second step, we combine the local representations into a globally consistent representation by estimating the set of rigid motions that best align the local representations using information from the patch overlaps, via group synchronization. A key distinguishing feature of local2global relative to existing work is that patches are trained independently without the need for the often costly parameter synchronization during distributed training. This allows local2global to scale to large-scale industrial applications, where the input graph may not even fit into memory and may be stored in a distributed manner. We apply local2global on data sets of different sizes and show that our approach achieves a good trade-off between scale and accuracy on edge reconstruction and semi-supervised classification. We also consider the downstream task of anomaly detection and show how one can use local2global to highlight anomalies in cybersecurity networks.

Related