vix.ing · top · new · best · stats · spec

Improving Skip-Gram based Graph Embeddings via Centrality-Weighted Sampling

2019/07/20 by Pedro Almagro-Blanco, Almagro-Blanco, Pedro, Fernando Sancho Caparrini +1
Computer Science · Physics and Astronomy · #Advanced Graph Neural Networks #Complex Network Analysis Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Social and Information Networks (cs.SI) #Topic Modeling

paper · pdf · doi:10.48550/arxiv.1907.08793

openalex publication_date 2019/07/20 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Network embedding techniques inspired by word2vec represent an effective unsupervised relational learning model. Commonly, by means of a Skip-Gram procedure, these techniques learn low dimensional vector representations of the nodes in a graph by sampling node-context examples. Although many ways of sampling the context of a node have been proposed, the effects of the way a node is chosen have not been analyzed in depth. To fill this gap, we have re-implemented the main four word2vec inspired graph embedding techniques under the same framework and analyzed how different sampling distributions affects embeddings performance when tested in node classification problems. We present a set of experiments on different well known real data sets that show how the use of popular centrality distributions in sampling leads to improvements, obtaining speeds of up to 2 times in learning times and increasing accuracy in all cases.

Citations

Related