2022/02/15 by Jiayi Li, Yujiu Yang, Li, Jiayi +1 · 2 citations
Computer Science · Mathematics · #Advanced Graph Neural Networks #Algorithm #Artificial intelligence #Bayesian Modeling and Causal Inference #Bilinear interpolation #Computer science #Computer vision #Embedding #FOS: Computer and information sciences #Geometry #Graph #Invertible matrix #Machine Learning (cs.LG) #Mathematics #Pure mathematics #Rotation (mathematics) #Scaling #Theoretical computer science #Topic Modeling #Translation (biology) #cs.LG
paper · pdf · doi:10.48550/arxiv.2202.07130
published in arXiv (Cornell University) (Cornell University)
arxiv created 2022/02/15 · openalex publication_date 2022/02/15 · arxiv updated 2022/02/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/08
The bilinear method is mainstream in Knowledge Graph Embedding (KGE), aiming to learn low-dimensional representations for entities and relations in Knowledge Graph (KG) and complete missing links. Most of the existing works are to find patterns between relationships and effectively model them to accomplish this task. Previous works have mainly discovered 6 important patterns like non-commutativity. Although some bilinear methods succeed in modeling these patterns, they neglect to handle 1-to-N, N-to-1, and N-to-N relations (or complex relations) concurrently, which hurts their expressiveness. To this end, we integrate scaling, the combination of translation and rotation that can solve complex relations and patterns, respectively, where scaling is a simplification of projection. Therefore, we propose a corresponding bilinear model Scaling Translation and Rotation (STaR) consisting of the above two parts. Besides, since translation cannot be incorporated into the bilinear model directly, we introduce translation matrix as the equivalent. Theoretical analysis proves that STaR is capable of modeling all patterns and handling complex relations simultaneously, and experiments demonstrate its effectiveness on commonly used benchmarks for link prediction.