Edgeless-GNN: Unsupervised Inductive Edgeless Network Embedding

We study the problem of embedding edgeless nodes such as users who newly enter the underlying network, while using graph neural networks (GNNs) widely studied for effective representation learning of graphs thanks to its highly expressive capability via message passing. Our study is motivated by the fact that existing GNNs cannot be adopted for our problem since message passing to such edgeless nodes having no connections is impossible. To tackle this challenge, we propose Edgeless-GNN, a new framework that enables GNNs to generate node embeddings even for edgeless nodes through unsupervised inductive learning. Specifically, we start by constructing a $k$-nearest neighbor graph ($k$NNG) based on the similarity of node attributes to replace the GNNs computation graph defined by the neighborhood-based aggregation of each node. As our main contributions, the known network structure is used to train model parameters, while a new loss function is established using energy-based learning in such a way that our model learns the network structure. For the edgeless nodes, we inductively infer embeddings for the edgeless nodes by using edges via $k$NNG construction as a computation graph. By evaluating the performance of various downstream machine learning (ML) tasks, we empirically demonstrate that Edgeless-GNN consistently outperforms state-of-the-art methods of inductive network embedding. Moreover, our findings corroborate the effectiveness of Edgeless-GNN in judiciously combining the replaced computation graph with our newly designed loss. Our framework is GNN-model-agnostic; thus, GNN models can be appropriately chosen according to ones needs and ML tasks.