Label-Enhanced Graph Neural Network for Semi-supervised Node Classification
Abstract
Graph Neural Networks (GNNs) have been widely applied in the semi-supervised node classification task, where a key point lies in how to sufficiently leverage the limited but valuable label information. Most of the classical GNNs solely use the known labels for computing the classification loss at the output. In recent years, several methods have been designed to additionally utilize the labels at the input. One part of the methods augment the node features via concatenating or adding them with the one-hot encodings of labels, while other methods optimize the graph structure by assuming neighboring nodes tend to have the same label. To bring into full play the rich information of labels, in this paper, we present a label-enhanced learning framework for GNNs, which first models each label as a virtual center for intra-class nodes and then jointly learns the representations of both nodes and labels. Our approach could not only smooth the representations of nodes belonging to the same class, but also explicitly encode the label semantics into the learning process of GNNs. Moreover, a training node selection technique is provided to eliminate the potential label leakage issue and guarantee the model generalization ability. Finally, an adaptive self-training strategy is proposed to iteratively enlarge the training set with more reliable pseudo labels and distinguish the importance of each pseudo-labeled node during the model training process. Experimental results on both real-world and synthetic datasets demonstrate our approach can not only consistently outperform the state-of-the-arts, but also effectively smooth the representations of intra-class nodes.
Benchmark Results
Tested on 1 dataset 2 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
OGB
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LMSPS+LP+MS | 0.5784
±0.0022 | |
| 2 | SeHGNN+emb+ms | 0.5719
±0.0012 | |
| 3 | SeHGNN+ms | 0.5671
±0.0014 | |
| 23 | LEGNN | 0.5378 best reported | best today: SCNode: Spatial and Contextual Coordinates for Graph Representation Learning (TMLR 2024) |
| 24 | LEGNN + AS-Train | 0.5378
±0.0016 | This paper |
| 27 | SIGN | 0.5289
±0.0011 best reported | best at pub: Scalable Graph Neural Networks for Heterogeneous Graphs (2020) best today: Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization (KDD 2023) |
| 40 | HGConv | 0.5045
±0.0017 | This paper |
| 41 | R-GSN | 0.5032
±0.0037 | This paper |
| 42 | HGT | 0.5023
±0.0048 best reported | best at pub: Graph Attention MLP with Reliable Label Utilization (2021) |
| 48 | RGCN | 0.4811
±0.0048 best reported | best at pub: Heterogeneous Graph Representation Learning with Relation Awareness (2021) best today: Efficient Heterogeneous Graph Learning via Random Projection (2023) |
| 57 | GraphSAGE | 0.4646
±0.0060 | |
| 71 | MetaPath2Vec | 0.3544
±0.0036 | This paper |
| 76 | MLP | 0.3243 |
