GANN: Graph Alignment Neural Network for Semi-Supervised Learning

Linxuan Song, Wenxuan Tu, Sihang Zhou, Xinwang Liu, En Zhu

Main figure for GANN: Graph Alignment Neural Network for Semi-Supervised Learning

Abstract

Graph neural networks (GNNs) have been widely investigated in the field of semi-supervised graph machine learning. Most methods fail to exploit adequate graph information when labeled data is limited, leading to the problem of oversmoothing. To overcome this issue, we propose the Graph Alignment Neural Network (GANN), a simple and effective graph neural architecture. A unique learning algorithm with three alignment rules is proposed to thoroughly explore hidden information for insufficient labels. Firstly, to better investigate attribute specifics, we suggest the feature alignment rule to align the inner product of both the attribute and embedding matrices. Secondly, to properly utilize the higher-order neighbor information, we propose the cluster center alignment rule, which involves aligning the inner product of the cluster center matrix with the unit matrix. Finally, to get reliable prediction results with few labels, we establish the minimum entropy alignment rule by lining up the prediction probability matrix with its sharpened result. Extensive studies on graph benchmark datasets demonstrate that GANN can achieve considerable benefits in semi-supervised node classification and outperform state-of-the-art competitors.

Proposed method: GANN

Benchmark Results

Tested on 3 datasets 3 baseline values reported too low Non-standard metric on 3 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterogeneous Graph Benchmarks

DBLP

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is Micro-F1. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
HG-SCM
0.9490 ±0.0015
2
SeHGNN
0.9489 ±0.0018
3
AdvSynGNN
0.9486 ±0.0012
31
GAT
actual #31 vs paper #73 42 places worse
0.8859 ±0.0010
best reported
actual #31 vs paper #73 42 places worse
paper 0.7997 ±0.0058
paper 0.7997 ±0.0058 Δ at pub 0.0862
36
GCN
actual #36 vs paper #79 43 places worse
0.8758 ±0.0020
best reported
actual #36 vs paper #79 43 places worse
paper 0.7879 ±0.0054
paper 0.7879 ±0.0054 Δ at pub 0.0879
60
GANN
0.8204 ±0.0022
This paper
61
SGC
actual #61 vs paper #77 16 places worse
0.8170
best reported
actual #61 vs paper #77 16 places worse
paper 0.7927 ±0.0107
paper 0.7927 ±0.0107 Δ at pub 0.0243
65
MLP
0.8118 ±0.0020
66
GPRGNN
0.8092 ±0.0020
This paper
70
AdaGCN
0.8045 ±0.0083
This paper
71
PPNP
0.8040 ±0.0042
This paper
72
GCN-Cheby
0.8033 ±0.0097
This paper
73
FAGCN
0.7998 ±0.0089
This paper
75
JK-Net
0.7962 ±0.0058
This paper
76
APPNP
0.7962 ±0.0074
This paper
78
GWNN
0.7927 ±0.0054
This paper
80
V. GCN
0.7832 ±0.0078
This paper
105
GraphSAGE
0.7455 ±0.0061
106
MixupForGraph
0.7429 ±0.0071
This paper

ACM

Global leaderboard →
Non-default metric. This paper reports Accuracy; the dataset default is Micro-F1. Values below use Accuracy only.

Sorted by Accuracy. Highlighted rows are from other papers.

#ModelAccuracy ↑Paper
1
SignGT
0.9545 ±0.0049
2
NodeFormer
0.9493 ±0.0035
3
FAGCN
actual #3 vs paper #46 43 places worse
0.9487 ±0.0059
best reported
actual #3 vs paper #46 43 places worse
paper 0.9038 ±0.0086
paper 0.9038 ±0.0086 Δ today 0.0449
7
GAT
actual #7 vs paper #47 40 places worse
0.9424 ±0.0043
best reported
actual #7 vs paper #47 40 places worse
paper 0.9016 ±0.0052
paper 0.9016 ±0.0052 Δ today 0.0408
26
SGC
actual #26 vs paper #37 11 places worse
0.9175 ±0.0048
actual #26 vs paper #37 11 places worse
paper 0.9175 ±0.0048
29
GANN
0.9323 ±0.0034
This paper
32
APPNP
actual #32 vs paper #39 7 places worse
0.9300 ±0.0055
best reported
actual #32 vs paper #39 7 places worse
paper 0.9154 ±0.0034
34
GCN
actual #34 vs paper #37 3 places worse
0.9185 ±0.0040
actual #34 vs paper #37 3 places worse
paper 0.9185 ±0.0040
paper 0.9185 ±0.0040 Δ at pub 0.1630
39
PPNP
0.9164 ±0.0044
This paper
42
V. GCN
0.9106 ±0.0044
This paper
43
GCN-Cheby
0.9101 ±0.0056
This paper
46
JK-Net
0.9056 ±0.0056
This paper
51
MixupForGraph
0.8933 ±0.0059
This paper
67
GraphSAGE
0.7529 ±0.0020

Hypergraph Benchmarks

AMAP

Global leaderboard →
Non-default metric. This paper reports F1; the dataset default is Accuracy. Values below use F1 only.

Sorted by F1. Highlighted rows are from other papers.

#ModelF1 ↑Paper
1
GANN
0.9405 ±0.0037
This paper
2
GPRGNN
0.9308 ±0.0026
This paper
3
GAT
0.9238 ±0.0014
This paper
4
JK-Net
0.9168 ±0.0082
This paper
5
GCN-Cheby
0.9156 ±0.0075
This paper
6
GWNN
0.9075 ±0.0126
This paper
7
SGC
0.9017 ±0.0075
This paper
8
FAGCN
0.9006 ±0.0104
This paper
9
MixupForGraph
0.8728 ±0.0108
This paper
10
PPNP
0.8627 ±0.0074
This paper
11
APPNP
0.8602 ±0.0076
This paper
13
V. GCN
0.8141 ±0.0147
This paper
14
GCN
0.8115 ±0.0105
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Improved at pub — later paper surpassed this result Best today — OK at publication; today's leaderboard best is elsewhere