Graph-Revised Convolutional Network

Donghan Yu, Ruohong Zhang, Zhengbao Jiang, Yuexin Wu, Yiming Yang

Main figure for Graph-Revised Convolutional Network

Abstract

Graph Convolutional Networks (GCNs) have received increasing attention in the machine learning community for effectively leveraging both the content features of nodes and the linkage patterns across graphs in various applications. As real-world graphs are often incomplete and noisy, treating them as ground-truth information, which is a common practice in most GCNs, unavoidably leads to sub-optimal solutions. Existing efforts for addressing this problem either involve an over-parameterized model which is difficult to scale, or simply re-weight observed edges without dealing with the missing-edge issue. This paper proposes a novel framework called Graph-Revised Convolutional Network (GRCN), which avoids both extremes. Specifically, a GCN-based graph revision module is introduced for predicting missing edges and revising edge weights w.r.t. downstream tasks via joint optimization. A theoretical analysis reveals the connection between GRCN and previous work on multigraph belief propagation. Experiments on six benchmark datasets show that GRCN consistently outperforms strong baseline methods, especially when the original graphs are severely incomplete or the labeled instances for model training are highly sparse.

Proposed method: GCNs

Benchmark Results

Tested on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphTARIF
0.9461 ±0.0017
2
GCN
actual #2 vs paper #407 405 places worse
0.8190 ±0.0170
actual #2 vs paper #407 405 places worse
paper 0.8190 ±0.0170

Improvement within reported uncertainty; not highlighted.

paper 0.8190 ±0.0170 Δ at pub 0.0020 Δ today 0.1222
3
GAT
actual #3 vs paper #408 405 places worse
0.8180 ±0.0200
actual #3 vs paper #408 405 places worse
paper 0.8180 ±0.0200

Improvement within reported uncertainty; not highlighted.

paper 0.8180 ±0.0200 Δ at pub 0.0040 Δ today 0.1218
8
SAGE
0.9351 ±0.0006
82
SGC
actual #82 vs paper #408 326 places worse
0.9022 ±0.0021
best reported
actual #82 vs paper #408 326 places worse
paper 0.8180 ±0.0230
paper 0.8180 ±0.0230 Δ today 0.0842
320
MLP
0.8463
359
GRCN
0.8370 ±0.0180
This paper
368
Fast-GRCN
0.8350 ±0.0160
This paper
428
GLCN
0.8040 ±0.0190
This paper
SOTA performance (not significantly different from the best) Baseline / comparison (this paper) Global context (other papers) Best today — OK at publication; today's leaderboard best is elsewhere