ICML 2016

Revisiting Semi-Supervised Learning with Graph Embeddings

Zhilin Yang, William W. Cohen, R. Salakhutdinov

Main figure for Revisiting Semi-Supervised Learning with Graph Embeddings

Abstract

We present a semi-supervised learning framework based on graph embeddings. Given a graph between instances, we train an embedding for each instance to jointly predict the class label and the neighborhood context in the graph. We develop both transductive and inductive variants of our method. In the transductive variant of our method, the class labels are determined by both the learned embeddings and input feature vectors, while in the inductive variant, the embeddings are defined as a parametric function of the feature vectors, so predictions can be made on instances not seen during training. On a large and diverse set of benchmark tasks, including text classification, distantly supervised entity extraction, and entity classification, we show improved performance over many of the existing models.

Benchmark Results

Tested on 1 dataset

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
0.9004
724
MLP
0.7768
763
Planetoid-T
0.7570
This paper
827
Planetoid-G
0.6910
This paper
835
LP
actual #835 vs paper #836 1 place worse
0.6820
best reported
actual #835 vs paper #836 1 place worse
paper 0.6800
paper 0.6800 Δ today 0.0020
844
GraphEmb
0.6720
This paper
872
Planetoid-I
0.6120
This paper
875
ManiReg
actual #875 vs paper #877 2 places worse
0.6040 ±0.0080
best reported
actual #875 vs paper #877 2 places worse
paper 0.5950

Difference within reported uncertainty; not counted as underperformance.

paper 0.5950 Δ today 0.0090
880
SemiEmb
0.5900
This paper
885
TSVM
0.5750
This paper
886
Feat
0.5740
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best today — OK at publication; today's leaderboard best is elsewhere