Semantic-aware Node Synthesis for Imbalanced Heterogeneous Information Networks

Xinyi Gao, Wentao Zhang, Tong Chen, Junliang Yu, Hung Quoc Viet Nguyen, Hongzhi Yin

Main figure for Semantic-aware Node Synthesis for Imbalanced Heterogeneous Information Networks

Abstract

Heterogeneous graph neural networks (HGNNs) have exhibited exceptional efficacy in modeling the complex heterogeneity in heterogeneous information networks (HINs). The critical advantage of HGNNs is their ability to handle diverse node and edge types in HINs by extracting and utilizing the abundant semantic information for effective representation learning. As a widespread phenomenon in many real-world scenarios, the class-imbalance distribution in HINs creates a performance bottleneck for existing HGNNs. Apart from the node imbalance in quantity, the more crucial and distinctive challenge in HINs is semantic imbalance. Minority classes in HINs often lack diverse and sufficient neighbor nodes, resulting in biased and incomplete semantic information. This semantic imbalance further compounds the difficulty of accurately classifying minority nodes, leading to the performance degradation of HGNNs. However, existing remedies are either tailored for non-graph data or designed specifically for homogeneous graphs, thus overlooking the inherent semantic imbalance in HINs. To tackle the imbalance of minority classes and supplement their inadequate semantics, we present the first method for the semantic imbalance problem in imbalanced HINs named Semantic-aware Node Synthesis (SNS). By assessing the influence on minority classes, SNS adaptively selects the heterogeneous neighbor nodes and augments the network with synthetic nodes while preserving the minority semantics. In addition, we introduce two dedicated regularization approaches for HGNNs that explore the inter-type and intra-type information and constrain the representation of synthetic nodes from both semantic and class perspectives to effectively suppress the potential noises from synthetic nodes, facilitating more expressive embeddings for classification. The comprehensive experimental study demonstrates that SNS consistently outperforms existing methods in different benchmark datasets.

Proposed method: SNS

Benchmark Results

Tested on 3 datasets Non-standard metric on 3 datasets

Tables show presented results in global context (best 3 papers + GCN + MLP).

Heterogeneous Graph Benchmarks

DBLP

Global leaderboard →
Non-default metric. This paper reports F1; the dataset default is Micro-F1. Values below use F1 only.

Sorted by F1. Highlighted rows are from other papers.

#ModelF1 ↑Paper
1
AUG_bal
0.9454 ±0.0123
This paper
2
AUG_min
0.9375 ±0.0115
This paper
3
AUG_ran
0.9368 ±0.0108
This paper
5
SNS
0.9250 ±0.0053
This paper
8
GraphENS
0.9162 ±0.0019
This paper
9
Imbalance
0.9162 ±0.0178
This paper
10
Focal loss
0.9154 ±0.0038
This paper
12
ROS
0.9028 ±0.0087
This paper
14
Reweight
0.8995 ±0.0082
This paper
15
cRT
0.8987 ±0.0062
This paper
16
SMOTE
0.8970 ±0.0084
This paper
17
BS
0.8935 ±0.0176
This paper
18
Self-training
0.8934 ±0.0157
This paper
19
Vanilla
0.8932 ±0.0102
This paper
39
SAGE
0.7320

ACM

Global leaderboard →
Non-default metric. This paper reports F1; the dataset default is Micro-F1. Values below use F1 only.

Sorted by F1. Highlighted rows are from other papers.

#ModelF1 ↑Paper
1
SPGRL
0.9398
2
CDC
0.9360
3
SynC SSL
0.9274 ±0.0004
17
GCN
0.9049
42
SNS
0.6384 ±0.0078
This paper
43
cRT
0.6257 ±0.0169
This paper
44
GraphENS
0.6245 ±0.0141
This paper
45
Self-training
0.6206 ±0.0297
This paper
46
BS
0.6192 ±0.0189
This paper
47
Reweight
0.6145 ±0.0123
This paper
48
Focal loss
0.6116 ±0.0211
This paper
49
ROS
0.6113 ±0.0093
This paper
50
SMOTE
0.6102 ±0.0120
This paper
52
Vanilla
0.5975 ±0.0053
This paper

IMDB

Global leaderboard →
Non-default metric. This paper reports F1; the dataset default is Micro-F1. Values below use F1 only.

Sorted by F1. Highlighted rows are from other papers.

#ModelF1 ↑Paper
1
SGC
0.6151
2
GAT
0.6099
3
GCN
0.6083
5
GIN
0.5931
6
AUG_bal
0.5261 ±0.0182
This paper
7
AUG_ran
0.5155 ±0.0096
This paper
8
AUG_min
0.5131 ±0.0110
This paper
9
Imbalance
0.4974 ±0.0016
This paper
13
SNS
0.3513 ±0.0136
This paper
14
GraphENS
0.3380 ±0.0271
This paper
15
BS
0.3344 ±0.0153
This paper
16
Self-training
0.3344 ±0.0349
This paper
17
Reweight
0.3277 ±0.0149
This paper
18
Focal loss
0.3235 ±0.0176
This paper
19
ROS
0.3232 ±0.0323
This paper
20
cRT
0.2983 ±0.0145
This paper
21
SMOTE
0.2832 ±0.0089
This paper
22
Vanilla
0.2738 ±0.0141
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers)