FMP: Toward Fair Graph Message Passing against Topology Bias

Zhimeng Jiang, Xiaotian Han, Chao Fan, Zirui Liu, Na Zou, A. Mostafavi, Xia Hu

Main figure for FMP: Toward Fair Graph Message Passing against Topology Bias

Abstract

Despite recent advances in achieving fair representations and predictions through regularization, adversarial debiasing, and contrastive learning in graph neural networks (GNNs), the working mechanism (i.e., message passing) behind GNNs inducing unfairness issue remains unknown. In this work, we theoretically and experimentally demonstrate that representative aggregation in message passing schemes accumulates bias in node representation due to topology bias induced by graph topology. Thus, a Fair Message Passing (FMP) scheme is proposed to aggregate useful information from neighbors but minimize the effect of topology bias in a unified framework considering graph smoothness and fairness objectives. The proposed FMP is effective, transparent, and compatible with back-propagation training. An acceleration approach on gradient calculation is also adopted to improve algorithm efficiency. Experiments on node classification tasks demonstrate that the proposed FMP outperforms the state-of-the-art baselines in effectively and efficiently mitigating bias on three real-world datasets.

Proposed method: FMP

Benchmark Results

Tested on 1 dataset 1 baseline value reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

LINKX Benchmarks

#ModelAccuracy ↑Paper
1
SAGE
0.8597 ±0.0021
2
Polynormer
0.8595 ±0.0007
3
NID_SAGE
0.8563 ±0.0031
23
GCN
actual #23 vs paper #27 4 places worse
0.7601 ±0.0049
best reported
actual #23 vs paper #27 4 places worse
paper 0.7178 ±0.0037
paper 0.7178 ±0.0037 Δ at pub 0.0367 Δ today 0.0423
24
GraphSAGE
0.7576 ±0.0004
28
GAT
actual #28 vs paper #31 3 places worse
0.7177 ±0.0618
best reported
actual #28 vs paper #31 3 places worse
paper 0.6976 ±0.0130

Difference within reported uncertainty; not counted as underperformance.

paper 0.6976 ±0.0130 Δ today 0.0201
29
SGC
0.7124 ±0.0046
This paper
30
FMP
0.7050 ±0.0050
This paper
31
MLP
actual #31 vs paper #31
0.7048 ±0.0077
actual #31 vs paper #31
paper 0.7048 ±0.0077
paper 0.7048 ±0.0077 Δ at pub 0.0811
34
APPNP
0.6691 ±0.0146
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published