FMP: Toward Fair Graph Message Passing against Topology Bias
Abstract
Despite recent advances in achieving fair representations and predictions through regularization, adversarial debiasing, and contrastive learning in graph neural networks (GNNs), the working mechanism (i.e., message passing) behind GNNs inducing unfairness issue remains unknown. In this work, we theoretically and experimentally demonstrate that representative aggregation in message passing schemes accumulates bias in node representation due to topology bias induced by graph topology. Thus, a Fair Message Passing (FMP) scheme is proposed to aggregate useful information from neighbors but minimize the effect of topology bias in a unified framework considering graph smoothness and fairness objectives. The proposed FMP is effective, transparent, and compatible with back-propagation training. An acceleration approach on gradient calculation is also adopted to improve algorithm efficiency. Experiments on node classification tasks demonstrate that the proposed FMP outperforms the state-of-the-art baselines in effectively and efficiently mitigating bias on three real-world datasets.
Benchmark Results
Tested on 1 dataset 1 baseline value reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
LINKX Benchmarks
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | SAGE | 0.8597
±0.0021 | |
| 2 | Polynormer | 0.8595
±0.0007 | |
| 3 | NID_SAGE | 0.8563
±0.0031 | |
| 23 | GCN | 0.7601
±0.0049 best reported | best at pub: Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited (NeurIPS 2022) best today: Mixture of Weak & Strong Experts on Graphs (ICLR 2023) |
| 24 | GraphSAGE | 0.7576
±0.0004 | |
| 28 | GAT | 0.7177
±0.0618 best reported | best today: Mixture of Weak & Strong Experts on Graphs (ICLR 2023) Difference within reported uncertainty; not counted as underperformance. |
| 29 | SGC | 0.7124
±0.0046 | This paper |
| 30 | FMP | 0.7050
±0.0050 | This paper |
| 31 | MLP | 0.7048
±0.0077 | prev best: Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited (NeurIPS 2022) |
| 34 | APPNP | 0.6691
±0.0146 | This paper |
