I'm Me, We're Us, and I'm Us: Tri-directional Contrastive Learning on Hypergraphs
Abstract
Although machine learning on hypergraphs has attracted considerable attention, most of the works have focused on (semi-)supervised learning, which may cause heavy labeling costs and poor generalization. Recently, contrastive learning has emerged as a successful unsupervised representation learning method. Despite the prosperous development of contrastive learning in other domains, contrastive learning on hypergraphs remains little explored. In this paper, we propose TriCL (-directional ontrastive earning), a general framework for contrastive learning on hypergraphs. Its main idea is tri-directional contrast, and specifically, it aims to maximize in two augmented views the agreement (a) between the same node, (b) between the same group of nodes, and (c) between each group and its members. Together with simple but surprisingly effective data augmentation and negative sampling schemes, these three forms of contrast enable TriCL to capture both node- and group-level structural information in node embeddings. Our extensive experiments using 14 baseline approaches, 10 datasets, and two tasks demonstrate the effectiveness of TriCL, and most noticeably, TriCL almost consistently outperforms not just unsupervised competitors but also (semi-)supervised competitors mostly by significant margins for node classification. The code and datasets are available at.
Benchmark Results
Tested on 3 datasets 12 baseline values reported too low Non-standard metric on 1 dataset
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | CNA | 0.9575
±0.0058 | |
| 2 | IS-GIB | 0.9390
±0.0187 | |
| 3 | EERM | 0.9112
±0.0145 | |
| 35 | GAT | 0.8080
±0.0026 best reported | best at pub: Gophormer: Ego-Graph Transformer for Node Classification (2021) best today: Feature Expansion for Graph Neural Networks (ICML 2023) |
| 44 | GCN | 0.8033
±0.0088 best reported | best at pub: Gophormer: Ego-Graph Transformer for Node Classification (2021) |
| 61 | GraphSAGE | 0.7923
±0.0053 | |
| 66 | DGI | 0.7890
±0.0020 best reported | best at pub: Node Representation Learning in Graph via Node-to-Neighbourhood Mutual Information Maximization (2022) best today: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) |
| 201 | GRACE | 0.7450
±0.0010 best reported | best at pub: Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learning (AAAI 2020) best today: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) |
| 350 | MLP | 0.7289
±0.0010 best reported | best at pub: Block Modeling-Guided Graph Convolutional Neural Networks (AAAI 2021) best today: Gumbel-MPNN: Graph Rewiring with Gumbel-Softmax (2025) |
| 360 | HyperGCN | 0.7276
±0.0112 best reported | Difference within reported uncertainty; not counted as underperformance. |
| 373 | HNHN | 0.7264
±0.0157 best reported | |
| 457 | TriCL (L_n + L_g) | 0.7202
±0.0120 | This paper |
| 524 | TriCL-NG | 0.7138
±0.0120 | This paper |
| 609 | TriCL-N | 0.7028
±0.0150 | This paper |
| 679 | S2-HHGR | 0.6821
±0.0180 | This paper |
| 693 | AllSet | 0.6783
±0.0180 | This paper |
| 737 | UniGCN | 0.6640
±0.0190 | This paper |
| 750 | HGNN | 0.6616
±0.0230 | This paper |
| 766 | Node2Vec | 0.6552
±0.0018 best reported | |
| 791 | HyperConv | 0.6412
±0.0260 | This paper |
| 827 | Random-Init | 0.6044
±0.0250 | This paper |
| 863 | HyperSAGE | 0.5243
±0.0940 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | LGTL | 0.9518
±0.0011 | |
| 2 | MixHop (LO) | 0.9513
±0.0038 | |
| 3 | GraphSAGE (LO) | 0.9511
±0.0036 | |
| 18 | GCN | 0.9296
±0.0015 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 20 | GAT | 0.9233
±0.0018 best reported | best at pub: Tackling Over-Smoothing for General Graph Convolutional Networks (2020) |
| 116 | SAGE | 0.8881
±0.0015 | |
| 194 | GRACE | 0.8730
±0.0010 best reported | best at pub: Augmentation-Free Graph Contrastive Learning with Performance Guarantee (2022) best today: Oversmoothing: A Nightmare for Graph Contrastive Learning? (2023) |
| 204 | DGI | 0.8708
±0.0017 best reported | |
| 210 | MLP | 0.8690
±0.0074 best reported | best at pub: Block Modeling-Guided Graph Convolutional Neural Networks (AAAI 2021) best today: On the Equivalence of Graph Convolution and Mixup (TMLR 2023) |
| 225 | HGNN | 0.8644
±0.0044 best reported | |
| 251 | Node2Vec | 0.8520
±0.0002 best reported | |
| 272 | TriCL (L_n + L_g) | 0.8426
±0.0060 | This paper |
| 273 | HNHN | 0.8421
±0.0064 best reported | |
| 277 | UniGCN | 0.8408
±0.0070 | This paper |
| 287 | TriCL-NG | 0.8368
±0.0070 | This paper |
| 293 | TriCL-N | 0.8344
±0.0060 | This paper |
| 295 | HyperConv | 0.8342
±0.0060 | This paper |
| 307 | AllSet | 0.8285
±0.0090 | This paper |
| 308 | HyperGCN | 0.8284
±0.0067 best reported | Difference within reported uncertainty; not counted as underperformance. |
| 325 | S2-HHGR | 0.8213
±0.0060 | This paper |
| 519 | HyperSAGE | 0.7949
±0.0870 | This paper |
| 854 | Random-Init | 0.6749
±0.0220 | This paper |
Heterogeneous Graph Benchmarks
DBLP
Global leaderboard →Sorted by Accuracy. Highlighted rows are from other papers.
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | HG-SCM | 0.9490
±0.0015 | |
| 2 | SeHGNN | 0.9489
±0.0018 | |
| 3 | AdvSynGNN | 0.9486
±0.0012 | |
| 22 | TriCL (L_n + L_g) | 0.9112
±0.0010 | This paper |
| 23 | TriCL-NG | 0.9094
±0.0010 | This paper |
| 24 | TriCL-N | 0.9088
±0.0010 | This paper |
| 25 | UniGCN | 0.9031
±0.0020 | This paper |
| 27 | AllSet | 0.9007
±0.0030 | This paper |
| 29 | HyperConv | 0.8883
±0.0020 | This paper |
| 30 | S²-HHGR | 0.8869
±0.0020 | This paper |
| 31 | GAT | 0.8859
±0.0010 | prev best: Directed Graph Convolutional Network (2020) |
| 32 | HGNN | 0.8832
±0.0030 | This paper |
| 34 | DGI | 0.8800
±0.0020 | prev best: Deep Graph Contrastive Representation Learning (2020) |
| 36 | GCN | 0.8758
±0.0020 | prev best: Deep Graph Contrastive Representation Learning (2020) |
| 39 | HNHN | 0.8671
±0.0120 | This paper |
| 65 | MLP | 0.8118
±0.0020 | This paper |
| 74 | HyperSAGE | 0.7963
±0.0860 | This paper |
| 79 | Node2Vec | 0.7880 best reported | best at pub: Deep Graph Contrastive Representation Learning (2020) |
| 89 | HyperGCN | 0.7659
±0.0760 | This paper |
| 90 | Random-Init | 0.7657
±0.0060 | This paper |
| 105 | GraphSAGE | 0.7455
±0.0061 |
