Energy-Balanced Hyperspherical Graph Representation Learning via Structural Binding and Entropic Dispersion

Rui Chen, Junjun Guo, Hongbin Wang, Yan Xiang, Yantuan Xian, Zhengtao Yu

Main figure for Energy-Balanced Hyperspherical Graph Representation Learning via Structural Binding and Entropic Dispersion

Abstract

Graph Representation Learning (GRL) can be fundamentally modeled as a physical process of seeking an energy equilibrium state for a node system on a latent manifold. However, existing Graph Neural Networks (GNNs) often suffer from uncontrolled energy dissipation during message passing, driving the system towards a state of Thermal Death—manifested as feature collapse or over-smoothing—due to the absence of explicit thermodynamic constraints. To address this, we propose HyperGRL, a thermodynamics-driven framework that embeds nodes on a unit hypersphere by minimizing a Helmholtz free energy objective composed of two competing potentials. First, we introduce Structural Binding Energy (via Neighbor-Mean Alignment), which functions as a local binding force to strengthen structural cohesion, encouraging structurally related nodes to form compact local clusters. Second, to counteract representation collapse, we impose a Mean-Field Repulsive Potential (via Sampling-Free Uniformity), which acts as a global entropic force to maximize representation dispersion without the need for negative sampling. Crucially, to govern the trade-off between local alignment and global uniformity, we devise an Adaptive Thermostat. This entropy-guided strategy dynamically regulates the system's ``temperature'' during training, guiding the representation towards a robust metastable state that balances local cohesion with global discriminability. Extensive experiments on node classification, node clustering, and link prediction show that HyperGRL consistently achieves strong performance across diverse benchmark datasets, yielding more discriminative and robust representations while alleviating over-smoothing.

Proposed method: HyperGRL

Benchmark Results

Tested on 2 datasets 15 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphTARIF
0.9703 ±0.0019
2
GAT
0.9669 ±0.0014
3
GAT+T
0.9660 ±0.0007
7
SAGE
0.9643 ±0.0027
8
GCN
actual #8 vs paper #292 284 places worse
0.9632 ±0.0008
best reported
actual #8 vs paper #292 284 places worse
paper 0.9242 ±0.0022
89
HyperGRL
0.9424 ±0.0002
This paper
103
SGRL
actual #103 vs paper #103
0.9395 ±0.0003
actual #103 vs paper #103
paper 0.9395 ±0.0003
paper 0.9395 ±0.0003 Δ at pub 0.0098
105
Str-GCL
0.9390 ±0.0026
This paper
155
PaGCL
0.9349 ±0.0031
This paper
157
SGCL
0.9346 ±0.0030
This paper
172
BGRL
actual #172 vs paper #313 141 places worse
0.9337 ±0.0021
best reported
actual #172 vs paper #313 141 places worse
paper 0.9228 ±0.0044
paper 0.9228 ±0.0044 Δ at pub 0.0109
186
CCA-SSG
actual #186 vs paper #201 15 places worse
0.9325 ±0.0021
best reported
actual #186 vs paper #201 15 places worse
paper 0.9314 ±0.0043

Difference within reported uncertainty; not counted as underperformance.

paper 0.9314 ±0.0043 Δ at pub 0.0011
191
GCA
actual #191 vs paper #305 114 places worse
0.9320 ±0.0060
best reported
actual #191 vs paper #305 114 places worse
paper 0.9235 ±0.0053
194
SUGRL
actual #194 vs paper #231 37 places worse
0.9320 ±0.0020
best reported
actual #194 vs paper #231 37 places worse
paper 0.9287 ±0.0019

Difference within reported uncertainty; not counted as underperformance.

paper 0.9287 ±0.0019 Δ at pub 0.0033 Δ today 0.0033
203
GRACE
actual #203 vs paper #324 121 places worse
0.9313 ±0.0017
best reported
actual #203 vs paper #324 121 places worse
paper 0.9220 ±0.0016
paper 0.9220 ±0.0016 Δ at pub 0.0093
206
MVGRL
actual #206 vs paper #359 153 places worse
0.9310 ±0.0040
best reported
actual #206 vs paper #359 153 places worse
paper 0.9177 ±0.0021
paper 0.9177 ±0.0021 Δ at pub 0.0133
213
DGI
actual #213 vs paper #366 153 places worse
0.9309 ±0.0008
best reported
actual #213 vs paper #366 153 places worse
paper 0.9162 ±0.0037
317
VGAE
actual #317 vs paper #327 10 places worse
0.9224
best reported
actual #317 vs paper #327 10 places worse
paper 0.9213 ±0.0012

Difference within reported uncertainty; not counted as underperformance.

paper 0.9213 ±0.0012 Δ at pub 0.0011
390
MLP
actual #390 vs paper #535 145 places worse
0.9128 ±0.0063
best reported
actual #390 vs paper #535 145 places worse
paper 0.7853 ±0.0032
paper 0.7853 ±0.0032 Δ at pub 0.1275
408
GMI
actual #408 vs paper #408
0.9081 ±0.0015
actual #408 vs paper #408
paper 0.9081 ±0.0015

Improvement within reported uncertainty; not highlighted.

paper 0.9081 ±0.0015 Δ at pub 0.0008
444
DeepWalk
actual #444 vs paper #465 21 places worse
0.9005 ±0.0008
best reported
actual #444 vs paper #465 21 places worse
paper 0.8940 ±0.0011
paper 0.8940 ±0.0011 Δ at pub 0.0065 Δ today 0.0065
457
Node2Vec
actual #457 vs paper #458 1 place worse
0.8970 ±0.0010
best reported
actual #457 vs paper #458 1 place worse
paper 0.8968 ±0.0019

Difference within reported uncertainty; not counted as underperformance.

paper 0.8968 ±0.0019 Δ at pub 0.0002 Δ today 0.0002
#ModelAccuracy ↑Paper
1
GCN
actual #1 vs paper #73 72 places worse
0.9302 ±0.0011
best reported
actual #1 vs paper #73 72 places worse
paper 0.8105 ±0.0006
paper 0.8105 ±0.0006 Δ at pub 0.1197
2
RSE + RGCN (70b)
0.8852 ±0.0019
3
LEMP+T
0.8825
9
SAGE
0.8771
31
GAT
actual #31 vs paper #78 47 places worse
0.8533
best reported
actual #31 vs paper #78 47 places worse
paper 0.8090 ±0.0009
paper 0.8090 ±0.0009 Δ at pub 0.0443
65
HyperGRL
0.8188 ±0.0015
This paper
66
Transformer
actual #66 vs paper #66
0.8188 ±0.0015
actual #66 vs paper #66
paper 0.8188 ±0.0015
paper 0.8188 ±0.0015 Δ at pub 0.0452
69
GraphSAGE
actual #69 vs paper #69
0.8146 ±0.0010
actual #69 vs paper #69
paper 0.8146 ±0.0010
87
PaGCL
0.8045 ±0.0051
This paper
94
GRACE
actual #94 vs paper #117 23 places worse
0.8014 ±0.0048
best reported
actual #94 vs paper #117 23 places worse
paper 0.7937 ±0.0024
paper 0.7937 ±0.0024 Δ at pub 0.0077 Δ today 0.0077
100
BGRL
actual #100 vs paper #118 18 places worse
0.8000 ±0.0010
best reported
actual #100 vs paper #118 18 places worse
paper 0.7928 ±0.0045
paper 0.7928 ±0.0045 Δ at pub 0.0072 Δ today 0.0072
103
SGCL
0.7985 ±0.0053
This paper
115
SGRL
0.7940 ±0.0010
This paper
130
CCA-SSG
actual #130 vs paper #186 56 places worse
0.7908 ±0.0053
best reported
actual #130 vs paper #186 56 places worse
paper 0.7767 ±0.0029
paper 0.7767 ±0.0029 Δ at pub 0.0141 Δ today 0.0141
138
SUGRL
actual #138 vs paper #143 5 places worse
0.7897 ±0.0022
best reported
actual #138 vs paper #143 5 places worse
paper 0.7888 ±0.0035

Difference within reported uncertainty; not counted as underperformance.

paper 0.7888 ±0.0035 Δ at pub 0.0009 Δ today 0.0009
151
DGI
actual #151 vs paper #226 75 places worse
0.7865 ±0.0690
best reported
actual #151 vs paper #226 75 places worse
paper 0.7542 ±0.0017

Difference within reported uncertainty; not counted as underperformance.

paper 0.7542 ±0.0017 Δ at pub 0.0323
162
GCA
actual #162 vs paper #167 5 places worse
0.7840 ±0.0013
best reported
actual #162 vs paper #167 5 places worse
paper 0.7826 ±0.0039

Difference within reported uncertainty; not counted as underperformance.

paper 0.7826 ±0.0039 Δ at pub 0.0014 Δ today 0.0014
180
VGAE
actual #180 vs paper #224 44 places worse
0.7787 ±0.0053
best reported
actual #180 vs paper #224 44 places worse
paper 0.7555 ±0.0022
paper 0.7555 ±0.0022 Δ at pub 0.0232
190
MVGRL
actual #190 vs paper #190
0.7757 ±0.0046
best reported
actual #190 vs paper #190
paper 0.7755 ±0.0006

Difference within reported uncertainty; not counted as underperformance.

paper 0.7755 ±0.0006 Δ at pub 0.0002 Δ today 0.0002
198
DeepWalk
actual #198 vs paper #238 40 places worse
0.7721
best reported
actual #198 vs paper #238 40 places worse
paper 0.7442 ±0.0013
paper 0.7442 ±0.0013 Δ at pub 0.0279
234
GMI
actual #234 vs paper #235 1 place worse
0.7490 ±0.0010
best reported
actual #234 vs paper #235 1 place worse
paper 0.7479 ±0.0016

Difference within reported uncertainty; not counted as underperformance.

paper 0.7479 ±0.0016 Δ at pub 0.0011
237
MLP
actual #237 vs paper #252 15 places worse
0.7469 ±0.0085
best reported
actual #237 vs paper #252 15 places worse
paper 0.7198 ±0.0042
paper 0.7198 ±0.0042 Δ at pub 0.0271
258
Node2Vec
actual #258 vs paper #259 1 place worse
0.7180 ±0.0010
best reported
actual #258 vs paper #259 1 place worse
paper 0.7176 ±0.0014

Difference within reported uncertainty; not counted as underperformance.

paper 0.7176 ±0.0014 Δ at pub 0.0004
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best at pub — reported value improved over the best known when published Best today — OK at publication; today's leaderboard best is elsewhere