Beyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Models

Feng Li, Liang Zhang, Y. Zuo, Rui Zhao, Yansong Liu, Yunfei Ma, Fanyu Meng, Junlan Feng

Main figure for Beyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Models

Abstract

Graph-based tasks in the zero-shot setting remain a significant challenge due to data scarcity and the inability of traditional Graph Neural Networks (GNNs) to generalize to unseen domains or label spaces. While recent advancements have transitioned toward leveraging Large Language Models (LLMs) as predictors to enhance GNNs, these methods often suffer from cross-modal alignment issues. A recent paradigm (i.e., Graph-R1) overcomes the aforementioned architectural dependencies by adopting a purely text-based format and utilizing LLM-based graph reasoning, showing improved zero-shot generalization. However, it employs a task-agnostic, one-size-fits-all subgraph extraction strategy, which inevitably introduces significant structural noise—irrelevant neighbors and edges—that distorts the LLMs' receptive field and leads to suboptimal predictions. To address this limitation, we introduce GraphSSR, a novel framework designed for adaptive subgraph extraction and denoising in zero-shot LLM-based graph reasoning. Specifically, we propose the SSR pipeline, which dynamically tailors subgraph extraction to specific contexts through a ``Sample-Select-Reason'' process, enabling the model to autonomously filter out task-irrelevant neighbors and overcome the one-size-fits-all issue. To internalize this capability, we develop SSR-SFT, a data synthesis strategy that generates high-quality SSR-style graph reasoning traces for supervised fine-tuning of LLMs. Furthermore, we propose SSR-RL, a two-stage reinforcement learning framework that explicitly regulates sampling and selection operations within the proposed SSR pipeline designed for adaptive subgraph denoising. By incorporating Authenticity-Reinforced and Denoising-Reinforced RL, we guide the model to achieve accurate predictions using parsimonious, denoised subgraphs for reasoning. Extensive experiments across multiple benchmarks demonstrate that GraphSSR significantly outperforms state-of-the-art methods, highlighting the necessity of adaptive subgraph denoising for zero-shot graph reasoning. Our code is publicly available at.

Proposed method: GraphSSR

Benchmark Results

Tested on 2 datasets 3 baseline values reported too low

Tables show presented results in global context (best 3 papers + GCN + MLP).

Classic

#ModelAccuracy ↑Paper
1
GraphSAGE+CNA
0.9418 ±0.0033
2
GCN+CNA
0.9366 ±0.0048
3
TransformerConv
0.9350 ±0.0058
21
GCN
0.9004
124
LLaGA
actual #124 vs paper #898 774 places worse
0.8745
best reported
actual #124 vs paper #898 774 places worse
paper 0.5185
680
OFA
actual #680 vs paper #913 233 places worse
0.7941
best reported
actual #680 vs paper #913 233 places worse
paper 0.2865
paper 0.2865 Δ at pub 0.5076
724
MLP
0.7768
799
GraphSSR
0.7241
This paper
810
Graph-R1
0.7153
This paper
814
GOFA-T
0.7081
This paper
821
DeepSeek-R1-0528
0.6959
This paper
822
UniGraph
0.6953
This paper
823
GOFA-F
0.6941
This paper
825
Ministral-3-14B-Reasoning-2512
0.6930
This paper
830
DeepSeek-R1-distilled-Qwen2.5-14B
0.6880
This paper
862
Qwen3-14B (Thinking)
0.6515
This paper
868
ZeroG
0.6421
This paper
907
GraphGPT
0.4465
This paper
#ModelAccuracy ↑Paper
1
GCN
0.9302 ±0.0011
2
RSE + RGCN (70b)
0.8852 ±0.0019
3
LEMP+T
0.8825
7
GraphSSR
0.8793
This paper
9
SAGE
0.8771
16
Graph-R1
0.8689
This paper
78
GOFA-T
0.8093
This paper
85
GOFA-F
0.8052
This paper
146
ZeroG
actual #146 vs paper #313 167 places worse
0.7882
best reported
actual #146 vs paper #313 167 places worse
paper 0.4825
155
Qwen3-14B (Thinking)
0.7856
This paper
156
OFA
actual #156 vs paper #314 158 places worse
0.7855 ±0.0037
best reported
actual #156 vs paper #314 158 places worse
paper 0.3515
208
DeepSeek-R1-0528
0.7696
This paper
228
Ministral-3-14B-Reasoning-2512
0.7538
This paper
230
DeepSeek-R1-distilled-Qwen2.5-14B
0.7526
This paper
237
MLP
0.7469 ±0.0085
306
UniGraph
0.6023
This paper
SOTA performance (not significantly different from the best) Proposed method (this paper) Baseline / comparison (this paper) Global context (other papers) Best at pub — reported result worse than the best known when published (best reported in green) Best today — OK at publication; today's leaderboard best is elsewhere