Beyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Models
Abstract
Graph-based tasks in the zero-shot setting remain a significant challenge due to data scarcity and the inability of traditional Graph Neural Networks (GNNs) to generalize to unseen domains or label spaces. While recent advancements have transitioned toward leveraging Large Language Models (LLMs) as predictors to enhance GNNs, these methods often suffer from cross-modal alignment issues. A recent paradigm (i.e., Graph-R1) overcomes the aforementioned architectural dependencies by adopting a purely text-based format and utilizing LLM-based graph reasoning, showing improved zero-shot generalization. However, it employs a task-agnostic, one-size-fits-all subgraph extraction strategy, which inevitably introduces significant structural noise—irrelevant neighbors and edges—that distorts the LLMs' receptive field and leads to suboptimal predictions. To address this limitation, we introduce GraphSSR, a novel framework designed for adaptive subgraph extraction and denoising in zero-shot LLM-based graph reasoning. Specifically, we propose the SSR pipeline, which dynamically tailors subgraph extraction to specific contexts through a ``Sample-Select-Reason'' process, enabling the model to autonomously filter out task-irrelevant neighbors and overcome the one-size-fits-all issue. To internalize this capability, we develop SSR-SFT, a data synthesis strategy that generates high-quality SSR-style graph reasoning traces for supervised fine-tuning of LLMs. Furthermore, we propose SSR-RL, a two-stage reinforcement learning framework that explicitly regulates sampling and selection operations within the proposed SSR pipeline designed for adaptive subgraph denoising. By incorporating Authenticity-Reinforced and Denoising-Reinforced RL, we guide the model to achieve accurate predictions using parsimonious, denoised subgraphs for reasoning. Extensive experiments across multiple benchmarks demonstrate that GraphSSR significantly outperforms state-of-the-art methods, highlighting the necessity of adaptive subgraph denoising for zero-shot graph reasoning. Our code is publicly available at.
Benchmark Results
Tested on 2 datasets 3 baseline values reported too low
Tables show presented results in global context (best 3 papers + GCN + MLP).
Classic
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GraphSAGE+CNA | 0.9418
±0.0033 | |
| 2 | GCN+CNA | 0.9366
±0.0048 | |
| 3 | TransformerConv | 0.9350
±0.0058 | |
| 21 | GCN | 0.9004 | |
| 124 | LLaGA | 0.8745 best reported | best at pub: Text-space Graph Foundation Models: Comprehensive Benchmarks and New Insights (NeurIPS 2024) |
| 680 | OFA | 0.7941 best reported | best at pub: Text-space Graph Foundation Models: Comprehensive Benchmarks and New Insights (NeurIPS 2024) |
| 724 | MLP | 0.7768 | |
| 799 | GraphSSR | 0.7241 | This paper |
| 810 | Graph-R1 | 0.7153 | This paper |
| 814 | GOFA-T | 0.7081 | This paper |
| 821 | DeepSeek-R1-0528 | 0.6959 | This paper |
| 822 | UniGraph | 0.6953 | This paper |
| 823 | GOFA-F | 0.6941 | This paper |
| 825 | Ministral-3-14B-Reasoning-2512 | 0.6930 | This paper |
| 830 | DeepSeek-R1-distilled-Qwen2.5-14B | 0.6880 | This paper |
| 862 | Qwen3-14B (Thinking) | 0.6515 | This paper |
| 868 | ZeroG | 0.6421 | This paper |
| 907 | GraphGPT | 0.4465 | This paper |
| # | Model | Accuracy ↑ | Paper |
|---|---|---|---|
| 1 | GCN | 0.9302
±0.0011 | |
| 2 | RSE + RGCN (70b) | 0.8852
±0.0019 | |
| 3 | LEMP+T | 0.8825 | |
| 7 | GraphSSR | 0.8793 | This paper |
| 9 | SAGE | 0.8771 | |
| 16 | Graph-R1 | 0.8689 | This paper |
| 78 | GOFA-T | 0.8093 | This paper |
| 85 | GOFA-F | 0.8052 | This paper |
| 146 | ZeroG | 0.7882 best reported | |
| 155 | Qwen3-14B (Thinking) | 0.7856 | This paper |
| 156 | OFA | 0.7855
±0.0037 best reported | best at pub: Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglement (NeurIPS 2025) |
| 208 | DeepSeek-R1-0528 | 0.7696 | This paper |
| 228 | Ministral-3-14B-Reasoning-2512 | 0.7538 | This paper |
| 230 | DeepSeek-R1-distilled-Qwen2.5-14B | 0.7526 | This paper |
| 237 | MLP | 0.7469
±0.0085 | |
| 306 | UniGraph | 0.6023 | This paper |
