Controllable Graph Generation with Diffusion Models via Inference-Time Tree Search Guidance
2510.10402v1
cs.LG, cs.AI, cs.CE
2025-10-16
Авторы:
Jiachi Zhao, Zehong Wang, Yamei Liao, Chuxu Zhang, Yanfang Ye
Abstract
Graph generation is a fundamental problem in graph learning with broad
applications across Web-scale systems, knowledge graphs, and scientific domains
such as drug and material discovery. Recent approaches leverage diffusion
models for step-by-step generation, yet unconditional diffusion offers little
control over desired properties, often leading to unstable quality and
difficulty in incorporating new objectives. Inference-time guidance methods
mitigate these issues by adjusting the sampling process without retraining, but
they remain inherently local, heuristic, and limited in controllability. To
overcome these limitations, we propose TreeDiff, a Monte Carlo Tree Search
(MCTS) guided dual-space diffusion framework for controllable graph generation.
TreeDiff is a plug-and-play inference-time method that expands the search space
while keeping computation tractable. Specifically, TreeDiff introduces three
key designs to make it practical and scalable: (1) a macro-step expansion
strategy that groups multiple denoising updates into a single transition,
reducing tree depth and enabling long-horizon exploration; (2) a dual-space
denoising mechanism that couples efficient latent-space denoising with
lightweight discrete correction in graph space, ensuring both scalability and
structural fidelity; and (3) a dual-space verifier that predicts long-term
rewards from partially denoised graphs, enabling early value estimation and
removing the need for full rollouts. Extensive experiments on 2D and 3D
molecular generation benchmarks, under both unconditional and conditional
settings, demonstrate that TreeDiff achieves state-of-the-art performance.
Notably, TreeDiff exhibits favorable inference-time scaling: it continues to
improve with additional computation, while existing inference-time methods
plateau early under limited resources.
Ссылки и действия
Дополнительные ресурсы: