Semantic-Condition Tuning: Fusing Graph Context with Large Language Models for Knowledge Graph Completion

2510.08966v1 cs.AI, cs.CL, I.2.7 2025-10-14
Авторы:

Ruitong Liu, Yan Wen, Te Sun, Yunjia Wu, Pingyang Huang, Zihang Yu, Siyuan Li

Abstract

Fusing Knowledge Graphs with Large Language Models is crucial for knowledge-intensive tasks like knowledge graph completion. The prevailing paradigm, prefix-tuning, simply concatenates knowledge embeddings with text inputs. However, this shallow fusion overlooks the rich relational semantics within KGs and imposes a significant implicit reasoning burden on the LLM to correlate the prefix with the text. To address these, we propose Semantic-condition Tuning (SCT), a new knowledge injection paradigm comprising two key modules. First, a Semantic Graph Module employs a Graph Neural Network to extract a context-aware semantic condition from the local graph neighborhood, guided by knowledge-enhanced relations. Subsequently, this condition is passed to a Condition-Adaptive Fusion Module, which, in turn, adaptively modulates the textual embedding via two parameterized projectors, enabling a deep, feature-wise, and knowledge-aware interaction. The resulting pre-fused embedding is then fed into the LLM for fine-tuning. Extensive experiments on knowledge graph benchmarks demonstrate that SCT significantly outperforms prefix-tuning and other strong baselines. Our analysis confirms that by modulating the input representation with semantic graph context before LLM inference, SCT provides a more direct and potent signal, enabling more accurate and robust knowledge reasoning.

Ссылки и действия

Связанные статьи

Artificial Phantasia: Evidence for Propositional Reasoning-Based Mental Imagery ...

## Контекст В настоящее время визуальная ментальная имитажирование считается одним из ключевых способов решения задач, ...

2025-10-01

Sticker-TTS: Learn to Utilize Historical Experience with a Sticker-driven Test-T...

#### Контекст Модели большого размера для решения задач логического и математического разума (Large Reasoning Models, LR...

2025-09-09

Instructional Agents: LLM Agents on Automated Course Material Generation for Tea...

## Контекст Подготовка высококачественных учебных материалов является трудоемкой задачей, требующей значительного времен...

2025-08-29