A Multi-dimensional Semantic Surprise Framework Based on Low-Entropy Semantic Manifolds for Fine-Grained Out-of-Distribution Detection
2510.13093v1
stat.ML, cs.AI, cs.LG
2025-10-17
Авторы:
Ningkang Peng, Yuzhe Mao, Yuhao Zhang, Linjin Qian, Qianfeng Yu, Yanhui Gu, Yi Chen, Li Kong
Abstract
Out-of-Distribution (OOD) detection is a cornerstone for the safe deployment
of AI systems in the open world. However, existing methods treat OOD detection
as a binary classification problem, a cognitive flattening that fails to
distinguish between semantically close (Near-OOD) and distant (Far-OOD) unknown
risks. This limitation poses a significant safety bottleneck in applications
requiring fine-grained risk stratification. To address this, we propose a
paradigm shift from a conventional probabilistic view to a principled
information-theoretic framework. We formalize the core task as quantifying the
Semantic Surprise of a new sample and introduce a novel ternary classification
challenge: In-Distribution (ID) vs. Near-OOD vs. Far-OOD. The theoretical
foundation of our work is the concept of Low-Entropy Semantic Manifolds, which
are explicitly structured to reflect the data's intrinsic semantic hierarchy.
To construct these manifolds, we design a Hierarchical Prototypical Network. We
then introduce the Semantic Surprise Vector (SSV), a universal probe that
decomposes a sample's total surprise into three complementary and interpretable
dimensions: conformity, novelty, and ambiguity. To evaluate performance on this
new task, we propose the Normalized Semantic Risk (nSR), a cost-sensitive
metric. Experiments demonstrate that our framework not only establishes a new
state-of-the-art (sota) on the challenging ternary task, but its robust
representations also achieve top results on conventional binary benchmarks,
reducing the False Positive Rate by over 60% on datasets like LSUN.
Ссылки и действия
Дополнительные ресурсы: