Spectral Concentration at the Edge of Stability: Information Geometry of Kernel Associative Memory
2511.23083v1
cs.LG, cs.NE, stat.ML
2025-12-02
Авторы:
Akira Tamamori
Abstract
High-capacity kernel Hopfield networks exhibit a "Ridge of Optimization" characterized by extreme stability. While previously linked to "Spectral Concentration," its origin remains elusive. Here, we analyze the network dynamics on a statistical manifold, revealing that the Ridge corresponds to the "Edge of Stability," a critical boundary where the Fisher Information Matrix becomes singular. We demonstrate that the apparent Euclidean force antagonism is a manifestation of \textit{Dual Equilibrium} in the Riemannian space. This unifies learning dynamics and capacity via the Minimum Description Length principle, offering a geometric theory of self-organized criticality.
Ссылки и действия
Дополнительные ресурсы: