📊 Статистика дайджестов
Всего дайджестов: 34022 Добавлено сегодня: 82
Последнее обновление: сегодня
Авторы:
Chuan He, Shuyi Ren, Jingwei Mao, Erik G. Larsson
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
In this paper, we propose DeMuon, a method for decentralized matrix
optimization over a given communication topology. DeMuon incorporates matrix
orthogonalization via Newton-Schulz iterations-a technique inherited from its
centralized predecessor, Muon-and employs gradient tracking to mitigate
heterogeneity among local functions. Under heavy-tailed noise conditions and
additional mild assumptions, we establish the iteration complexity of DeMuon
for reaching an approximate stochastic stationary p...