📊 Статистика дайджестов
Всего дайджестов: 34022 Добавлено сегодня: 82
Последнее обновление: сегодня
Авторы:
Yuma Ichikawa, Shuhei Kashiwamura, Ayaka Sakata
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Quantized neural network training optimizes a discrete, non-differentiable
objective. The straight-through estimator (STE) enables backpropagation through
surrogate gradients and is widely used. While previous studies have primarily
focused on the properties of surrogate gradients and their convergence, the
influence of quantization hyperparameters, such as bit width and quantization
range, on learning dynamics remains largely unexplored. We theoretically show
that in the high-dimensional limit,...