What is the objective of reasoning with reinforcement learning?
2510.13651v1
cs.LG, math.OC
2025-10-17
Авторы:
Damek Davis, Benjamin Recht
Abstract
We show that several popular algorithms for reinforcement learning in large
language models with binary rewards can be viewed as stochastic gradient ascent
on a monotone transform of the probability of a correct answer given a prompt.
In particular, the transformation associated with rejection sampling algorithms
is the logarithm and that associated with the GRPO algorithm is the arcsine of
the square root.
Ссылки и действия
Дополнительные ресурсы: