Chart-RVR: Reinforcement Learning with Verifiable Rewards for Explainable Chart Reasoning
2510.10973v1
cs.CV, cs.LG
2025-10-15
Авторы:
Sanchit Sinha, Oana Frunza, Kashif Rasul, Yuriy Nevmyvaka, Aidong Zhang
Abstract
The capabilities of Large Vision-Language Models (LVLMs) have reached
state-of-the-art on many visual reasoning tasks, including chart reasoning, yet
they still falter on out-of-distribution (OOD) data, and degrade further when
asked to produce their chain-of-thought (CoT) rationales, limiting
explainability. We present Chart-RVR, a general framework that fine-tunes LVLMs
to be more robust and explainable for chart reasoning by coupling Group
Relative Policy Optimization (GRPO) with automatically verifiable rewards. Our
framework comprises of three rewards that maximize: (i) correct chart-type
classification, (ii) faithful chart table reconstruction, and (iii) process
conformity. Applied to 3-billion-parameter LVLMs, Chart-RVR consistently
outperforms standard supervised fine-tuning (SFT) on both in-distribution and
out-of-distribution datasets, closing the OOD performance gap while improving
rationale fidelity. The resulting models, the Chart-RVR-3B series, achieve
state-of-the-art results on six chart-reasoning benchmarks spanning in-domain
and OOD settings, surpassing all existing models of comparable size. Beyond
accuracy, Chart-RVR yields more interpretable CoT rationales, strengthening
trust and reliability - showcasing the power of verifiable rewards with GRPO
for training reliable, interpretable chart-reasoning models.
Ссылки и действия
Дополнительные ресурсы: