AURA: A Reinforcement Learning Framework for AI-Driven Adaptive Conversational Surveys
2510.27126v1
cs.HC, cs.AI, cs.LG
2025-11-04
Авторы:
Jinwen Tang, Yi Shang
Abstract
Conventional online surveys provide limited personalization, often resulting
in low engagement and superficial responses. Although AI survey chatbots
improve convenience, most are still reactive: they rely on fixed dialogue trees
or static prompt templates and therefore cannot adapt within a session to fit
individual users, which leads to generic follow-ups and weak response quality.
We address these limitations with AURA (Adaptive Understanding through
Reinforcement Learning for Assessment), a reinforcement learning framework for
AI-driven adaptive conversational surveys. AURA quantifies response quality
using a four-dimensional LSDE metric (Length, Self-disclosure, Emotion, and
Specificity) and selects follow-up question types via an epsilon-greedy policy
that updates the expected quality gain within each session. Initialized with
priors extracted from 96 prior campus-climate conversations (467 total
chatbot-user exchanges), the system balances exploration and exploitation
across 10-15 dialogue exchanges, dynamically adapting to individual
participants in real time. In controlled evaluations, AURA achieved a +0.12
mean gain in response quality and a statistically significant improvement over
non-adaptive baselines (p=0.044, d=0.66), driven by a 63% reduction in
specification prompts and a 10x increase in validation behavior. These results
demonstrate that reinforcement learning can give survey chatbots improved
adaptivity, transforming static questionnaires into interactive, self-improving
assessment systems.
Ссылки и действия
Дополнительные ресурсы: