From Delegates to Trustees: How Optimizing for Long-Term Interests Shapes Bias and Alignment in LLM
2510.12689v1
cs.CY, cs.AI
2025-10-16
Авторы:
Suyash Fulay, Jocelyn Zhu, Michiel Bakker
Abstract
Large language models (LLMs) have shown promising accuracy in predicting
survey responses and policy preferences, which has increased interest in their
potential to represent human interests in various domains. Most existing
research has focused on behavioral cloning, effectively evaluating how well
models reproduce individuals' expressed preferences. Drawing on theories of
political representation, we highlight an underexplored design trade-off:
whether AI systems should act as delegates, mirroring expressed preferences, or
as trustees, exercising judgment about what best serves an individual's
interests. This trade-off is closely related to issues of LLM sycophancy, where
models can encourage behavior or validate beliefs that may be aligned with a
user's short-term preferences, but is detrimental to their long-term interests.
Through a series of experiments simulating votes on various policy issues in
the U.S. context, we apply a temporal utility framework that weighs short and
long-term interests (simulating a trustee role) and compare voting outcomes to
behavior-cloning models (simulating a delegate). We find that trustee-style
predictions weighted toward long-term interests produce policy decisions that
align more closely with expert consensus on well-understood issues, but also
show greater bias toward models' default stances on topics lacking clear
agreement. These findings reveal a fundamental trade-off in designing AI
systems to represent human interests. Delegate models better preserve user
autonomy but may diverge from well-supported policy positions, while trustee
models can promote welfare on well-understood issues yet risk paternalism and
bias on subjective topics.
Ссылки и действия
Дополнительные ресурсы: