Modeling Human Beliefs about AI Behavior for Scalable Oversight
Leon Lang, Patrick Forré — 2025-02-28 — Transactions on Machine Learning Research
Summary
Formalizes human belief models to interpret evaluator feedback more reliably in scalable oversight contexts, introducing ‘belief model covering’ as a relaxation and proposing to use adapted foundation model representations to mimic human evaluators’ beliefs for improved value learning.
Source
- Link: https://arxiv.org/abs/2502.21262
- Listed in the Shallow Review of Technical AI Safety 2025 under 1 agenda(s):
- supervising-ais-improving-ais — Make AI solve it