AgentOPSD Assigns Turn-Level Credit in Multi-Turn RL via Recursive Belief Revision
AgentOPSD is a critic-free reinforcement learning scheme that assigns credit one interaction turn at a time instead of spreading a single advantage across an entire trajectory. Within each turn, token-level log-probabili...