Research
PACT trains GUI agents to align executed actions with correct plans
PACT is a training framework for GUI agents that targets cases where an agent forms a correct plan but emits an action that fails to execute it. It protects reference-aligned plan tokens from negative policy-gradient updates and uses a preference surrogate to favor reference actions over erroneous emitted actions without changing the original scalar action reward. On AndroidWorld, PACT improves task success from 60.34% to 68.97%, and on AndroidControl High it improves rule-based plan-action consistency from 83.71% to 89.74%. Adapted to desktop agents, it raises task success on the 369-task OSWorld benchmark from 40.92% to 44.17%.
GUI agentsreinforcement learningcredit assignment