Actor-Predictor Learns Formal-Specification Progress Without Automata
Researchers propose Actor-Predictor, a reinforcement learning framework that learns a surrogate representation of logic progress instead of explicitly constructing automata for formal specifications. A predictor estimates whether a partial trajectory will eventually satisfy the specification, and its learned features are supplied as auxiliary inputs to an actor optimized with GRPO and RWR. The authors show theoretically that, with sufficient predictive accuracy, the learned representation is equivalent to the automaton state. Experiments on grid-world and robotic tasks in Isaac Lab report better performance than automaton-based baselines on LTL-constrained tasks, with additional applicability to non-regular specifications such as a^n b^n.
It offers a concrete research method for enforcing formal temporal constraints in RL without the scalability limits of automaton construction, relevant to safe and verifiable learned control.
Comments & Questions (0)
No comments yet
Be the first to comment!