Research
Actor-Predictor Learns Formal-Specification Progress Without Automata
Researchers propose Actor-Predictor, a reinforcement learning framework that learns a surrogate representation of logic progress instead of explicitly constructing automata for formal specifications. A predictor estimates whether a partial trajectory will eventually satisfy the specification, and its learned features are supplied as auxiliary inputs to an actor optimized with GRPO and RWR. The authors show theoretically that, with sufficient predictive accuracy, the learned representation is equivalent to the automaton state. Experiments on grid-world and robotic tasks in Isaac Lab report better performance than automaton-based baselines on LTL-constrained tasks, with additional applicability to non-regular specifications such as a^n b^n.
Reinforcement learningFormal verificationLinear temporal logic