Sampling-Based Control Can Exploit Human-Preference Rewards, Cutting True Return by up to 76%
This paper investigates how reward models learned from human preferences can be exploited by sampling-based control methods like MPPI and best-of-N selection. Experiments on HalfCheetah, Hopper, and Meta-World tasks show...