Live intelligence

Latest AI updates

2 updates
Research

WATERFALL: Automated Reward Discovery for Partially Observable RL

Researchers introduce WATERFALL, a population-based workflow for automated reward discovery in reinforcement learning settings where task objectives and dynamics must be learned through interaction. The method generates diverse programmatic reward candidates, evaluates visual rollouts through a Swiss-system evolutionary tournament judged by vision-language models, and uses assessment histories to mutate, escalate, or prune candidates. Across fully observable and reveal-gated partially observable environments, WATERFALL reportedly outperformed sparse-reward RL, intrinsic-motivation, and foundation-model reward-synthesis baselines most clearly in the POMDP regime. Ablations indicate visual evidence, tournament-based selection, and iterative refinement are jointly important.

reinforcement learningreward designvision-language models
Research

Density-Aware Reward Scaling for Diverse High-Reward Outcomes in RL

DARS is a lightweight reward-processing method that inversely scales rewards by local outcome density to promote reward-proportional sampling in continuous spaces. It requires no learned density model or auxiliary objective)Skip, and works with standard policy-gradient training. In multimodal navigation and text-to-image prompt adaptation, DARS-GRPO avoids mode collapse and improves diversity while maintaining semantic alignment.

Reinforcement LearningReward DesignDiversity in AI