Live intelligence

Latest AI updates

2 updates

Research

Study finds AI auditors detect most agent reward hacking but generate many false alarms

A study by Anthropic researcher Andy Hall found that AI models can identify problematic behavior in other AI agents' logs. GPT-5 detected about 98 percent of reward-hacking cases, but more exhaustive detection settings produced increasing numbers of false positives. The findings suggest automated AI auditing is promising but not yet reliable enough for safety-critical oversight.

the-decoder4h agoScore 75

AI auditingAgent safetyReward hacking

Research Editor selected

EmoReward: Self-Evolving Reward Calibration for Emotional Video Generation RL

EmoReward is a new training mechanism that adaptively calibrates reward weights for emotional video generation in reinforcement learning. It uses reward traces from training runs to estimate reliability of different emotional evidence signals, then adjusts fusion weights in subsequent runs without updating reward models. Experiments on HunyuanVideo 1.5 show improvements across RL algorithms, with ablations on SD 3.5 and FLUX supporting transferability.

Why it matters: This introduces a concrete method to address reward hacking and subjective evaluation in emotional video generation, with experimental validation on multiple models.

arxiv2d agoScore 85

EmoRewardreward hackingvideo generation