Live intelligence

Latest AI updates

2 updates
Research

OICycle: Observe, Infer, and Intervene Cycle for Belief-State Learning in Longitudinal Clinical Decision Making

OICycle is a method for learning a stochastic belief state directly from retrospective clinical trajectories, treating clinical care as a partially observable Markov decision process. At each episode, a learned recurrent operator fuses a sample of the previous belief with new multimodal observations and the intervention that produced them, and the resulting Gaussian belief is trained to predict clinicians' next interventions, time to the next episode, and next-episode mortality. The authors release a benchmark derived from MIMIC-IV, MIMIC-IV-Note, and MIMIC-CXR covering 72,075 hospital admissions and 5.4M records organized into temporally ordered therapeutic-diagnostic episodes. Compared with an otherwise identical history-free model, OICycle improves next-intervention adaptive recall from 0.253 to 0.347, time-to-next-episode macro-F1 from 0.293 to 0.351, and next-episode mortality macro-F1 from 0.585 to 0.649.

Clinical AIPOMDPElectronic health records
Research

WATERFALL: Automated Reward Discovery for Partially Observable RL

Researchers introduce WATERFALL, a population-based workflow for automated reward discovery in reinforcement learning settings where task objectives and dynamics must be learned through interaction. The method generates diverse programmatic reward candidates, evaluates visual rollouts through a Swiss-system evolutionary tournament judged by vision-language models, and uses assessment histories to mutate, escalate, or prune candidates. Across fully observable and reveal-gated partially observable environments, WATERFALL reportedly outperformed sparse-reward RL, intrinsic-motivation, and foundation-model reward-synthesis baselines most clearly in the POMDP regime. Ablations indicate visual evidence, tournament-based selection, and iterative refinement are jointly important.

reinforcement learningreward designvision-language models