OICycle: Observe, Infer, and Intervene Cycle for Belief-State Learning in Longitudinal Clinical Decision Making
OICycle is a method for learning a stochastic belief state directly from retrospective clinical trajectories, treating clinical care as a partially observable Markov decision process. At each episode, a learned recurrent operator fuses a sample of the previous belief with new multimodal observations and the intervention that produced them, and the resulting Gaussian belief is trained to predict clinicians' next interventions, time to the next episode, and next-episode mortality. The authors release a benchmark derived from MIMIC-IV, MIMIC-IV-Note, and MIMIC-CXR covering 72,075 hospital admissions and 5.4M records organized into temporally ordered therapeutic-diagnostic episodes. Compared with an otherwise identical history-free model, OICycle improves next-intervention adaptive recall from 0.253 to 0.347, time-to-next-episode macro-F1 from 0.293 to 0.351, and next-episode mortality macro-F1 from 0.585 to 0.649.