Inference-Environment Coordination Cuts LLM Agent Batch Makespan by Up to 65%
The paper targets batch makespan for LLM agent tasks that alternate between inference and environment interaction, a pattern common in benchmark evaluation, synthetic-data generation and RL rollouts. It introduces a work...