Lessons from Building an LLM Agent for Automated Experimentation
The paper reports practical lessons from building and operating an LLM-based agent for automating experimentation workflows. The central finding is that nondeterminism should be bounded by having the model select and seq...