Validation Pipeline for Deploying LLM Inference Platforms on Agentic Workloads
The paper presents an end-to-end evaluation pipeline for agentic LLM serving, spanning small-scale testing, sizing, pre-production and production validation. Experiments show that replaying captured traces reproduces per...