ServerBench: Benchmarking Coding Agents for Designing Specialized LLM Serving Systems
ServerBench is a new benchmark that evaluates coding agents' ability to design complete, specialized LLM serving systems. Agents are scored on a dollars-per-dollar metric, balancing latency-qualified token value aga...