Route coding agent requests to the right model on Amazon Bedrock with NVIDIA NeMo Switchyard
AWS describes a deployable sample that routes coding-agent requests on Amazon Bedrock through LiteLLM and NVIDIA NeMo Switchyard. The sample offers Stage routing between a capable Claude model and a lower-cost Nemotron model, plus Random routing for A/B traffic splits, and uses AWS CDK to deploy LiteLLM on ECS Fargate. It includes benchmark runners and single-model baselines for measuring cost per solved task rather than relying on per-token pricing alone. The post explicitly labels the implementation as sample code for non-production use.