Building a self-service LLM gateway with Amazon Bedrock and LiteLLM
AWS describes how to build a self-service LLM gateway using Amazon Bedrock Application Inference Profiles and LiteLLM running on AWS Fargate, exposing an OpenAI-compatible API for developer tools. The post covers per-use...