Official announcement · AWS Machine Learning ·
Building a self-service LLM gateway with Amazon Bedrock and LiteLLM

Build a self-service LLM gateway with LiteLLM on AWS Fargate that puts Amazon Bedrock foundation models behind an OpenAI-compatible API. Developers get instant access through a single API key, while platform teams gain per-user cost controls, quota isolation, and observability.
In this story
- ToolLiteLLM
- Repoberriai/litellm
- Repoaws-solutions-library-samples/guidance-for-multi-provider-generative-ai-gateway-on-aws
A tool or model opens in the Heidelberg AI Curriculum: what it does, what it costs, how to start. A repo opens on GitHub.



