Heidelberg AI News

Official announcement · AWS Machine Learning ·

Route coding agent requests to the right model on Amazon Bedrock with NVIDIA NeMo Switchyard

Coding agents work in tasks, and the number that matters is cost per solved task, not price per token. In this post, you use the AWS CDK to deploy LiteLLM with the NVIDIA NeMo Switchyard routing plugin on Amazon Bedrock, then measure cost per solved task for a routed model group against single-model baselines.

Read at aws.amazon.com The opening of the article at aws.amazon.com.

In this story

A tool or model opens in the Heidelberg AI Curriculum: what it does, what it costs, how to start. A repo opens on GitHub.

Related stories

All stories

VideoEverlast AIDE

Black October: AI cripples half of Germany! What's really behind it | AI NEWS

Das Video ordnet eine Cybersecurity-Woche ein, in der KI Zero-Day-Lücken entdeckte, zugleich aber echte KI-gestützte Angriffe ermöglichten, und erklärt, warum Unternehmen ihre Verteidigung mit leistungsfähigen KI-Systemen neu aufstellen müssen. Außerdem zeigt es Fortschritte bei deutscher und chinesischer Robotik sowie neue Entwicklungen bei Coding- und Agentenmodellen.

VideoFireship

The most vulnerable week in internet history...

The video covers a concentrated week of major internet-security failures, including PHP2Shell, vulnerable Node.js and GitLab releases, a backdoored AI package, weak certificate keys, rogue banking agents, and attacks targeting AI API credentials. It matters because AI-driven infrastructure expands the supply-chain and credential risks, making timely patching, dependency review, and agent monitoring essential.

OfficialAWS Machine Learning

Building a self-service LLM gateway with Amazon Bedrock and LiteLLM

Build a self-service LLM gateway with LiteLLM on AWS Fargate that puts Amazon Bedrock foundation models behind an OpenAI-compatible API. Developers get instant access through a single API key, while platform teams gain per-user cost controls, quota isolation, and observability.