Official announcement · AWS Machine Learning · Friday 6 November

SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints

Amazon SageMaker Inference now supports GPU partitioning with NVIDIA Multi-Instance GPU (MIG), which divides one GPU into hardware-isolated partitions so you can run a different model in each or take a right-sized fraction of a newer accelerator.

Read at aws.amazon.com The opening of the article at aws.amazon.com.

In this story

A tool or model opens in the Heidelberg AI Curriculum: what it does, what it costs, how to start. A repo opens on GitHub.

More from AWS Machine Learning

All stories

OfficialAWS Machine Learning

Taxonomy of agentic primitives in Amazon Quick

As we built Amazon Quick, its agents grew from answering questions to taking actions, and the same primitives kept getting rebuilt under different names.

4 h ago

OfficialAWS Machine Learning

Serverless MCP server for AI agent data lake access on Amazon ECS Fargate

Learn how to build a serverless Model Context Protocol (MCP) server on Amazon ECS with AWS Fargate that gives AI agents secure, metadata-driven access to an enterprise data lake. Exposing a new dataset requires only a JSON file, with no per-dataset integration code.

4 h ago

OfficialAWS Machine Learning

Govern AI agent access with Okta Cross App Access and Amazon Bedrock AgentCore – Part 2

In Part 1 you built one governed agent.

Repoawslabs/agentcore-samples

4 h ago

OfficialAWS Machine Learning

Govern AI agent access with Okta Cross App Access and Amazon Bedrock AgentCore – Part 1

An AI agent that acts for a user raises an identity question that per-app OAuth and service accounts leave open: which agent may act for which user, and how you stop it.

Repoawslabs/agentcore-samples

4 h ago