Amazon SageMaker HyperPod Inference adds managed NVIDIA Dynamo support
AWS now supports NVIDIA Dynamo on SageMaker HyperPod Inference, bringing multi-node deployment, disaggregated prefill/decode and KV-aware routing to managed LLM endpoints. The HyperPod Inference add-on installs Dynamo�...