SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints
AWS SageMaker Inference now supports NVIDIA Multi-Instance GPU (MIG) partitioning, allowing a single physical GPU to be divided into isolated partitions for deploying multiple models or right-sizing capacity. This featur...