Amazon ECS now supports GPU sharing with NVIDIA Multi-Process Service (MPS)
Amazon ECS now supports GPU sharing using NVIDIA Multi-Process Service (MPS), so multiple ECS tasks can run concurrently on a single NVIDIA GPU. Users set a GPU memory amount per container and can optionally cap GPU compute share, and ECS places tasks on GPUs with spare capacity during scaling and deployments. It is available on ECS Managed Instances and ECS on EC2 in all AWS commercial and GovCloud (US) Regions.
What changes for platform teams
Platform teams running GPU workloads on ECS can increase GPU utilization by packing tasks per instance, which AWS says reduces infrastructure cost, with no application code changes. On ECS Managed Instances, ECS monitors the MPS control daemon and replaces unhealthy instances, moving tasks to healthy capacity.
Read the original at What's New with AWS ↗
written by claude-haiku-5-5, prompt 7cbe154, checked by publish rules