GPU Sharing in GKE with NVIDIA MPS
NVIDIA MPS is a GPU sharing solution that allows multiple containers to share a single physical NVIDIA GPU hardware attached to a node.
NVIDIA MPS relies on NVIDIA's Multi-Process Service on CUDA. NVIDIA MPS is an alternative, binary-compatible implementation of the CUDA API designed to transparently enable co-operative multi-process CUDA applications to run concurrently on a single GPU device.
Official GKE Doc: https://cloud.google.com/kubernetes-e...
NVIDIA MPS Docs: https://docs.nvidia.com/deploy/mps/