GKE Time Sharing for GPUs
GPU time-sharing is a GKE feature that lets multiple containers share a single physical GPU attached to a node. Using GPU time-sharing in GKE lets you more efficiently use your attached GPUs and save running costs.
GKE Doc: https://cloud.google.com/kubernetes-e...
Multi Instance: • GPU Sharing on GKE with Multi Instance GPU
MPS: