GPU Sharing on GKE with Multi Instance GPU
The A100 GPU and H100 GPU consist of seven compute units and eight memory units, which can be partitioned into GPU instances of varying sizes.
Overview of all GPU Sharing Techniques on GKE: • Effective GPU Sharing Strategies in GKE
GKE Multi Instance GPU: https://cloud.google.com/kubernetes-e...
NVIDIA Partitioning Table: https://docs.nvidia.com/datacenter/te...