GPUs on Kubernetes are bring-your-own-everything, starting with the bill

If you run a Kubernetes platform, you’ve probably got at least one Grafana dashboard for resource visibility on your workloads. It shows what a container asked for versus what it used, making it relatively easy to point at the deployment that requested four cores and is only using half of one. If you break it down by namespace you get a rough idea which team is consuming what, which is what teams have been doing for CPU and memory for years and it mostly works. Then people started putting workloads on GPUs and a lot of what we assumed would carry over didn’t. Almost every piece of visibility...

Source: The New Stack

← Back to News