NVIDIA Open-Sources NVKE and NVKR for Managed Kubernetes on GPU

NVIDIA Open-Sources NVKE and NVKR for Managed Kubernetes on GPU Infrastructure


NVIDIA has released two open-source projects for running managed Kubernetes on GPU infrastructure: NVIDIA Kubernetes Engine (NVKE) and NVIDIA Kubernetes Recipes (NVKR). Both were recently announced as components of the NVIDIA DSX AI Factory Platform. NVKE serves as the control plane for a managed Kubernetes service, while NVKR builds the OS images, container images, and packages those clusters depend on. Both ship under Apache 2.0 and are currently in public preview.


TL;DR


  • Size / footprint: Three CPU servers for the management cluster, three CPU servers per workload control plane, plus a pool of GPU worker nodes. A local evaluation requires 6 CPUs, 12 GiB RAM, 100 GiB disk, and no GPU.
  • Runs on: Your own NVIDIA GPU bare-metal servers, provisioned through NVIDIA Infra Controller (NICo). Node images build for amd64 and arm64.
  • Performance: No throughput or provisioning-time benchmarks have been published. The quality signal is certification, not speed.
  • Best: Certified Kubernetes AI Platform and Certified Kubernetes Installer, conformance tested on Kubernetes 1.36.
  • Worst: After installation, the NVKE API serves plain HTTP on port 30080 with authentication disabled, and there is no management-plane upgrade or backup procedure.

via MarkTechPost

Related