NVIDIA Open Sources Run:ai Under Apache 2.0 for Kubernetes GPU

NVIDIA Open Sources Run:ai Under Apache 2.0 for Kubernetes GPU Orchestration

NVIDIA has released the full NVIDIA Run:ai platform as open source software. The source code ships under the Apache 2.0 license on GitHub, putting production-grade GPU scheduling, quotas, and workload management directly in developers' hands. The release makes Run:ai part of the NVIDIA DSX AI Factory platform, and platform teams can now inspect, fork, and self-host the stack without a paid subscription.

TL;DR

• Size: A monorepo containing the control plane, cluster services, installer, CLI, and MCP server. A local development build compiles roughly 50 Go services.
• Runs on: Kubernetes or OpenShift clusters equipped with NVIDIA GPUs. Local development runs on macOS or Linux with eight simulated Tesla-A10 GPUs—no physical GPU required.
• Performance: NVIDIA published no platform-level benchmark for this release.
• Best: The related Model Streamer loaded models 3x to 6x faster on eight NVIDIA H100 VMs on Azure.
• Worst: The community edition has no NVIDIA enterprise support. Local builds require 16 GB... [content truncated in source]

via MarkTechPost