Install the Control Plane

System and Network Requirements

Before installing the NVIDIA Run:ai control plane, validate that the system requirements and network requirements are met.

Permissions

As part of the installation, you will be required to install the NVIDIA Run:ai control plane Helm chart. The Helm charts require Kubernetes administrator permissions. You can review the exact objects that are created by the charts using the --dry-run on both helm charts.

Installation

1. Create a values.yaml file using the appropriate example below based on your metrics backend:

YAML with Grafana Labs

global:
  domain: <RUNAI_DOMAIN> # example: "runai.hostorg.com"
  multiTenancy: true
metricsService:
  config:
   datasourceUrl: <METRIC_STORE_READ_URL> # example: https://prometheus-prod-13-prod-us-east-0.grafana.net/api/prom
tenantsManager:
  config:
    defaultMetricStore:
      read:
        auth:
          basic:
            password: glc_eyJvIjoiNTEwNjM0IiwibiI6InN0YWNrLTg2MTM4OC1obS1yZWFkLXJlYWRlciIsImsiOiIwRzNHVDdXNEgwNDJPa1drVnBMOTJnNlciLCJtIjp7InIiOiJwcm9kLXVzLWVhc3QtMCJ9fQ==
            username: "1434499"
        url: <METRIC_STORE_READ_URL> # example: https://prometheus-prod-13-prod-us-east-0.grafana.net/api/prom
      useXscopeHeader: true
      write:
        auth:
          basic:
            password: glc_eyJvIjoiNTEwNjM0IiwibiI6InN0YWNrLTg2MTM4OC1obS13cml0ZS13cml0ZSIsImsiOiJMN3FhODh1NTBZOEh5ME13cjBtN1ZQRzgiLCJtIjp7InIiOiJwcm9kLXVzLWVhc3QtMCJ9fQ==
            username: "1434499"
        url: <METRIC_STORE_WRITE_URL> # example: https://prometheus-prod-56-prod-us-east-2.grafana.net/api/prom
thanos:
  enabled: false
authorization:
  config:
    isCSPEnv: true

YAML with Mimir

global:
  domain: <RUNAI_DOMAIN> # example: "runai.hostorg.com"
  multiTenancy: true
metricsService:
  config:
   datasourceUrl: <METRIC_STORE_READ_URL> # example: http://mimir-query-frontend.monitoring.svc:8080/prometheus
tenantsManager:
  config:
    defaultMetricStore:
      read:
        auth:
          basic:
            password: ''
            username: ''
        url: <METRIC_STORE_READ_URL> # example: http://mimir-query-frontend.monitoring.svc:8080/prometheus
      useXscopeHeader: true
      write:
        auth:
          basic:
            password: ''
            username: ''
        url: <<REPLACE ME WITH MIMIR ENDPOINT>> # example: http://mimir-distributor.monitoring.svc:8080/api/v1/push
thanos:
  enabled: false
authorization:
  config:
    isCSPEnv: true

1. Run the following commands to install the NVIDIA Run:ai control plane using your configured values.yaml file:

helm repo add runai-backend https://runai.jfrog.io/artifactory/cp-charts-prod
helm repo update
helm upgrade -i runai-backend -n runai-backend runai-backend/control-plane \ 
    -f /path/to/your/values.yaml 

Note

• To install a specific version, add --version <VERSION> to the install command. You can find available versions by running helm search repo -l runai-backend.

• Use the --dry-run flag to gain an understanding of what is being installed before the actual installation.

• To customize the installation based on your environment, see Customized installation.