Monitor Workloads by Category

A workload category represents the role or purpose of a workload such as training, building, or deploying models. Each workload type is automatically assigned a default category to ensure consistent classification across the platform.

Categories appear in the Overview dashboard, allowing administrators to filter, group, and monitor workloads based on their function. Administrators can modify the default category mapping for a workload type using the NVIDIA Run:ai API.

Default Category Mapping

NVIDIA Run:ai defines the following default mappings of workload types to categories. To retrieve the default category per workload type, refer to the List workload types API.

Note

Workload Types
Default Category

NVIDIA Run:ai native workloads

Workspaces, Standard training, Distributed training, Custom inference, Hugging Face inference, NVIDIA NIM inference

Workspaces = Build Training = Train Inference = Deploy

NVIDIA

NIM services, NVIDIA Cloud Functions (NVCF)

Deploy

Kubernetes

Deployment, StatefulSet, ReplicaSet, Pod, Service, CronJob, Job, JobSet

Most = Deploy Job = Build JobSet = Train

Kubeflow

TFJob, PyTorchJob, MPIJob, XGBoostJob, Notebook, ScheduledWorkflow

Most = Train Notebook = Build ScheduledWorkflow = Deploy

Ray

RayService, RayCluster, RayJob

RayCluster, RayJob = Train RayService = Deploy

Tekton

PipelineRun, TaskRun

PipelineRun = Deploy TaskRun = Build

Additional Frameworks

SeldonDeployment, AMLJob, Workflow, DevWorkspace, Service, VirtualMachineInstance, KServe, Milvus

Most = Deploy AMLJob, VirtualMachineInstance = Train DevWorkspace = Build

Update the Default Category Mapping

Administrators can change the default category assigned to a workload type by updating the category mapping using the NVIDIA Run:ai API. To update the category mapping:

  1. Retrieve the list of workload types and their IDs using GET /api/v1/workload-types.

  2. Identify the workloadTypeId of the workload type you want to modify.

  3. Retrieve the list of available categories and their IDs using GET /api/v1/workload-categories.

  4. Send a request to update the workload type with the new category using PUT /api/v1/workload-types/{workloadTypeId} and include the categoryId in the request body.

Using API

Go to the Workloads API reference to view the available actions.

Last updated