Cluster-wide Requirements
These components are required for the cluster to function correctly and are used by various parts of the Enkrypt AI platform.| Component | Version/Type | Description |
|---|---|---|
| Kubernetes | v1.31 or newer | Current Stack is not compatibe with 1.34 |
| Ingress Controller | Ingress Controller v1.12.1 or newer (or equivalent) | Ensure all domains are configured with TLS. |
| Metrics Server | Metrics Server v0.8.0 or newer | Used in Pod autoscaling based on load |
Node Group Requirements
The Enkrypt AI platform requires different types of node groups to accommodate the specific needs of its components.1. GPU Node Group for Guardrails
This node group is dedicated to running the Enkrypt AI Guardrails application, which requires NVIDIA GPUs for accelerated performance.| Attribute | Specification |
|---|---|
| GPU per Node | 1 |
| GPU Architecture | NVIDIA A10G |
| VRAM | 24 GiB |
| vCPU | 4 |
| RAM | 16 GiB |
| Disk Size | 100 GB |
Note: Due to resource requirements, only one Guardrails pod can be scheduled per node in this configuration.
2. Node Group for Redteaming Application
This node group is tailored for the Red Teaming application, which has its own specific CPU and memory requirements.| Attribute | Specification | Notes |
|---|---|---|
| Instance Type | r7i.xlarge or equivalent | Example from AWS, use a comparable instance type from your cloud provider. |
| vCPU | 4 | |
| RAM | 32 GiB | |
| Disk Size | 100 GB | |
| Labels | dedicated: redteaming | To attract Red Teaming pods to these nodes. |
| Taints | app=redteaming:NoSchedule | To prevent other pods from being scheduled here. |
3. General Purpose Node Group
This node group is for running all other Enkrypt AI services and applications that do not have specialized hardware requirements.| Attribute | Specification | Notes |
|---|---|---|
| Instance Type | m5.xlarge or equivalent | Example from AWS, use a comparable instance type from your cloud provider. |
| vCPU | 4 | |
| RAM | 16 GiB | |
| Disk Size | 100 GB |