Kloudfuse Install on a Shared Kubernetes Cluster
Kloudfuse can be installed on a shared Kubernetes cluster. Within the shared cluster, it is highly recommended to have a dedicated node group for running Kloudfuse.
Using Node Affinity, Taints and Tolerations to Deploy Kloudfuse on the Dedicated Node Group.
Add Taint to Node Group
Ensure that the nodes have NoSchedule taint, e.g., dedicated=kfuse:NoSchedule taint. It is recommended that the taint is configured through the cloud provider, rather than kubectl. This ensures that the taints are persisted across node restart or replacement.
On GKE, refer to https://cloud.google.com/kubernetes-engine/docs/how-to/node-taints#console_1 .
On EKS, refer to https://docs.aws.amazon.com/eks/latest/userguide/node-taints-managed-node-groups.html .
Taints ensure that no other workloads gets scheduled on the node.
Add Label to Node Group
Ensure that the nodes have a custom label for Kloudfuse, e.g., dedicated=kfuse. The custom labels will be used to configure either Node Selector or Node Affinity to ensure Kloudfuse workloads only gets scheduled on the dedicated node group.
Configure Helm Custom Values
Tolerations
In the default values.yaml, each Kfuse service has a tolerations section that is defaulted to []. Copy and overwrite the tolerations sections in the custom_values.yaml. Using the example taint configuration above, add the following in each tolerations section:
tolerations:
- key: "dedicated"
operator: "Equal"
value: "kfuse"
effect: "NoSchedule"Node Affinity
In the default values.yaml, each Kfuse service has a affinity section that is defaulted to {}. Copy and overwrite the the affinity section and add a nodeAffinity section in the custom_values.yaml. Using the example label configuration above, add the following in each nodeAffinity section:
affinity:
nodeAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
nodeSelectorTerms:
- matchExpressions:
- key: dedicated
operator: In
values:
- kfuseNode Selector
Only one of Node Affinity or Node Selector is needed to be configured. Skip this section, if Node Affinity is already configured in the custom_values.yaml
In the default values.yaml, each Kfuse service has a nodeSelector section that is defaulted to {}. Copy and overwrite the the nodeSelector section in the custom_values.yaml. Using the example label configuration above, add the following in each nodeSelector section:
nodeSelector:
dedicated: kfuse