You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

101 lines
8.1 KiB

  1. # vSphere CSI Driver
  2. vSphere CSI driver allows you to provision volumes over a vSphere deployment. The Kubernetes historic in-tree cloud provider is deprecated and will be removed in future versions.
  3. ## Prerequisites
  4. The vSphere user for CSI driver requires a set of privileges to perform Cloud Native Storage operations. Follow the [official guide](https://vsphere-csi-driver.sigs.k8s.io/driver-deployment/prerequisites.html#roles_and_privileges) to configure those.
  5. ## Kubespray configuration
  6. To enable vSphere CSI driver, uncomment the `vsphere_csi_enabled` option in `group_vars/all/vsphere.yml` and set it to `true`.
  7. To set the number of replicas for the vSphere CSI controller, you can change `vsphere_csi_controller_replicas` option in `group_vars/all/vsphere.yml`.
  8. You need to source the vSphere credentials you use to deploy your machines that will host Kubernetes.
  9. | Variable | Required | Type | Choices | Default | Comment |
  10. |---------------------------------------------|----------|---------|----------------------------|---------------------------|---------------------------------------------------------------------------------------------------------------------|
  11. | external_vsphere_vcenter_ip | TRUE | string | | | IP/URL of the vCenter |
  12. | external_vsphere_vcenter_port | TRUE | string | | "443" | Port of the vCenter API |
  13. | external_vsphere_insecure | TRUE | string | "true", "false" | "true" | set to "true" if the host above uses a self-signed cert |
  14. | external_vsphere_user | TRUE | string | | | User name for vCenter with required privileges (Can also be specified with the `VSPHERE_USER` environment variable) |
  15. | external_vsphere_password | TRUE | string | | | Password for vCenter (Can also be specified with the `VSPHERE_PASSWORD` environment variable) |
  16. | external_vsphere_datacenter | TRUE | string | | | Datacenter name to use |
  17. | external_vsphere_kubernetes_cluster_id | TRUE | string | | "kubernetes-cluster-id" | Kubernetes cluster ID to use |
  18. | external_vsphere_version | TRUE | string | | "6.7u3" | Vmware Vsphere version where located all VMs |
  19. | external_vsphere_cloud_controller_image_tag | TRUE | string | | "latest" | Kubernetes cluster ID to use |
  20. | vsphere_syncer_image_tag | TRUE | string | | "v2.2.1" | Syncer image tag to use |
  21. | vsphere_csi_attacher_image_tag | TRUE | string | | "v3.1.0" | CSI attacher image tag to use |
  22. | vsphere_csi_controller | TRUE | string | | "v2.2.1" | CSI controller image tag to use |
  23. | vsphere_csi_controller_replicas | TRUE | integer | | 1 | Number of pods Kubernetes should deploy for the CSI controller |
  24. | vsphere_csi_liveness_probe_image_tag | TRUE | string | | "v2.2.0" | CSI liveness probe image tag to use |
  25. | vsphere_csi_provisioner_image_tag | TRUE | string | | "v2.1.0" | CSI provisioner image tag to use |
  26. | vsphere_csi_node_driver_registrar_image_tag | TRUE | string | | "v1.1.0" | CSI node driver registrar image tag to use |
  27. | vsphere_csi_driver_image_tag | TRUE | string | | "v1.0.2" | CSI driver image tag to use |
  28. | vsphere_csi_resizer_tag | TRUE | string | | "v1.1.0" | CSI resizer image tag to use
  29. | vsphere_csi_aggressive_node_drain | FALSE | boolean | | false | Enable aggressive node drain strategy |
  30. | vsphere_csi_aggressive_node_unreachable_timeout | FALSE | int | 300 | | Timeout till node will be drained when it in an unreachable state |
  31. | vsphere_csi_aggressive_node_not_ready_timeout | FALSE | int | 300 | | Timeout till node will be drained when it in not-ready state |
  32. ## Usage example
  33. To test the dynamic provisioning using vSphere CSI driver, make sure to create a [storage policy](https://github.com/kubernetes/cloud-provider-vsphere/blob/master/docs/book/tutorials/kubernetes-on-vsphere-with-kubeadm.md#create-a-storage-policy) and [storage class](https://github.com/kubernetes/cloud-provider-vsphere/blob/master/docs/book/tutorials/kubernetes-on-vsphere-with-kubeadm.md#create-a-storageclass), then apply the following manifest:
  34. ```yml
  35. ---
  36. apiVersion: v1
  37. kind: PersistentVolumeClaim
  38. metadata:
  39. name: csi-pvc-vsphere
  40. spec:
  41. accessModes:
  42. - ReadWriteOnce
  43. resources:
  44. requests:
  45. storage: 1Gi
  46. storageClassName: Space-Efficient
  47. ---
  48. apiVersion: v1
  49. kind: Pod
  50. metadata:
  51. name: nginx
  52. spec:
  53. containers:
  54. - image: nginx
  55. imagePullPolicy: IfNotPresent
  56. name: nginx
  57. ports:
  58. - containerPort: 80
  59. protocol: TCP
  60. volumeMounts:
  61. - mountPath: /usr/share/nginx/html
  62. name: csi-data-vsphere
  63. volumes:
  64. - name: csi-data-vsphere
  65. persistentVolumeClaim:
  66. claimName: csi-pvc-vsphere
  67. readOnly: false
  68. ```
  69. Apply this conf to your cluster: ```kubectl apply -f nginx.yml```
  70. You should see the PVC provisioned and bound:
  71. ```ShellSession
  72. $ kubectl get pvc
  73. NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE
  74. csi-pvc-vsphere Bound pvc-dc7b1d21-ee41-45e1-98d9-e877cc1533ac 1Gi RWO Space-Efficient 10s
  75. ```
  76. And the volume mounted to the Nginx Pod (wait until the Pod is Running):
  77. ```ShellSession
  78. kubectl exec -it nginx -- df -h | grep /usr/share/nginx/html
  79. /dev/sdb 976M 2.6M 907M 1% /usr/share/nginx/html
  80. ```
  81. ## More info
  82. For further information about the vSphere CSI Driver, you can refer to the official [vSphere Cloud Provider documentation](https://cloud-provider-vsphere.sigs.k8s.io/container_storage_interface.html).