You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

164 lines
6.8 KiB

  1. Ansible variables
  2. ===============
  3. Inventory
  4. -------------
  5. The inventory is composed of 3 groups:
  6. * **kube-node** : list of kubernetes nodes where the pods will run.
  7. * **kube-master** : list of servers where kubernetes master components (apiserver, scheduler, controller) will run.
  8. Note: if you want the server to act both as master and node the server must be defined on both groups _kube-master_ and _kube-node_
  9. * **etcd**: list of server to compose the etcd server. you should have at least 3 servers for failover purposes.
  10. Below is a complete inventory example:
  11. ```
  12. ## Configure 'ip' variable to bind kubernetes services on a
  13. ## different ip than the default iface
  14. node1 ansible_ssh_host=95.54.0.12 # ip=10.3.0.1
  15. node2 ansible_ssh_host=95.54.0.13 # ip=10.3.0.2
  16. node3 ansible_ssh_host=95.54.0.14 # ip=10.3.0.3
  17. node4 ansible_ssh_host=95.54.0.15 # ip=10.3.0.4
  18. node5 ansible_ssh_host=95.54.0.16 # ip=10.3.0.5
  19. node6 ansible_ssh_host=95.54.0.17 # ip=10.3.0.6
  20. [kube-master]
  21. node1
  22. node2
  23. [etcd]
  24. node1
  25. node2
  26. node3
  27. [kube-node]
  28. node2
  29. node3
  30. node4
  31. node5
  32. node6
  33. [k8s-cluster:children]
  34. kube-node
  35. kube-master
  36. etcd
  37. ```
  38. Group vars and overriding variables precedence
  39. ----------------------------------------------
  40. The group variables to control main deployment options are located in the directory ``inventory/group_vars``.
  41. There are also role vars for docker, rkt, kubernetes preinstall and master roles.
  42. According to the [ansible docs](http://docs.ansible.com/ansible/playbooks_variables.html#variable-precedence-where-should-i-put-a-variable),
  43. those cannot be overriden from the group vars. In order to override, one should use
  44. the `-e ` runtime flags (most simple way) or other layers described in the docs.
  45. Kargo uses only a few layers to override things (or expect them to
  46. be overriden for roles):
  47. Layer | Comment
  48. ------|--------
  49. **role defaults** | provides best UX to override things for Kargo deployments
  50. inventory vars | Unused
  51. **inventory group_vars** | Expects users to use ``all.yml``,``k8s-cluster.yml`` etc. to override things
  52. inventory host_vars | Unused
  53. playbook group_vars | Unuses
  54. playbook host_vars | Unused
  55. **host facts** | Kargo overrides for internal roles' logic, like state flags
  56. play vars | Unused
  57. play vars_prompt | Unused
  58. play vars_files | Unused
  59. registered vars | Unused
  60. set_facts | Kargo overrides those, for some places
  61. **role and include vars** | Provides bad UX to override things! Use extra vars to enforce
  62. block vars (only for tasks in block) | Kargo overrides for internal roles' logic
  63. task vars (only for the task) | Unused for roles, but only for helper scripts
  64. **extra vars** (always win precedence) | override with ``ansible-playbook -e @foo.yml``
  65. Ansible tags
  66. ------------
  67. The following tags are defined in playbooks:
  68. | Tag name | Used for
  69. |--------------------------|---------
  70. | apps | K8s apps definitions
  71. | azure | Cloud-provider Azure
  72. | bastion | Setup ssh config for bastion
  73. | bootstrap-os | Anything related to host OS configuration
  74. | calico | Network plugin Calico
  75. | canal | Network plugin Canal
  76. | cloud-provider | Cloud-provider related tasks
  77. | dnsmasq | Configuring DNS stack for hosts and K8s apps
  78. | docker | Configuring docker for hosts
  79. | download | Fetching container images to a delegate host
  80. | etcd | Configuring etcd cluster
  81. | etcd-pre-upgrade | Upgrading etcd cluster
  82. | etcd-secrets | Configuring etcd certs/keys
  83. | etchosts | Configuring /etc/hosts entries for hosts
  84. | facts | Gathering facts and misc check results
  85. | flannel | Network plugin flannel
  86. | gce | Cloud-provider GCP
  87. | hyperkube | Manipulations with K8s hyperkube image
  88. | k8s-pre-upgrade | Upgrading K8s cluster
  89. | k8s-secrets | Configuring K8s certs/keys
  90. | kpm | Installing K8s apps definitions with KPM
  91. | kube-apiserver | Configuring self-hosted kube-apiserver
  92. | kube-controller-manager | Configuring self-hosted kube-controller-manager
  93. | kubectl | Installing kubectl and bash completion
  94. | kubelet | Configuring kubelet service
  95. | kube-proxy | Configuring self-hosted kube-proxy
  96. | kube-scheduler | Configuring self-hosted kube-scheduler
  97. | localhost | Special steps for the localhost (ansible runner)
  98. | master | Configuring K8s master node role
  99. | netchecker | Installing netchecker K8s app
  100. | network | Configuring networking plugins for K8s
  101. | nginx | Configuring LB for kube-apiserver instances
  102. | node | Configuring K8s minion (compute) node role
  103. | openstack | Cloud-provider OpenStack
  104. | preinstall | Preliminary configuration steps
  105. | resolvconf | Configuring /etc/resolv.conf for hosts/apps
  106. | upgrade | Upgrading, f.e. container images/binaries
  107. | upload | Distributing images/binaries across hosts
  108. | weave | Network plugin Weave
  109. Note: Use the ``bash scripts/gen_tags.sh`` command to generate a list of all
  110. tags found in the codebase. New tags will be listed with the empty "Used for"
  111. field.
  112. Example commands
  113. ----------------
  114. Example command to filter and apply only DNS configuration tasks and skip
  115. everything else related to host OS configuration and downloading images of containers:
  116. ```
  117. ansible-playbook -i inventory/inventory.ini cluster.yml --tags preinstall,dnsmasq,facts --skip-tags=download,bootstrap-os
  118. ```
  119. And this play only removes the K8s cluster DNS resolver IP from hosts' /etc/resolv.conf files:
  120. ```
  121. ansible-playbook -i inventory/inventory.ini -e dns_server='' cluster.yml --tags resolvconf
  122. ```
  123. And this prepares all container images localy (at the ansible runner node) without installing
  124. or upgrading related stuff or trying to upload container to K8s cluster nodes:
  125. ```
  126. ansible-playbook -i inventory/inventory.ini cluster.yaml \
  127. -e download_run_once=true -e download_localhost=true \
  128. --tags download --skip-tags upload,upgrade
  129. ```
  130. Note: use `--tags` and `--skip-tags` wise and only if you're 100% sure what you're doing.
  131. Bastion host
  132. --------------
  133. If you prefer to not make your nodes publicly accessible (nodes with private IPs only),
  134. you can use a so called *bastion* host to connect to your nodes. To specify and use a bastion,
  135. simply add a line to your inventory, where you have to replace x.x.x.x with the public IP of the
  136. bastion host.
  137. ```
  138. bastion ansible_ssh_host=x.x.x.x
  139. ```
  140. For more information about Ansible and bastion hosts, read
  141. [Running Ansible Through an SSH Bastion Host](http://blog.scottlowe.org/2015/12/24/running-ansible-through-ssh-bastion-host/)