2022-10-27 12:27:42 +00:00
|
|
|
# KubeZero 1.24
|
|
|
|
|
|
|
|
|
|
## TODO
|
|
|
|
|
|
|
|
|
|
## What's new - Major themes
|
2023-01-11 12:08:18 +00:00
|
|
|
- Cilium is now the default CNI, calico gets removed
|
2022-11-14 13:14:11 +00:00
|
|
|
- cluster-autoscaler is enabled by default on AWS
|
2023-01-11 12:08:18 +00:00
|
|
|
- worker nodes are now automatically update to latest AMI and config in a rolling fashion
|
|
|
|
|
- integrated Bitnami Sealed Secrets controller
|
|
|
|
|
|
2022-10-27 12:27:42 +00:00
|
|
|
|
|
|
|
|
## Version upgrades
|
2022-11-14 13:14:11 +00:00
|
|
|
- cilium
|
|
|
|
|
- metallb
|
|
|
|
|
- nvidia-device-plugin
|
|
|
|
|
- aws-node-termination-handler
|
|
|
|
|
- aws-ebs-csi-driver
|
|
|
|
|
- aws-efs-csi-driver
|
2023-01-11 12:08:18 +00:00
|
|
|
- istio 1.16
|
|
|
|
|
- argocd 2.5.5 + tweaks
|
|
|
|
|
- all things prometheus incl. automated muting of certain alarms, eg. CPUOverCommit when cluster-autoscaler is available
|
2022-11-14 13:14:11 +00:00
|
|
|
|
|
|
|
|
### FeatureGates
|
|
|
|
|
- PodAndContainerStatsFromCRI
|
|
|
|
|
- DelegateFSGroupToCSIDriver
|
2022-10-27 12:27:42 +00:00
|
|
|
|
|
|
|
|
# Upgrade
|
|
|
|
|
`(No, really, you MUST read this before you upgrade)`
|
|
|
|
|
|
2023-01-11 12:08:18 +00:00
|
|
|
Ensure your Kube context points to the correct cluster !
|
2022-10-27 12:27:42 +00:00
|
|
|
|
2023-01-11 12:08:18 +00:00
|
|
|
1. Review CFN config for controller and workers, no mandatory changes during this release though
|
2022-10-27 12:27:42 +00:00
|
|
|
|
2023-01-11 12:08:18 +00:00
|
|
|
2. Upgrade CFN stacks for the control plane *ONLY* !
|
|
|
|
|
Updating the workers CFN stacks would trigger rolling updates right away !
|
2022-10-27 12:27:42 +00:00
|
|
|
|
2023-01-11 12:08:18 +00:00
|
|
|
3. Trigger cluster upgrade:
|
2022-10-27 12:27:42 +00:00
|
|
|
`./admin/upgrade_cluster.sh <path to the argocd app kubezero yaml for THIS cluster>`
|
|
|
|
|
|
2022-11-14 13:14:11 +00:00
|
|
|
4. Reboot controller(s) one by one
|
2022-10-27 12:27:42 +00:00
|
|
|
Wait each time for controller to join and all pods running.
|
|
|
|
|
Might take a while ...
|
|
|
|
|
|
2023-01-11 12:08:18 +00:00
|
|
|
5. Upgrade CFN stacks for the workers.
|
|
|
|
|
This in turn will trigger automated worker updates by evicting pods and launching new workers in a rolling fashion.
|
|
|
|
|
Grab a coffee and keep an eye on the cluster to be safe ...
|
2022-10-27 12:27:42 +00:00
|
|
|
|
2022-11-14 13:14:11 +00:00
|
|
|
6. If all looks good, commit the ArgoApp resouce for Kubezero, before re-enabling ArgoCD itself.
|
2022-10-27 12:27:42 +00:00
|
|
|
git add / commit / push `<cluster/env/kubezero/application.yaml>`
|
2023-01-11 12:08:18 +00:00
|
|
|
|
|
|
|
|
7. Head over to ArgoCD and sync all KubeZero modules incl. `pruning` enabled to remove eg. Calico
|
