1 准备3节点机器，编辑 /etc/hosts提供域名访问
172.31.118.199 dev-node-1 dev-node-1
172.31.118.200 dev-node-2 dev-node-2
172.31.118.201 dev-node-3 dev-node-3
2 在3个节点上都安装Container Runtime。这里使用Docker
apt-get update && apt-get install -y \
apt-transport-https ca-certificates curl software-properties-common gnupg2
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | apt-key add –
add-apt-repository \
“deb [arch=amd64] https://download.docker.com/linux/ubuntu \
$(lsb_release -cs) \
stable”
apt-get update && apt-get install -y \
containerd.io=1.2.13-1 \
docker-ce=5:19.03.8~3-0~ubuntu-$(lsb_release -cs) \
docker-ce-cli=5:19.03.8~3-0~ubuntu-$(lsb_release -cs)
cat > /etc/docker/daemon.json <<EOF
{
“exec-opts”: [“native.cgroupdriver=systemd”],
“log-driver”: “json-file”,
“log-opts”: {
“max-size”: “100m”
},
“storage-driver”: “overlay2”
}
EOF
mkdir -p /etc/systemd/system/docker.service.d
systemctl daemon-reload
systemctl restart docker
3. 在3个节点上安装kubeadm,kubelet和kubectl
sudo apt-get update && sudo apt-get install -y apt-transport-https curl
curl -s https://packages.cloud.google.com/apt/doc/apt-key.gpg | sudo apt-key add –
cat <<EOF | sudo tee /etc/apt/sources.list.d/kubernetes.list
deb https://apt.kubernetes.io/ kubernetes-xenial main
EOF
sudo apt-get update
sudo apt-get install -y kubelet kubeadm kubectl
sudo apt-mark hold kubelet kubeadm kubectl
4 配置k8s cluster
在master节点运行。
注意：–pod-network-cidr=10.244.0.0/16 是和后面的flannel关联的，其他设置会导致网络连接问题。需要重置或完全重装才能解决
kubeadm init –control-plane-endpoint=172.31.118.199 –apiserver-advertise-address=172.31.118.199 –pod-network-cidr=10.244.0.0/16 –ignore-preflight-errors=NumCPU
在master节点运行
这里选择flannel
kubectl apply -f https://raw.githubusercontent.com/coreos/flannel/2140ac876ef134e0ed5af15c65e414cf26827915/Documentation/kube-flannel.yml
在非master节点运行。
记住token。使用类似指令在非master节点加入集群
kubeadm join 172.31.118.199:6443 –token 28lepr.xoji43nzk569dhen \
–discovery-token-ca-cert-hash sha256:22a09d232518d504a40ea0048f5eedf13f3fabcdb3c9ef01a05f2cc3f50950ba
5 安装helm到master
使用helm在master节点运行
helm install nfs-client-provisioner stable/nfs-client-provisioner –set nfs.server=172.31.118.199 –set nfs.path=/data
配置storageclass
kubectl patch storageclass nfs-client -p ‘{“metadata”: {“annotations”:{“storageclass.kubernetes.io/is-default-class”:”true”}}}’
安装mysql
helm install mysql –set service.type=NodePort bitnami/mysql
6 异常处理：清理重置cluster
kubectl drain dev-node-3 –delete-local-data –force –ignore-daemonsets
kubectl drain dev-node-2 –delete-local-data –force –ignore-daemonsets
kubectl drain dev-node-1 –delete-local-data –force –ignore-daemonsets
kubectl delete nodes dev-node-3
kubectl delete nodes dev-node-2
kubectl delete nodes dev-node-1
kubeadm reset
iptables -F && iptables -t nat -F && iptables -t mangle -F && iptables -X
rm /etc/cni/net.d/10-flannel.conflist
systemctl stop kubelet
systemctl stop docker
rm -rf /var/lib/cni/
rm -rf /var/lib/kubelet/*
rm -rf /etc/cni/
ifconfig cni0 down
ifconfig flannel.1 down
ifconfig docker0 down
ip link delete cni0
ip link delete flannel.1
systemctl start docker
systemctl start kubelet