91ÊÓƵרÇø

quanmeitijizhe liuyanchaowoshoushiwan£¬shidianzailiangtiwen£¬jijing38.4duliao£¬zhenianjidaliaodaodibuxing£¬xinlixiang£¬erxifuzongshuodao38.5liaozaichituishaoyao£¬erqietayekuaixiabanliao£¬dengtahuilaizaichituishaoyaoba£¬

ÉÂ(³§³ó²¹²Ô)Î÷(³Ý¾±)2022-2024Äê(±·¾±²¹²Ô)¸ß(³Ò²¹´Ç)¿¼(°­²¹´Ç)³É(°ä³ó±ð²Ô²µ)¼¨(´³¾±)ͬ(°Õ´Ç²Ô²µ)·Ö(¹ó±ð²Ô)Òì(³Û¾±)λ(°Â±ð¾±)±í(µþ¾±²¹´Ç)

³ó´Ç³Ü±ô²¹¾±£¬³Ù²¹³ú³ó´Ç²Ô²µ²â³Ü°ì²¹²Ô³ú³ó´Ç²Ô²µ±ô¾±²¹´Ç²â¾±²µ±ð°ù±ð²Ô£¬±ð°ù°ù±ð²Ô²Ô¾±²¹²Ô³¾²¹´Ç³æ¾±²¹²Ô²µ»å²¹²Ô²µ£¬»å³Ü¾±´Ú²¹²Ô²µ²â´Ç³Ü²Ô±ð²Ô²µ²õ³ó³Ü´Ç³ó³Ü¾±»å²¹´Ç²õ³ó¾±´Ú±ð²ÔÂá¾±²Ô²µ³¾¾±²Ô²µ¡£»å³Ü¾±·É±ð²Ô³æ¾±²¹²Ô²µ³ú¾±²Ô±¹²â±ð²µ±ð·É²¹¾±²µ³Ü²¹²Ô³æ¾±²Ô³ú³ó²¹´Ç²µ³Ü£¬·É±ð²Ô³æ¾±²¹²Ô²µ³ú³ó±ð²Ô»å±ð²â´Ç³Ü³æ¾±±ð³æ¾±²Ô»å´Ç²Ô²µ±ô¾±²¹´Ç¡£°ù²¹²Ô³ú³ó±ð²Ô²µ»å²¹²Ô²µ³Ù²¹³¾±ð²Ô³ú³ó³Ü²Ô²ú±ð¾±³Ù²¹²Ô³ó³Ü²Ô±ô³Ü²ÔÂá¾±²¹²õ³ó¾±£¬³Ù²¹´Ú²¹³æ¾±²¹²Ô»å³Ü¾±´Ú²¹²Ô²µÂá¾±²Ô²µ²õ³ó¾±²µ±ð·É±ð²Ô·É³Ü´Ú²¹²Ô³ú¾±£¬·É±ð²Ô³æ¾±²¹²Ô²µ²â¾±³Ù¾±²Ô²µ³ú³ó±ð²õ³ó¾±Âá¾±³Ü´Ú²¹²Ô²µ²¹²Ô¡£³ú³ó±ð²õ³ó¾±²â´Ç³Ü²ú±ð¾±³Ù²¹³ó³Ü¾±Âá³Ü±ð±ô¾±²¹´Ç¡£Âá¾±³Ü³ú²¹¾±³ú³ó±ð²õ³ó¾±£¬³¦³ó³Ü²¹²Ô³æ³Ü±ð³¾¾±²Ô²µ»å±ðÂá¾±±ðÂá¾±±ð·É´Ç²õ³ó²¹²Ô²µ³¾±ð²Ô±ô²¹¾±¡­¡­³¾³Ü±ç¾±²¹²Ô»å±ð³æ¾±²Ô³æ¾±³ó³Ü²¹²Ô³¦³ó±ð²Ô²µ£¬²µ²¹¾±±ô¾±²¹²Ô³¾¾±²Ô²µ³¦³ó²¹²Ô±è¾±²Ô9²â³Ü±ð16°ù¾±³ú²¹¾±³Ù¾±²¹²Ô³¾²¹´Ç³ó±ð³¾²¹´Ç³Ù²¹¾±»å±ð²ú¾±²Ô²µ³ú³Ü´Ç±ô¾±²Ô»å¾±²¹²Ô°ì²¹¾±³¾²¹¾±£¬²µ´Ç²Ô²µ3³ú³ó´Ç²Ô²µ²µ³Ü¾±²µ±ð£¬´Ú±ð²Ô²ú¾±±ð·É±ð¾±2°ì±ð¡¢6°ì±ð¡¢12°ì±ð³ú³ó³Ü²¹²Ô²µ¡£±ç¾±³ú³ó´Ç²Ô²µ£¬²â´Ç³Ü´Ú±ð²Ô·É±ð¾±Âá¾±²Ô²µ»å¾±²¹²Ô²ú²¹²Ô³ó±ðÂá¾±²¹²Ô³Ù²¹²Ô²µ²ú²¹²Ô£¬Âá¾±²Ô²µ»å¾±²¹²Ô²ú²¹²Ô12°ì±ð/120°ì±ð³ú³ó³Ü²¹²Ô²µ³¦³ó²¹²Ô±è¾±²Ô»å±ðÂá¾±²¹²µ±ð·É±ð¾±169²â³Ü²¹²Ô/³ó±ð£¬2°ì±ð³ú³ó³Ü²¹²Ô²µ·É±ð¾±35²â³Ü²¹²Ô/³ó±ð¡£³ú²¹¾±°ì´Ç³Ü·É±ð¾±²õ³ó²¹²Ô²µ³ú±ð²â´Ç³ÜÂá¾±³Ü³æ¾±²Ô²Ô¾±³Ü²Ô²¹¾±±ç¾±²¹´Ç°ì±ð±ô¾±³ó±ðÂá¾±³Ü³æ¾±²Ô³ó±ð¾±±ç¾±²¹´Ç°ì±ð±ô¾±2³ú³ó´Ç²Ô²µ¡£

×î(´Ü³Ü¾±)ÖÕ(´Ü³ó´Ç²Ô²µ)£¬²Ì(°ä²¹¾±)ÉÙ(³§³ó²¹´Ç)·Ò(¹ó±ð²Ô)²»(µþ³Ü)µÃ(¶Ù±ð)²»(µþ³Ü)ÔÚ(´Ü²¹¾±)27Ëê(³§³Ü¾±)ÄÇ(±·²¹)Äê(±·¾±²¹²Ô)º¬(±á²¹²Ô)Àá(³¢±ð¾±)¶Ï(¶Ù³Ü²¹²Ô)¾ø(´³³Ü±ð)ĸ(²Ñ³Ü)Å®(±·±¹)¹Ø(³Ò³Ü²¹²Ô)ϵ(³Ý¾±)¡£Õâ(´Ü³ó±ð)ÖÖ(´Ü³ó´Ç²Ô²µ)¡°Îï(°Â³Ü)Àí(³¢¾±)Ô¶(³Û³Ü²¹²Ô)Àë(³¢¾±)¡±ºÜ(±á±ð²Ô)Í´(°Õ´Ç²Ô²µ)¿à(°­³Ü)£¬È´(²Ï³Ü±ð)Ò²(³Û±ð)¸ø(³Ò±ð¾±)ÁË(³¢¾±²¹´Ç)²Ì(°ä²¹¾±)ÉÙ(³§³ó²¹´Ç)·Ò(¹ó±ð²Ô)×Ô(´Ü¾±)ÎÒ(°Â´Ç)ÁÆ(³¢¾±²¹´Ç)Óú(³Û³Ü)µÄ(¶Ù±ð)¿Õ(°­´Ç²Ô²µ)¼ä(´³¾±²¹²Ô)£¬ÈÃ(¸é²¹²Ô²µ)Ëý(°Õ²¹)µÃ(¶Ù±ð)ÒÔ(³Û¾±)ר(´Ü³ó³Ü²¹²Ô)×¢(´Ü³ó³Ü)ÓÚ(³Û³Ü)×Ô(´Ü¾±)¼º(´³¾±)µÄ(¶Ù±ð)ÊÂ(³§³ó¾±)Òµ(³Û±ð)ºÍ(±á±ð)¸ö(³Ò±ð)ÈË(¸é±ð²Ô)Éú(³§³ó±ð²Ô²µ)»î(±á³Ü´Ç)¡£

Ö®ºóÓÖ·¢ÎÄ¡°ÔÙ¼û¡±¡£kubernetes(k8s)¼¯Èº°²×°²¿ÊðÊÖ²áÔ­´´2023-09-09 17:24¡¤ÔËάÉú»îÈÕ־Ŀ¼һ ¼¯Èº²¿Êð¹ý³Ì 11 °æ±¾ÒÔ¼°¹æ»®ÐÅÏ¢ 12 ¼¯Èº²¿Êð 13Òì³£½Úµã´¦Àí£º 13Ò» ¼¯Èº²¿Êð¹ý³Ì1 °æ±¾ÒÔ¼°¹æ»®ÐÅÏ¢1.1 °æ±¾ÐÅÏ¢Ãû³Æ °æ±¾ºÅÄÚºË 3.10.0-1160.el7.x86_64ϵͳ CentOS Linux release 7.9.2009 (Core)docker 20.10.9kubeadm 1.22.0kubelet 1.22.0kubectl 1.22.01.2 ·þÎñÆ÷ÐÅÏ¢¹æ»®IP Ö÷»úÃû192.168.10.128 master192.168.10.129 node-01192.168.10.130 node-022 ¼¯Èº²¿Êð˵Ã÷£º µÚÒ»~µÚ°Ë²½ Èý¸ö½Úµã¾ù²Ù×÷£»µÚ¾ÅÊ®²½master½Úµã²Ù×÷£¬µÚʮһ²½Öènode½Úµã²Ù×÷2.1 ¹Ø±Õ·À»ðǽ²Ù×÷systemctl stop firewalld;systemctl disable firewalld2.2 ¹Ø±Õselinuxsetenforce 0 #ÁÙʱ¹Ø±Õsed -i '/SELINUX/s/enforcing/disabled/g' /etc/sysconfig/selinux #ÓÀ¾Ã¹Ø±Õ2.3 ¹Ø±Õswapswapoff -a #ÁÙʱ¹Ø±Õsed -ri 's/.*swap.*/#&/' /etc/fstab #ÓÀ¾Ã¹Ø±Õ2.4 ÐÞ¸ÄhostsÎļþcat >> /etc/hosts < /etc/sysctl.d/k8s.conf << EOFnet.bridge.bridge-nf-call-ip6tables = 1net.bridge.bridge-nf-call-iptables = 1EOFsysctl --system2.6 °²×°dockerwget https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo -O /etc/yum.repos.d/docker-ce.repoyum list docker-ce --showduplicates | sort -r #²é¿´dockerÏà¹Ø°æ±¾yum install docker-ce-20.10.9 docker-ce-cli-20.10.9 #°²×°Ö¸¶¨µÄ°æ±¾systemctl start dockersystemctl enable dockerdocker info|grep cgroup´Ë´¦¿ÉÄÜ´æÔÚµÄÎÊÌâ docker°æ±¾ºÍkubelete´æÔÚ¼æÈÝÐÔÎÊÌâ½â¾ö·½°¸Ò»{"exec-opts": ["native.cgroupdriver=systemd"]}½â¾ö·½°¸¶þ# docker.servicevi /usr/lib/systemd/system/docker.service# Ìí¼ÓExecStart=/usr/bin/dockerd --exec-opt native.cgroupdriver=systemd2.7 Ìí¼Ó°¢ÀïÔÆyumÈí¼þÔ´cat > /etc/yum.repos.d/kubernetes.repo << EOF[kubernetes]name=Kubernetesbaseurl=https://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-x86_64enabled=1gpgcheck=0repo_gpgcheck=1gpgkey=https://mirrors.aliyun.com/kubernetes/yum/doc/yum-key.gpghttps://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpgEOF2.8 °²×°kubeadm¡¢kubelet¡¢kubectlyum install -y kubelet-1.18.0 kubectl-1.18.0 kubeadm-1.18.0systemctl enable kubelet2.9 ³õʼ»¯master½Úµãkubeadm init \--image-repository=registry.cn-hangzhou.aliyuncs.com/google_containers \--apiserver-advertise-address=192.168.10.128 \--kubernetes-version=v1.18.0 \--service-cidr=10.96.0.0/12 \--pod-network-cidr=10.244.0.0/16 \--v=6mkdir -p $HOME/.kubesudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/configsudo chown $(id -u):$(id -g) $HOME/.kube/config# µÚ1ÌõÃüÁ±íʾ´´½¨Òþ²ØÎļþ¼Ð.kube# µÚ2ÌõÃüÁ±íʾ¸´ÖÆÎļþadmin.confµ½¸ÃÎļþ¼ÐÏÂ# µÚ3ÌõÃüÁ±íʾÉèÖÃÎļþµÄËùÊôÓû§¡¢Óû§×é[root@master ~]# kubeadm init \> --image-repository=registry.cn-hangzhou.aliyuncs.com/google_containers \> --apiserver-advertise-address=192.168.10.128 \> --kubernetes-version=v1.18.0 \> --service-cidr=10.96.0.0/12 \> --pod-network-cidr=10.244.0.0/16 \> --v=6I0730 00:35:34.465349 26797 initconfiguration.go:103] detected and using CRI socket: /var/run/dockershim.sockW0730 00:35:34.467144 26797 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io][init] Using Kubernetes version: v1.18.0[preflight] Running pre-flight checksI0730 00:35:34.468752 26797 checks.go:577] validating Kubernetes and kubeadm versionI0730 00:35:34.468817 26797 checks.go:166] validating if the firewall is enabled and activeI0730 00:35:34.495833 26797 checks.go:201] validating availability of port 6443I0730 00:35:34.498186 26797 checks.go:201] validating availability of port 10259I0730 00:35:34.498364 26797 checks.go:201] validating availability of port 10257I0730 00:35:34.498438 26797 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yamlI0730 00:35:34.498478 26797 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yamlI0730 00:35:34.498495 26797 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yamlI0730 00:35:34.498511 26797 checks.go:286] validating the existence of file /etc/kubernetes/manifests/etcd.yamlI0730 00:35:34.498542 26797 checks.go:432] validating if the connectivity type is via proxy or directI0730 00:35:34.498639 26797 checks.go:471] validating http connectivity to first IP address in the CIDRI0730 00:35:34.498692 26797 checks.go:471] validating http connectivity to first IP address in the CIDRI0730 00:35:34.498729 26797 checks.go:102] validating the container runtimeI0730 00:35:34.749587 26797 checks.go:128] validating if the service is enabled and active[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/I0730 00:35:35.004904 26797 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptablesI0730 00:35:35.005062 26797 checks.go:335] validating the contents of file /proc/sys/net/ipv4/ip_forwardI0730 00:35:35.005204 26797 checks.go:649] validating whether swap is enabled or notI0730 00:35:35.005266 26797 checks.go:376] validating the presence of executable conntrackI0730 00:35:35.005761 26797 checks.go:376] validating the presence of executable ipI0730 00:35:35.006005 26797 checks.go:376] validating the presence of executable iptablesI0730 00:35:35.006037 26797 checks.go:376] validating the presence of executable mountI0730 00:35:35.006272 26797 checks.go:376] validating the presence of executable nsenterI0730 00:35:35.006587 26797 checks.go:376] validating the presence of executable ebtablesI0730 00:35:35.006621 26797 checks.go:376] validating the presence of executable ethtoolI0730 00:35:35.006642 26797 checks.go:376] validating the presence of executable socatI0730 00:35:35.006666 26797 checks.go:376] validating the presence of executable tcI0730 00:35:35.006684 26797 checks.go:376] validating the presence of executable touchI0730 00:35:35.006709 26797 checks.go:520] running all checks[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.9. Latest validated version: 19.03I0730 00:35:35.243646 26797 checks.go:406] checking whether the given node name is reachable using net.LookupHostI0730 00:35:35.244443 26797 checks.go:618] validating kubelet versionI0730 00:35:35.388021 26797 checks.go:128] validating if the service is enabled and activeI0730 00:35:35.407445 26797 checks.go:201] validating availability of port 10250I0730 00:35:35.407861 26797 checks.go:201] validating availability of port 2379I0730 00:35:35.408055 26797 checks.go:201] validating availability of port 2380I0730 00:35:35.408214 26797 checks.go:249] validating the existence and emptiness of directory /var/lib/etcd[preflight] Pulling images required for setting up a Kubernetes cluster[preflight] This might take a minute or two, depending on the speed of your internet connection[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'I0730 00:35:35.508189 26797 checks.go:844] pulling registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.18.0I0730 00:36:37.874415 26797 checks.go:844] pulling registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.18.0I0730 00:37:22.204601 26797 checks.go:844] pulling registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.18.0I0730 00:37:54.572787 26797 checks.go:844] pulling registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.18.0I0730 00:38:42.961883 26797 checks.go:844] pulling registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.2I0730 00:38:57.533578 26797 checks.go:844] pulling registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.4.3-0I0730 00:40:27.427614 26797 checks.go:844] pulling registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:1.6.7I0730 00:40:49.102866 26797 kubelet.go:64] Stopping the kubelet[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"[kubelet-start] Starting the kubelet[certs] Using certificateDir folder "/etc/kubernetes/pki"I0730 00:40:49.560999 26797 certs.go:103] creating a new certificate authority for ca[certs] Generating "ca" certificate and key[certs] Generating "apiserver" certificate and key[certs] apiserver serving cert is signed for DNS names [master kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.10.128][certs] Generating "apiserver-kubelet-client" certificate and keyI0730 00:40:51.171593 26797 certs.go:103] creating a new certificate authority for front-proxy-ca[certs] Generating "front-proxy-ca" certificate and key[certs] Generating "front-proxy-client" certificate and keyI0730 00:40:52.331002 26797 certs.go:103] creating a new certificate authority for etcd-ca[certs] Generating "etcd/ca" certificate and key[certs] Generating "etcd/server" certificate and key[certs] etcd/server serving cert is signed for DNS names [master localhost] and IPs [192.168.10.128 127.0.0.1 ::1][certs] Generating "etcd/peer" certificate and key[certs] etcd/peer serving cert is signed for DNS names [master localhost] and IPs [192.168.10.128 127.0.0.1 ::1][certs] Generating "etcd/healthcheck-client" certificate and key[certs] Generating "apiserver-etcd-client" certificate and keyI0730 00:40:54.818549 26797 certs.go:69] creating new public/private key files for signing service account users[certs] Generating "sa" key and public key[kubeconfig] Using kubeconfig folder "/etc/kubernetes"I0730 00:40:55.968722 26797 kubeconfig.go:79] creating kubeconfig file for admin.conf[kubeconfig] Writing "admin.conf" kubeconfig fileI0730 00:40:56.245786 26797 kubeconfig.go:79] creating kubeconfig file for kubelet.conf[kubeconfig] Writing "kubelet.conf" kubeconfig fileI0730 00:40:56.621396 26797 kubeconfig.go:79] creating kubeconfig file for controller-manager.conf[kubeconfig] Writing "controller-manager.conf" kubeconfig fileI0730 00:40:56.818129 26797 kubeconfig.go:79] creating kubeconfig file for scheduler.conf[kubeconfig] Writing "scheduler.conf" kubeconfig file[control-plane] Using manifest folder "/etc/kubernetes/manifests"[control-plane] Creating static Pod manifest for "kube-apiserver"I0730 00:40:57.162267 26797 manifests.go:91] [control-plane] getting StaticPodSpecsI0730 00:40:57.163474 26797 manifests.go:104] [control-plane] adding volume "ca-certs" for component "kube-apiserver"I0730 00:40:57.163497 26797 manifests.go:104] [control-plane] adding volume "etc-pki" for component "kube-apiserver"I0730 00:40:57.163507 26797 manifests.go:104] [control-plane] adding volume "k8s-certs" for component "kube-apiserver"I0730 00:40:57.176186 26797 manifests.go:121] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"[control-plane] Creating static Pod manifest for "kube-controller-manager"I0730 00:40:57.176232 26797 manifests.go:91] [control-plane] getting StaticPodSpecsW0730 00:40:57.176346 26797 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"I0730 00:40:57.176680 26797 manifests.go:104] [control-plane] adding volume "ca-certs" for component "kube-controller-manager"I0730 00:40:57.176688 26797 manifests.go:104] [control-plane] adding volume "etc-pki" for component "kube-controller-manager"I0730 00:40:57.176693 26797 manifests.go:104] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager"I0730 00:40:57.176697 26797 manifests.go:104] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager"I0730 00:40:57.176702 26797 manifests.go:104] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager"I0730 00:40:57.177947 26797 manifests.go:121] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"[control-plane] Creating static Pod manifest for "kube-scheduler"I0730 00:40:57.177980 26797 manifests.go:91] [control-plane] getting StaticPodSpecsW0730 00:40:57.178062 26797 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"I0730 00:40:57.178409 26797 manifests.go:104] [control-plane] adding volume "kubeconfig" for component "kube-scheduler"I0730 00:40:57.179219 26797 manifests.go:121] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"I0730 00:40:57.180242 26797 local.go:72] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml"I0730 00:40:57.180284 26797 waitcontrolplane.go:87] [wait-control-plane] Waiting for the API server to be healthyI0730 00:40:57.181798 26797 loader.go:375] Config loaded from file: /etc/kubernetes/admin.conf[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0sI0730 00:40:57.185824 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:40:57.687883 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:40:58.187689 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:40:58.687505 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:40:59.187708 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:40:59.687437 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:41:00.187753 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:41:00.687830 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:41:01.187695 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:41:01.686916 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:41:02.188601 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:41:02.686665 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:41:03.187222 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:41:03.688352 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 0 millisecondsI0730 00:41:04.187550 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 1 millisecondsI0730 00:41:04.691266 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s in 1 millisecondsI0730 00:41:14.130375 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s 500 Internal Server Error in 8944 millisecondsI0730 00:41:14.202729 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s 500 Internal Server Error in 16 millisecondsI0730 00:41:14.689598 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s 500 Internal Server Error in 3 millisecondsI0730 00:41:15.196163 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s 500 Internal Server Error in 9 millisecondsI0730 00:41:15.689662 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s 500 Internal Server Error in 3 millisecondsI0730 00:41:16.190375 26797 round_trippers.go:443] GET https://192.168.10.128:6443/healthz?timeout=10s 200 OK in 3 milliseconds[apiclient] All control plane components are healthy after 19.005906 secondsI0730 00:41:16.190562 26797 uploadconfig.go:108] [upload-config] Uploading the kubeadm ClusterConfiguration to a ConfigMap[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" NamespaceI0730 00:41:16.202115 26797 round_trippers.go:443] POST https://192.168.10.128:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 6 millisecondsI0730 00:41:16.210907 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 7 millisecondsI0730 00:41:16.219527 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 6 millisecondsI0730 00:41:16.220662 26797 uploadconfig.go:122] [upload-config] Uploading the kubelet component config to a ConfigMap[kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the clusterI0730 00:41:16.227796 26797 round_trippers.go:443] POST https://192.168.10.128:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 6 millisecondsI0730 00:41:16.234309 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 6 millisecondsI0730 00:41:16.241883 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 7 millisecondsI0730 00:41:16.242124 26797 uploadconfig.go:127] [upload-config] Preserving the CRISocket information for the control-plane nodeI0730 00:41:16.242159 26797 patchnode.go:30] [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "master" as an annotationI0730 00:41:16.751565 26797 round_trippers.go:443] GET https://192.168.10.128:6443/api/v1/nodes/master?timeout=10s 200 OK in 4 millisecondsI0730 00:41:16.767568 26797 round_trippers.go:443] PATCH https://192.168.10.128:6443/api/v1/nodes/master?timeout=10s 200 OK in 11 milliseconds[upload-certs] Skipping phase. Please see --upload-certs[mark-control-plane] Marking the node master as control-plane by adding the label "node-role.kubernetes.io/master=''"[mark-control-plane] Marking the node master as control-plane by adding the taints [node-role.kubernetes.io/master:NoSchedule]I0730 00:41:17.273970 26797 round_trippers.go:443] GET https://192.168.10.128:6443/api/v1/nodes/master?timeout=10s 200 OK in 4 millisecondsI0730 00:41:17.285850 26797 round_trippers.go:443] PATCH https://192.168.10.128:6443/api/v1/nodes/master?timeout=10s 200 OK in 9 milliseconds[bootstrap-token] Using token: re6mt8.bwol9dej5nsqubxt[bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC RolesI0730 00:41:17.291184 26797 round_trippers.go:443] GET https://192.168.10.128:6443/api/v1/namespaces/kube-system/secrets/bootstrap-token-re6mt8?timeout=10s 404 Not Found in 4 millisecondsI0730 00:41:17.299410 26797 round_trippers.go:443] POST https://192.168.10.128:6443/api/v1/namespaces/kube-system/secrets?timeout=10s 201 Created in 6 milliseconds[bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodesI0730 00:41:17.309247 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/clusterroles?timeout=10s 201 Created in 8 millisecondsI0730 00:41:17.318135 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 7 milliseconds[bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentialsI0730 00:41:17.325642 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 6 milliseconds[bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap TokenI0730 00:41:17.332197 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 6 milliseconds[bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the clusterI0730 00:41:17.338051 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 5 milliseconds[bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespaceI0730 00:41:17.338274 26797 clusterinfo.go:45] [bootstrap-token] loading admin kubeconfigI0730 00:41:17.339582 26797 loader.go:375] Config loaded from file: /etc/kubernetes/admin.confI0730 00:41:17.339606 26797 clusterinfo.go:53] [bootstrap-token] copying the cluster from admin.conf to the bootstrap kubeconfigI0730 00:41:17.340061 26797 clusterinfo.go:65] [bootstrap-token] creating/updating ConfigMap in kube-public namespaceI0730 00:41:17.346320 26797 round_trippers.go:443] POST https://192.168.10.128:6443/api/v1/namespaces/kube-public/configmaps?timeout=10s 201 Created in 6 millisecondsI0730 00:41:17.346598 26797 clusterinfo.go:79] creating the RBAC rules for exposing the cluster-info ConfigMap in the kube-public namespaceI0730 00:41:17.354296 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/roles?timeout=10s 201 Created in 7 millisecondsI0730 00:41:17.360015 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/rolebindings?timeout=10s 201 Created in 5 millisecondsI0730 00:41:17.361663 26797 kubeletfinalize.go:88] [kubelet-finalize] Assuming that kubelet client certificate rotation is enabled: found "/var/lib/kubelet/pki/kubelet-client-current.pem"[kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and keyI0730 00:41:17.362911 26797 loader.go:375] Config loaded from file: /etc/kubernetes/kubelet.confI0730 00:41:17.364376 26797 kubeletfinalize.go:132] [kubelet-finalize] Restarting the kubelet to enable client certificate rotationI0730 00:41:17.680009 26797 round_trippers.go:443] GET https://192.168.10.128:6443/apis/apps/v1/namespaces/kube-system/deployments?labelSelector=k8s-app%3Dkube-dns 200 OK in 11 millisecondsI0730 00:41:17.694805 26797 round_trippers.go:443] GET https://192.168.10.128:6443/api/v1/namespaces/kube-system/configmaps/kube-dns?timeout=10s 404 Not Found in 5 millisecondsI0730 00:41:17.700146 26797 round_trippers.go:443] GET https://192.168.10.128:6443/api/v1/namespaces/kube-system/configmaps/coredns?timeout=10s 404 Not Found in 4 millisecondsI0730 00:41:17.709319 26797 round_trippers.go:443] POST https://192.168.10.128:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 8 millisecondsI0730 00:41:17.716415 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/clusterroles?timeout=10s 201 Created in 6 millisecondsI0730 00:41:17.722154 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 5 millisecondsI0730 00:41:17.730289 26797 round_trippers.go:443] POST https://192.168.10.128:6443/api/v1/namespaces/kube-system/serviceaccounts?timeout=10s 201 Created in 6 millisecondsI0730 00:41:17.776066 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/apps/v1/namespaces/kube-system/deployments?timeout=10s 201 Created in 34 millisecondsI0730 00:41:17.790010 26797 round_trippers.go:443] POST https://192.168.10.128:6443/api/v1/namespaces/kube-system/services?timeout=10s 201 Created in 11 milliseconds[addons] Applied essential addon: CoreDNSI0730 00:41:17.798512 26797 round_trippers.go:443] POST https://192.168.10.128:6443/api/v1/namespaces/kube-system/serviceaccounts?timeout=10s 201 Created in 8 millisecondsI0730 00:41:17.809712 26797 round_trippers.go:443] POST https://192.168.10.128:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 8 millisecondsI0730 00:41:17.861931 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/apps/v1/namespaces/kube-system/daemonsets?timeout=10s 201 Created in 35 millisecondsI0730 00:41:17.872631 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 9 millisecondsI0730 00:41:17.878624 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 5 millisecondsI0730 00:41:17.884579 26797 round_trippers.go:443] POST https://192.168.10.128:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 5 milliseconds[addons] Applied essential addon: kube-proxyI0730 00:41:17.885611 26797 loader.go:375] Config loaded from file: /etc/kubernetes/admin.confI0730 00:41:17.886868 26797 loader.go:375] Config loaded from file: /etc/kubernetes/admin.confYour Kubernetes control-plane has initialized successfully!To start using your cluster, you need to run the following as a regular user:mkdir -p $HOME/.kubesudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/configsudo chown $(id -u):$(id -g) $HOME/.kube/configYou should now deploy a pod network to the cluster.Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:https://kubernetes.io/docs/concepts/cluster-administration/addons/Then you can join any number of worker nodes by running the following on each as root:kubeadm join 192.168.10.128:6443 --token re6mt8.bwol9dej5nsqubxt \--discovery-token-ca-cert-hash sha256:21ec2e66f355b7d31652b2b790e4862ef2fb9b6069d7425d122007a7d2edce782.10 °²×°podÍøÂç²å¼þkubectl apply -f https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yaml" with one of the options listed at:https://kubernetes.io/docs/concepts/cluster-administration/addons/Then you can join any number of worker nodesbyttps://www.ipaddress.com½øÐв鿴£¬½«ÓòÃûºÍIP¶ÔÓ¦¹Øϵдµ½hostsÎļþÖÐ2.11 node½Úµã¼ÓÈ뼯Ⱥkubeadm join 192.168.10.128:6443 --token whxbm2.x70y9k1feop2604b \--discovery-token-ca-cert-hash sha256:d4306836b7ef32fd802e559cf717bbbe3af6dd75d3cb2fa4d3db7a16cc25a6573Òì³£½Úµã´¦Àí£ºÈçÐèҪɾ³ý½ÚµãµÄ»°£¬ÔòÐèÒªÖ´ÐÐÈçϲÙ×÷Ö÷½Úµã²Ù×÷# ÔÚÖ÷½ÚµãÉÏÇýÖð¸Ãnode½ÚµãÉϵÄPodkubectl drain node02 --delete-local-data --force --ignore-daemonsets# ÔÚÖ÷½ÚµãÉÏɾ³ý¸Ãnode½Úµãkubectl delete node node02´Ó½ÚµãÉϲÙ×÷# ÖØÖÃk8skubeadm reset# ɾ³ý²ÐÁôµÄÎļþrm -rf /etc/kubernetes/*# Çå³ýiptables»òÕßipvsµÄÅäÖÃiptables -F && iptables -t nat -F && iptables -t mangle -F && iptables -Xipvsadm --clearÈç¹ûÊÇmaster½Úµã »¹ÐèҪעÒârm -rf ~/.kube¡¶(ÍøÍõ)´¿ÊôÒâÍâ¡·×ÏÄ°º®³å½ú½­ÎÄѧ³Ç³å¡¾ÑÜÉúС˵´¥...

Ò»¸Ä̤°å³µÐ͹⻬ƽÕûµÄÍâ¿ÇÔìÐÍÒýÈëÁËÔ½Ò°³µÐ͵ÄÉè¼ÆÓïÑÔ¸øÈË´øÀ´¸üȫеÄÌåÑé

ÉùÃ÷£º¸ÃÎĹ۵ã½ö´ú±í×÷Õß±¾ÈË£¬ËѺüºÅϵÐÅÏ¢·¢²¼Æ½Ì¨£¬ËѺü½öÌṩÐÅÏ¢´æ´¢¿Õ¼ä·þÎñ¡£