Kubernetes环境搭建

落雁發表於 2021-9-2 08:47:00

<section id="nice" data-tool="mdnice编辑器" data-website="https://www.mdnice.com" style="font-size: 16px; color: rgba(0, 0, 0, 1); padding: 0 10px; line-height: 1.6; word-spacing: 0; letter-spacing: 0; word-wrap: break-word; text-align: left; font-family: Optima-Regular, Optima, PingFangSC-light, PingFangTC-light, "PingFang SC", Cambria, Cochin, Georgia, Times, "Times New Roman", serif"><h3 data-tool="mdnice编辑器" style="margin: 30px 0 15px; border-bottom: 2px solid rgba(0, 172, 193, 1); padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 20px"><span class="prefix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"><span class="content" style="display: inline-block; font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px">前言<span class="suffix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"></h3>
本篇是Kubernetes第二篇，大家一定要把环境搭建起来，看是解决不了问题的，必须实战。
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">Kubernetes系列文章:</h5>
<ol data-tool="mdnice编辑器" style="margin-top: 8px; margin-bottom: 8px; padding-left: 25px; color: rgba(0, 0, 0, 1); list-style-type: decimal">
<li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">Kubernetes介绍</section></li></ol>
<h3 data-tool="mdnice编辑器" style="margin: 30px 0 15px; border-bottom: 2px solid rgba(0, 172, 193, 1); padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 20px"><span class="prefix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"><span class="content" style="display: inline-block; font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px">Kubernetes搭建方式介绍和对比<span class="suffix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"></h3>
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">Minikube</h5>
Minikube是一种可以在本地轻松运行Kubernetes的工具。Minikube在笔记本电脑的VM中运行单节点Kubernetes集群，供希望尝试Kubernetes或日常开发的用户测试使用。特点是不能启动生产集群,没有高可用性的单节点机器。
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">Kubeadm</h5>
Kubeadm是Kubernetes 1.4开始新增的特性，Kubeadm 是一个提供了 kubeadm init 和 kubeadm join 的工具，作为创建 Kubernetes 集群的 “快捷途径” 的最佳实践。Kubeadm 通过执行必要的操作来启动和运行最小可用集群。按照设计，它只关注启动引导，而非配置机器。同样的，安装各种 “锦上添花” 的扩展，例如 Kubernetes Dashboard、监控方案、以及特定云平台的扩展，都不在讨论范围内。Kubeadm是一种把 kubelet 直接运行在宿主机上，然后使用容器部署其他的 Kubernetes 组件的方案。
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">Kind</h5>
Kind 是 Kubernetes in Docker 的简写，是一个使用 Docker 容器作为 Nodes，在本地创建和运行 Kubernetes 群集的工具。适用于在本机创建 Kubernetes 群集环境进行开发和测试。Kind 使用kubeadm创建和启动群集节点，使用 containerd 作为容器运行时。
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">二进制包</h5>
二进制包就是在官网下载相关的组件的二进制包，相对于上面两种快速搭建集群的方式，其实就是相当于用程序脚本帮我们装好了集群，前两者属于自动部署，简化部署操作，自动部署屏蔽了很多细节，使得对各个模块感知很少，遇到问题很难排查，如果手动安装，对Kubernetes理解也会更全面。二进制包目前生产环境的主流搭建方式，已在生产环境验证，kubeadm也可以搭建生产环境。
<h3 data-tool="mdnice编辑器" style="margin: 30px 0 15px; border-bottom: 2px solid rgba(0, 172, 193, 1); padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 20px"><span class="prefix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"><span class="content" style="display: inline-block; font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px">使用Kubeadm搭建Kubernetes学习环境<span class="suffix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"></h3>
这里我简单说下我为啥选择Kubeadm作为自己搭建集群工具，Kind、Minikube实在是太简单，根本让我们感觉不到一点困难，Kubeadm可以让我们适当体验Kubernetes搭建过程，去理解一些组件之间的交互，二进制才是我们终极目标，我只是刚开始不想让大家被安装就抹灭了学习Kubernetes的兴趣。
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">配置说明</h5>
在搭建K8S集群时，推荐在阿里云或腾讯云采购如下配置(当然也可以使用自己虚机):
<ol data-tool="mdnice编辑器" style="margin-top: 8px; margin-bottom: 8px; padding-left: 25px; color: rgba(0, 0, 0, 1); list-style-type: decimal">
<li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">至少2台2C2G的服务器，最好2C4G或者8G，2G的话内存单存Kubernetes就会占用一般，后面不太方便大家做实验，我采用的2台2C4G阿里云机器;</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">系统的话大家采用CentOS 7.X 或 CentOS 8.X的版本，这里我采用8.2的版本；</section></li></ol>
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">搭建前准备工作</h5>
注意:我这里采用的Kubernetes1.21.2和Docker 20.10.7的版本，大家注意下版本问题。
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">查看Linux版本</h5>
<pre class="custom" data-tool="mdnice编辑器" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="word-wrap: break-word; margin: 0 2px; overflow-x: auto; padding: 15px 16px 16px; color: rgba(56, 58, 66, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; font-size: 12px; -webkit-overflow-scrolling: touch; background: rgba(250, 250, 250, 1); border-radius: 5px">#所有机器都进行检查 cat /etc/redhat-release </code></pre>
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">修改hostname</h5>
<pre class="custom" data-tool="mdnice编辑器" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="word-wrap: break-word; margin: 0 2px; overflow-x: auto; padding: 15px 16px 16px; color: rgba(56, 58, 66, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; font-size: 12px; -webkit-overflow-scrolling: touch; background: rgba(250, 250, 250, 1); border-radius: 5px">#这里强烈建议修改hostname，这样子在集群列表查询的时候很很明确 #修改hostname hostnamectl set-hostname demo-master-1 #检查是否修改成功 hostname #设置hostname解析 类似windows的host解析 echo "127.0.0.1   $(hostname)" >> /etc/hosts </code></pre>
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">查看网络</h5>
<pre class="custom" data-tool="mdnice编辑器" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="word-wrap: break-word; margin: 0 2px; overflow-x: auto; padding: 15px 16px 16px; color: rgba(56, 58, 66, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; font-size: 12px; -webkit-overflow-scrolling: touch; background: rgba(250, 250, 250, 1); border-radius: 5px">#查看内网ip地址 找到eth0 ip add #使用ping命令保证每个节点都是IP地址必须可以互通 ping #关闭防火墙 systemctl stop firewalld systemctl disable firewalld </code></pre>
<figure data-tool="mdnice编辑器" style="margin: 10px 0; display: flex; flex-direction: column; justify-content: center; align-items: center"><img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/374ad558221e44c598e993092c698c37~tplv-k3u1fbpfcp-zoom-1.image"><figcaption style="margin-top: 5px; text-align: center; color: rgba(136, 136, 136, 1); font-size: 14px">image.png</figcaption></figure>
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">Docker安装</h5>
可以参考我的这篇博文;
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">安装 kubeadm、kubelet 和 kubectl</h5>
<ol data-tool="mdnice编辑器" style="margin-top: 8px; margin-bottom: 8px; padding-left: 25px; color: rgba(0, 0, 0, 1); list-style-type: decimal">
<li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">配置配置Kubernetes的yum源;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">cat <<EOF > /etc/yum.repos.d/kubernetes.repo name=Kubernetes baseurl=http://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-x86_64 enabled=1 gpgcheck=0 repo_gpgcheck=0 gpgkey=http://mirrors.aliyun.com/kubernetes/yum/doc/yum-key.gpg        http://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpg EOF </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">如果存在旧版本首先卸载旧版本，安装kubelet、kubeadm、kubectl，如果非Master可以不安装kubectl；
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">#卸载Kubernetes yum remove -y kubelet kubeadm kubectl #安装 yum install -y kubelet-1.21.2 kubeadm-1.21.2 kubectl-1.21.2 #非master可以采用以下命令 yum install -y kubelet-1.21.2 kubeadm-1.21.2 </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">关闭Swap，这里简单聊下Kubernetes为什么会关闭Swap？Swap Space是磁盘上的一块区域，可以是一个分区，也可以是一个文件，或者是他们的组合。简单点说，当系统物理内存吃紧时，Linux会将内存中不常访问的数据保存到Swap上，这样系统就有更多的物理内存为各个进程服务，而当系统需要访问Swap上存储的内容时，再将Swap上的数据加载到内存中。Kubernetes关闭Swap一个是性能问题，开启Swap会严重影响性能（包括内存和I/O）；另一个是管理问题，开启Swap后通过Cgroups设置的内存上限就会失效，如果不关闭Kubernetes运行会出现错误，即使安装成功了，node重启后也会出现kubernetes server运行错误;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">swapoff -a yes | cp /etc/fstab /etc/fstab_bak cat /etc/fstab_bak |grep -v swap > /etc/fstab </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">关闭SeLinux，也简单聊一下为什么关闭SeLinux？SELinux(Secure Enhanced Linux)安全增强的Linux是美国国家安全局NSA针对计算机基础结构安全开发的一个全新的Linux安全策略机制。SELinux可以允许系统管理员更加灵活的来定义安全策略。SELinux是一个内核级别的安全机制，从Linux2.6内核之后就将SELinux集成在了内核当中，因为SELinux是内核级别的，所以我们对于其配置文件的修改都是需要重新启动操作系统才能生效的。现在主流发现的Linux版本里面都集成了SELinux机制，CentOS/RHEL都会默认开启SELinux机制。这里为什么建议大家关闭SeLinux，我相信不是专门的运维可能懂这个的人也不多，所以为了防止大家遇到一些奇怪的问题，就把它关闭吧;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">setenforce 0 sed -i "s/SELINUX=enforcing/SELINUX=disabled/g" /etc/selinux/config </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">将Docker的Cgroup Driver 修改为systemd并且更改Docker为国内的镜像加速器，不然在为Kubernetes集群添加节点时会报错；
</section></li></ol>
<pre class="custom" data-tool="mdnice编辑器" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="word-wrap: break-word; margin: 0 2px; overflow-x: auto; padding: 15px 16px 16px; color: rgba(56, 58, 66, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; font-size: 12px; -webkit-overflow-scrolling: touch; background: rgba(250, 250, 250, 1); border-radius: 5px">#修改docker/daemon.json cat > /etc/docker/daemon.json <<EOF {     "exec-opts": ["native.cgroupdriver=systemd"],     "log-driver": "json-file",     "log-opts": {     "max-size": "100m"     },     "storage-driver": "overlay2",     "registry-mirrors":[         "https://kfwkfulq.mirror.aliyuncs.com",         "https://2lqq34jg.mirror.aliyuncs.com",         "https://pee6w651.mirror.aliyuncs.com",         "http://hub-mirror.c.163.com",         "https://docker.mirrors.ustc.edu.cn",         "https://registry.docker-cn.com"     ] } EOF mkdir -p /etc/systemd/system/docker.service.d </code></pre>
<ol start="6" data-tool="mdnice编辑器" style="margin-top: 8px; margin-bottom: 8px; padding-left: 25px; color: rgba(0, 0, 0, 1); list-style-type: decimal">
<li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">设置网络配置相关的参数;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">#增加配置 cat <<EOF > /etc/sysctl.d/ k8s.confnet.ipv4.ip_forward=1 net.bridge.bridge-nf-call-ip6tables = 1 net.bridge.bridge-nf-call-iptables = 1 EOF #加载 sysctl --system </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">重启docker，并设置开机启动kubelet；
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px"># 重启docker，并启动 kubelet systemctl daemon-reloadsy stemctl restart docker systemctl enable kubelet && systemctl start kubelet </code></pre>
</section></li></ol>
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">初始化Master</h5>
<ol data-tool="mdnice编辑器" style="margin-top: 8px; margin-bottom: 8px; padding-left: 25px; color: rgba(0, 0, 0, 1); list-style-type: decimal">
<li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">配置Host相关内容；
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">#只在master节点执行 export MASTER_IP=172.21.122.230 #替换为自己hostName export APISERVER_NAME=demo-master-1 #设置Kubernetes容器组所在的网段 export POD_SUBNET=10.100.0.0/16echo "${MASTER_IP}    ${APISERVER_NAME}" >> /etc/hosts </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">配置kubeadm-config.xml相关参数，可以参考该文章，具体学习下参数含义；
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">#删除默认是版本 rm -f ./kubeadm-config.yaml #编辑kubeadm-config cat <<EOF > ./kubeadm-config.yaml #api的版本 apiVersion: kubeadm.k8s.io/v1beta2 #配置的种类 kind: ClusterConfiguration #版本 kubernetesVersion: v1.21.2 #镜像拉取地址 imageRepository: registry.aliyuncs.com/google_containers #api默认绑定的端口 controlPlaneEndpoint: "${APISERVER_NAME}:6443" #自定义的网络 networking:    serviceSubnet: "10.96.0.0/16"    podSubnet: "${POD_SUBNET}"    dnsDomain: "cluster.local" EOF </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">初始化初始化Master节点，成功以后大致信息如下图;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">kubeadm init --config=kubeadm-config.yaml --upload-certs </code></pre>
<figure style="margin: 10px 0; display: flex; flex-direction: column; justify-content: center; align-items: center"><img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/822780c70b2f455487bea25ab6a42b24~tplv-k3u1fbpfcp-zoom-1.image"><figcaption style="margin-top: 5px; text-align: center; color: rgba(136, 136, 136, 1); font-size: 14px">image.png</figcaption></figure>
如果出现以下错误，说明安装过kubeadm，使用以下命令进行初始化:
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">kubeadm reset -f
</code></pre>
<figure style="margin: 10px 0; display: flex; flex-direction: column; justify-content: center; align-items: center"><img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/7207e37d988c47a491a65274d336ad21~tplv-k3u1fbpfcp-zoom-1.image"><figcaption style="margin-top: 5px; text-align: center; color: rgba(136, 136, 136, 1); font-size: 14px">image.png</figcaption></figure>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">配置kubectl；
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">rm -rf /root/.kube/ mkdir /root/.kube/ cp -i /etc/kubernetes/admin.conf /root/.kube/config </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">检查节点初始化的情况;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">#查看各个组件执行的情况 watch kubectl get pod -n kube-system -o wide #查看Master节点情况 kubectl get nodes -o wide </code></pre>
<figure style="margin: 10px 0; display: flex; flex-direction: column; justify-content: center; align-items: center"><img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/f3d2edf09aec4134b7fb1dd29d2ccb9f~tplv-k3u1fbpfcp-zoom-1.image"><figcaption style="margin-top: 5px; text-align: center; color: rgba(136, 136, 136, 1); font-size: 14px">image.png</figcaption></figure>
<figure style="margin: 10px 0; display: flex; flex-direction: column; justify-content: center; align-items: center"><img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/f6c4f3832de0476085e88abd659f052b~tplv-k3u1fbpfcp-zoom-1.image"><figcaption style="margin-top: 5px; text-align: center; color: rgba(136, 136, 136, 1); font-size: 14px">image.png</figcaption></figure>
</section></li></ol>
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">安装网络插件</h5>
这里我选择了Flannel作为我的网络插件;
<pre class="custom" data-tool="mdnice编辑器" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="word-wrap: break-word; margin: 0 2px; overflow-x: auto; padding: 15px 16px 16px; color: rgba(56, 58, 66, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; font-size: 12px; -webkit-overflow-scrolling: touch; background: rgba(250, 250, 250, 1); border-radius: 5px">export POD_SUBNET=10.100.0.0/16 kubectl apply -f https://kuboard.cn/install-script/v1.21.x/calico-operator.yaml wget https://kuboard.cn/install-script/flannel/flannel-v0.14.0.yaml sed -i "s#10.244.0.0/16#${POD_SUBNET}#" flannel-v0.14.0.yaml kubectl apply -f ./flannel-v0.14.0.yaml </code></pre>
<h5 data-tool="mdnice编辑器" style="margin: 30px 0 15px; padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 16px">初始化Work节点</h5>
<ol data-tool="mdnice编辑器" style="margin-top: 8px; margin-bottom: 8px; padding-left: 25px; color: rgba(0, 0, 0, 1); list-style-type: decimal">
<li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">在Master节点上获取join参数;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">kubeadm token create --print-join-command </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">配置Work节点的host信息;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px"># 替换为master节点IP export MASTER_IP=172.21.122.230 # 替换为Master节点hostName export APISERVER_NAME=demo-master-1 echo "${MASTER_IP}    ${APISERVER_NAME}" >> /etc/hosts </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">初始化Work节点，执行Master节点上获取到的Join参数;
<figure style="margin: 10px 0; display: flex; flex-direction: column; justify-content: center; align-items: center"><img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/d3f8c05e19b84f99a83af2a7e35940b7~tplv-k3u1fbpfcp-zoom-1.image"><figcaption style="margin-top: 5px; text-align: center; color: rgba(136, 136, 136, 1); font-size: 14px">image.png</figcaption></figure>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">在Master上检查初始化结果;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">kubectl get nodes -o wide </code></pre>
<figure style="margin: 10px 0; display: flex; flex-direction: column; justify-content: center; align-items: center"><img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/7f65d52058bc460d860baba2de6fde91~tplv-k3u1fbpfcp-zoom-1.image"><figcaption style="margin-top: 5px; text-align: center; color: rgba(136, 136, 136, 1); font-size: 14px">image.png</figcaption></figure>
</section></li></ol>
恭喜你，至此安装完成!
<h3 data-tool="mdnice编辑器" style="margin: 30px 0 15px; border-bottom: 2px solid rgba(0, 172, 193, 1); padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 20px"><span class="prefix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"><span class="content" style="display: inline-block; font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px">实战<span class="suffix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"></h3>
这个案例就简单创建一个运行着Nginx的Pod，体验一把Kubernetes的使用，此外建议大家再开始学习阶段不要去使用一些图形化工具，先把一些命令整体去了解一下，以后在使用图形化界面。
<ol data-tool="mdnice编辑器" style="margin-top: 8px; margin-bottom: 8px; padding-left: 25px; color: rgba(0, 0, 0, 1); list-style-type: decimal">
<li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">创建一个nginx-deployment.yaml文件，这里大家可以使用vscode去编辑，然后同步到服务器上，应该vscode也可以直接同步到服务器上，具体怎么配置大家自行百度，编写如下内容:</section></li></ol>
<pre class="custom" data-tool="mdnice编辑器" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="word-wrap: break-word; margin: 0 2px; overflow-x: auto; padding: 15px 16px 16px; color: rgba(56, 58, 66, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; font-size: 12px; -webkit-overflow-scrolling: touch; background: rgba(250, 250, 250, 1); border-radius: 5px">#api版本
apiVersion: apps/v1
#指定资源的角色
kind: Deployment
#元数据名称
metadata:
name: nginx-deployment
#指定该资源的内容详情
spec:
#选择器
selector:
matchLabels:
 app: nginx
#Pod的定义
template:
metadata:
 labels:
 app: nginx
#指定该资源的内容
spec:
 containers:
 #容器名称
 - name: nginx
 #镜像版本
 image: nginx:latest
 #资源的限制
 resources:
 limits:
 memory: "128Mi"
 cpu: "500m"
 #暴露的端口
 ports:
 - containerPort: 80
</code><code class="hljs" style="word-wrap: break-word; margin: 0 2px; overflow-x: auto; padding: 15px 16px 16px; color: rgba(56, 58, 66, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; font-size: 12px; -webkit-overflow-scrolling: touch; background: rgba(250, 250, 250, 1); border-radius: 5px"></code></pre>
<ol start="2" data-tool="mdnice编辑器" style="margin-top: 8px; margin-bottom: 8px; padding-left: 25px; color: rgba(0, 0, 0, 1); list-style-type: decimal">
<li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">在Master上运行该资源；
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">kubectl create -f nginx-deployment.yaml </code></pre>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">检查资源是否创建成功，这里我通过标签选择器进行查看，所以跟-l的参数；
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">kubectl get pods -l app=nginx </code></pre>
<figure style="margin: 10px 0; display: flex; flex-direction: column; justify-content: center; align-items: center"><img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/902670782fcc46349057c2bc2cb8aae9~tplv-k3u1fbpfcp-zoom-1.image"><figcaption style="margin-top: 5px; text-align: center; color: rgba(136, 136, 136, 1); font-size: 14px">image.png</figcaption></figure>
</section></li><li style="margin-bottom: 0.5em"><section style="margin-top: 5px; margin-bottom: 5px; line-height: 26px; text-align: left; color: rgba(1, 1, 1, 1); font-weight: 500">查看Pod的整个详情;
<pre class="custom" style="margin-top: 10px; margin-bottom: 10px; border-radius: 5px; box-shadow: 0 2px 10px rgba(0, 0, 0, 0.55)"><span style="display: block; background: url("https://files.mdnice.com/user/3441/876cad08-0422-409d-bb5a-08afec5da8ee.svg") 10px 10px / 40px no-repeat rgba(250, 250, 250, 1); height: 30px; width: 100%; margin-bottom: -7px; border-radius: 5px"><code class="hljs" style="overflow-x: auto; -webkit-overflow-scrolling: touch; font-size: 14px; word-wrap: break-word; padding: 15px 4px 2px; margin: 0 2px; color: rgba(30, 107, 184, 1); background: rgba(250, 250, 250, 1); font-family: Operator Mono, Consolas, Monaco, Menlo, monospace; word-break: break-all; border-radius: 5px">#后面跟着具体的pod名称 kubectl describe pod nginx-deployment-7dc45fbd74-5bh2z </code></pre>
<figure style="margin: 10px 0; display: flex; flex-direction: column; justify-content: center; align-items: center"><img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/3f1c7961098143b6bd28d3d2364afc5d~tplv-k3u1fbpfcp-zoom-1.image"><figcaption style="margin-top: 5px; text-align: center; color: rgba(136, 136, 136, 1); font-size: 14px">image.png</figcaption></figure>
</section></li></ol>
<h3 data-tool="mdnice编辑器" style="margin: 30px 0 15px; border-bottom: 2px solid rgba(0, 172, 193, 1); padding: 0; font-weight: bold; color: rgba(0, 0, 0, 1); font-size: 20px"><span class="prefix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"><span class="content" style="display: inline-block; font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px">结束<span class="suffix" style="font-weight: normal; background: rgba(0, 172, 193, 1); color: rgba(255, 255, 255, 1); padding: 3px 10px 0; border-top-right-radius: 3px; border-top-left-radius: 4px; margin-right: 2px; display: none"></h3>
欢迎大家点点关注，点点赞!
<img src="https://img2018.cnblogs.com/blog/1005447/201906/1005447-20190620221533393-1847070636.png">
</section> 
来源：https://www.cnblogs.com/wtzbk/p/15216488.html

頁: [1]

琼殿技术论坛's Archiver

Kubernetes环境搭建