Centos 7.2中双网卡绑定及相关问题踩坑记录
<p><span><strong>前言</strong></span></p>
<p>
最近工作中在做线上服务器，安装centos7.2 x64最小化安装，需要做链路聚合，双网卡绑定。在centos 6.x 和 centos 7上测试都ok，于是直接开搞。</p>
<p>
说明下，以下环境是在虚拟机中实现的：</p>
<p>
系统： centos7.2 x64 最小化安装。</p>
<p>
<img style="max-width:100%!important;height:auto!important;"title="Centos 7.2中双网卡绑定及相关问题踩坑记录" alt="Centos 7.2中双网卡绑定及相关问题踩坑记录" src="https://zhuji.jb51.net/uploads/img/202305/47f6ac0d8d73d6eaecb0de3f94455ce6.jpg"></p>
<p>
为了方便演示，这里共有三张网卡：</p>
<p>
eno16777736 ： 桥接网卡：10.0.0.11/24</p>
<p>
剩下的两张网卡准备做绑定：</p>
<p>
eno33554984</p>
<p>
eno50332208</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_10546">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
<div class="line number22 index21 alt1">
22</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># nmcli con sh </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">name uuid </code><code class="bash functions">type</code> <code class="bash plain">device </code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">wired connection 2 bf0cf9b6-c7fb-4c0a-ada4-abfb650dd5f0 802-3-ethernet -- </code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">wired connection 1 5b4e0b3e-c469-404c-8839-76d18442fc20 802-3-ethernet -- </code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">eno16777736 100e462e-c0d0-4271-9b5a-1c8e47ff0d03 802-3-ethernet eno16777736 </code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain"></code><code class="bash comments"># nmcli con del 5b4e0b3e-c469-404c-8839-76d18442fc20 bf0cf9b6-c7fb-4c0a-ada4-abfb650dd5f0</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">connection </code><code class="bash string">'wired connection 1'</code> <code class="bash plain">(5b4e0b3e-c469-404c-8839-76d18442fc20) successfully deleted.</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">connection </code><code class="bash string">'wired connection 2'</code> <code class="bash plain">(bf0cf9b6-c7fb-4c0a-ada4-abfb650dd5f0) successfully deleted.</code>
</div>
<div class="line number9 index8 alt2">
</div>
<div class="line number10 index9 alt1">
<code class="bash plain"></code><code class="bash comments"># nmcli con add type team ifname team0 con-name team0 config '{"runner":{"name":"roundrobin"}}'</code>
</div>
<div class="line number11 index10 alt2">
<code class="bash plain">connection </code><code class="bash string">'team0'</code> <code class="bash plain">(913f05c2-15d8-49a9-a35f-8bc5ee843c0c) successfully added.</code>
</div>
<div class="line number12 index11 alt1">
<code class="bash plain"></code><code class="bash comments"># nmcli con add type team-slave ifname eno50332208 con-name team0-port2 master team0</code>
</div>
<div class="line number13 index12 alt2">
<code class="bash plain">connection </code><code class="bash string">'team0-port2'</code> <code class="bash plain">(1583854c-1f85-4c76-8cc7-c643071d4b82) successfully added.</code>
</div>
<div class="line number14 index13 alt1">
<code class="bash plain"></code><code class="bash comments"># nmcli con mod team0 ipv4.address "192.168.121.100/24"</code>
</div>
<div class="line number15 index14 alt2">
<code class="bash plain"></code><code class="bash comments"># nmcli con mod team0 ipv4.method manual</code>
</div>
<div class="line number16 index15 alt1">
</div>
<div class="line number17 index16 alt2">
<code class="bash plain"></code><code class="bash comments"># nmcli con sh </code>
</div>
<div class="line number18 index17 alt1">
<code class="bash plain">name uuid </code><code class="bash functions">type</code> <code class="bash plain">device </code>
</div>
<div class="line number19 index18 alt2">
<code class="bash plain">eno16777736 100e462e-c0d0-4271-9b5a-1c8e47ff0d03 802-3-ethernet eno16777736 </code>
</div>
<div class="line number20 index19 alt1">
<code class="bash plain">team0-port2 1583854c-1f85-4c76-8cc7-c643071d4b82 802-3-ethernet -- </code>
</div>
<div class="line number21 index20 alt2">
<code class="bash plain">team0-port1 bfd408b4-76d9-4f5c-ad5b-4d92430eb6ba 802-3-ethernet -- </code>
</div>
<div class="line number22 index21 alt1">
<code class="bash plain">team0 913f05c2-15d8-49a9-a35f-8bc5ee843c0c team --</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
到这里都没毛病。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_761614">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># nmcli con up team0</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">error: connection activation failed: networkmanager plugin </code><code class="bash keyword">for</code> <code class="bash string">'team'</code> <code class="bash plain">unavailable</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
什么鬼？networkmanager "team"插件不可用。于是开始排查。</p>
<p>
是否存在team模块</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_650114">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># lsmod | egrep *team*</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
木有。那直接restart network好了。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_229272">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># systemctl restart network </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">job </code><code class="bash keyword">for</code> <code class="bash plain">network.service failed because the control process exited with error code. see </code><code class="bash string">"systemctl status network.service"</code> <code class="bash plain">and </code><code class="bash string">"journalctl -xe"</code> <code class="bash keyword">for</code> <code class="bash plain">details.</code>
</div>
<div class="line number3 index2 alt2">
</div>
<div class="line number4 index3 alt1">
<code class="bash plain"></code><code class="bash comments"># systemctl status network</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">...</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">mar 25 04:47:56 bogon network: bringing up interface team0: error: connection activation failed: networkmanager plugin </code><code class="bash keyword">for</code> <code class="bash string">'team'</code> <code class="bash plain">unavailable</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">mar 25 04:47:56 bogon network: </code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">...</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
一样的报错，难道什么包没有安装到？</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_288373">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># yum list all | grep networkmanager*</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">networkmanager.x86_64 1:1.0.6-27.el7 @anaconda</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">networkmanager-libnm.x86_64 1:1.0.6-27.el7 @anaconda</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">networkmanager-tui.x86_64 1:1.0.6-27.el7 @anaconda</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">networkmanager-wifi.x86_64 1:1.0.6-27.el7 @anaconda</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">networkmanager-adsl.x86_64 1:1.0.6-27.el7 yum </code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">networkmanager-bluetooth.x86_64 1:1.0.6-27.el7 yum </code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">networkmanager-glib.x86_64 1:1.0.6-27.el7 yum </code>
</div>
<div class="line number9 index8 alt2">
<code class="bash plain">networkmanager-libreswan.x86_64 1.0.6-3.el7 yum </code>
</div>
<div class="line number10 index9 alt1">
<code class="bash plain">networkmanager-libreswan-gnome.x86_64 1.0.6-3.el7 yum </code>
</div>
<div class="line number11 index10 alt2">
<code class="bash plain">networkmanager-team.x86_64 1:1.0.6-27.el7 yum </code>
</div>
<div class="line number12 index11 alt1">
<code class="bash plain">networkmanager-wwan.x86_64 1:1.0.6-27.el7 yum</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
哎哟，还真有个networkmanager-team没有安装叻。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_904235">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># yum install networkmanager-team -y</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
然后再次尝试：</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_815262">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># nmcli con sh </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">name uuid </code><code class="bash functions">type</code> <code class="bash plain">device </code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">eno16777736 100e462e-c0d0-4271-9b5a-1c8e47ff0d03 802-3-ethernet eno16777736 </code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">team0-port2 1583854c-1f85-4c76-8cc7-c643071d4b82 802-3-ethernet -- </code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">team0-port1 bfd408b4-76d9-4f5c-ad5b-4d92430eb6ba 802-3-ethernet -- </code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">team0 913f05c2-15d8-49a9-a35f-8bc5ee843c0c team -- </code>
</div>
<div class="line number7 index6 alt2">
</div>
<div class="line number8 index7 alt1">
<code class="bash plain"></code><code class="bash comments"># nmcli con up team0</code>
</div>
<div class="line number9 index8 alt2">
<code class="bash plain">error: connection activation failed: networkmanager plugin </code><code class="bash keyword">for</code> <code class="bash string">'team'</code> <code class="bash plain">unavailable</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
尼玛，还是同样的错，这就尴尬了。那就重启下networkmanager 在看看。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_799241">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># systemctl restart networkmanager</code>
</div>
<div class="line number2 index1 alt1">
</div>
<div class="line number3 index2 alt2">
<code class="bash plain"></code><code class="bash comments"># nmcli con sh </code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">name uuid </code><code class="bash functions">type</code> <code class="bash plain">device </code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">team0-port2 1583854c-1f85-4c76-8cc7-c643071d4b82 802-3-ethernet eno50332208 </code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">eno16777736 100e462e-c0d0-4271-9b5a-1c8e47ff0d03 802-3-ethernet eno16777736 </code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">team0-port1 bfd408b4-76d9-4f5c-ad5b-4d92430eb6ba 802-3-ethernet eno33554984 </code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">team0 913f05c2-15d8-49a9-a35f-8bc5ee843c0c team team0</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
好了？ what the fuck！赶紧查看是不是roundrobin模式</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_564662">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># teamdctl team0 st</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">setup:</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash spaces"> </code><code class="bash plain">runner: roundrobin</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">ports:</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash spaces"> </code><code class="bash plain">eno33554984</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash spaces"> </code><code class="bash plain">link watches:</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash spaces"> </code><code class="bash plain">link summary: up</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash spaces"> </code><code class="bash plain">instance:</code>
</div>
<div class="line number9 index8 alt2">
<code class="bash spaces"> </code><code class="bash plain">name: </code><code class="bash functions">ethtool</code>
</div>
<div class="line number10 index9 alt1">
<code class="bash spaces"> </code><code class="bash plain">link: up</code>
</div>
<div class="line number11 index10 alt2">
<code class="bash spaces"> </code><code class="bash plain">down count: 0</code>
</div>
<div class="line number12 index11 alt1">
<code class="bash spaces"> </code><code class="bash plain">eno50332208</code>
</div>
<div class="line number13 index12 alt2">
<code class="bash spaces"> </code><code class="bash plain">link watches:</code>
</div>
<div class="line number14 index13 alt1">
<code class="bash spaces"> </code><code class="bash plain">link summary: up</code>
</div>
<div class="line number15 index14 alt2">
<code class="bash spaces"> </code><code class="bash plain">instance:</code>
</div>
<div class="line number16 index15 alt1">
<code class="bash spaces"> </code><code class="bash plain">name: </code><code class="bash functions">ethtool</code>
</div>
<div class="line number17 index16 alt2">
<code class="bash spaces"> </code><code class="bash plain">link: up</code>
</div>
<div class="line number18 index17 alt1">
<code class="bash spaces"> </code><code class="bash plain">down count: 0</code>
</div>
<div class="line number19 index18 alt2">
<code class="bash plain"></code><code class="bash comments"># teamnl team0 ports </code>
</div>
<div class="line number20 index19 alt1">
<code class="bash spaces"> </code><code class="bash plain">4: eno50332208: up 1000mbit fd </code>
</div>
<div class="line number21 index20 alt2">
<code class="bash spaces"> </code><code class="bash plain">3: eno33554984: up 1000mbit fd</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
一切ok，老铁，扎心了。</p>
<p>
接下来测试下roundrobin</p>
<p>
这里说明下：roundrobin这种bind模式：</p>
<p>
先来讲下网卡bind的原理：</p>
<p>
通过将两张或者多张网卡通过软件虚拟出来一张逻辑网卡来传输数据，这里bind的模式有很多种。比如我们上面的这种，就是其中的链路聚合模式。当使用该模式的时候，两张物理网卡和逻辑网卡的mac地址都被设置为一致，大家都知道，我们做链路聚合就是为了让多张物理网卡聚合在一块扩展数据带宽的方式，既然我们在逻辑上是一张网卡，那mac地址也就必须一致对吧。不然我们接到交换机或者路由器上，逻辑网卡一会是物理网卡1的mac地址，一会又是物理网卡2的地址，交换机一会找的到人，一会又找不到人。那数据还怎么传输。</p>
<p>
在链路聚合中，因为是两张物理网卡捆绑的模式，如果其中一张网卡down掉了，整个链路也就瘫了。</p>
<p>
如下：</p>
<p>
<img style="max-width:100%!important;height:auto!important;"title="Centos 7.2中双网卡绑定及相关问题踩坑记录" alt="Centos 7.2中双网卡绑定及相关问题踩坑记录" src="https://zhuji.jb51.net/uploads/img/202305/77bcf686eacbbb1b56124e6022f51c2e.jpg"></p>
<p>
<span><strong>总结</strong></span></p>
<p>
以上就是这篇文章的全部内容了，希望本文的内容对大家的学习或者工作具有一定的参考学习价值，如果有疑问大家可以留言交流，谢谢大家对服务器之家的支持。</p>
<p>
原文链接：http://www.cnblogs.com/hukey/p/6613226.html</p>
頁:
[1]