手把手教你在腾讯云上搭建hive3.1.2的方法
<p><span><strong>环境准备</strong></span></p>
<p>
所有操作开始前,先确定hadoop版本已经装好。具体可以看我的另一篇博客<br>
搭建hadoop3.x</p>
<p>
<span><strong>mysql安装</strong></span></p>
<p>
先把安装包放到software文件夹,并解压到mysql-lib中</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_295058">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
<div class="line number22 index21 alt1">
22</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># ll</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">总用量 1422372</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">-rw-r--r-- 1 root root 312850286 7月 2 15:00 apache-hive-3.1.2-bin.</code><code class="bash functions">tar</code><code class="bash plain">.gz</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">-rw-r--r-- 1 root root 338075860 7月 2 09:39 hadoop-3.1.3.</code><code class="bash functions">tar</code><code class="bash plain">.gz</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">-rw-r--r-- 1 root root 195013152 7月 2 09:36 jdk-8u212-linux-x64.</code><code class="bash functions">tar</code><code class="bash plain">.gz</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">-rw-r--r-- 1 root root 609556480 7月 2 15:08 mysql-5.7.28-1.el7.x86_64.rpm-bundle.</code><code class="bash functions">tar</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">-rw-r--r-- 1 root root 985600 7月 2 14:44 mysql-connector-java-5.1.37.jar</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain"></code><code class="bash comments"># mkdir mysql-lib</code>
</div>
<div class="line number9 index8 alt2">
<code class="bash plain"></code><code class="bash comments"># tar -xf mysql-5.7.28-1.el7.x86_64.rpm-bundle.tar -C ./mysql-lib/</code>
</div>
<div class="line number10 index9 alt1">
<code class="bash plain"></code><code class="bash comments"># cd mysql-lib/</code>
</div>
<div class="line number11 index10 alt2">
<code class="bash plain"></code><code class="bash comments"># ll</code>
</div>
<div class="line number12 index11 alt1">
<code class="bash plain">总用量 595272</code>
</div>
<div class="line number13 index12 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 45109364 9月 30 2019 mysql-community-client-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number14 index13 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 318768 9月 30 2019 mysql-community-common-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number15 index14 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 7037096 9月 30 2019 mysql-community-devel-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number16 index15 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 49329100 9月 30 2019 mysql-community-embedded-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number17 index16 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 23354908 9月 30 2019 mysql-community-embedded-compat-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number18 index17 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 136837816 9月 30 2019 mysql-community-embedded-devel-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number19 index18 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 4374364 9月 30 2019 mysql-community-libs-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number20 index19 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 1353312 9月 30 2019 mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number21 index20 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 208694824 9月 30 2019 mysql-community-server-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number22 index21 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 133129992 9月 30 2019 mysql-community-</code><code class="bash functions">test</code><code class="bash plain">-5.7.28-1.el7.x86_64.rpm</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
先处理一下环境,因为centos自带mariadb,会产生冲突,所以要先卸载</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_900701">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># rpm -qa|grep mariadb</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">mariadb-libs-5.5.56-2.el7.x86_64</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain"></code><code class="bash comments"># sudo rpm -e --nodeps mariadb-libs </code>
</div>
<div class="line number4 index3 alt1">
<code class="bash comments"># 查看一下是不是卸载干净了</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain"></code><code class="bash comments"># rpm -qa|grep mariadb</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain"></code><code class="bash comments"># rpm -qa|grep mysql</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
没什么问题了就可以安装了,一定要按顺序安装</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_540843">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
<div class="line number22 index21 alt1">
22</div>
<div class="line number23 index22 alt2">
23</div>
<div class="line number24 index23 alt1">
24</div>
<div class="line number25 index24 alt2">
25</div>
<div class="line number26 index25 alt1">
26</div>
<div class="line number27 index26 alt2">
27</div>
<div class="line number28 index27 alt1">
28</div>
<div class="line number29 index28 alt2">
29</div>
<div class="line number30 index29 alt1">
30</div>
<div class="line number31 index30 alt2">
31</div>
<div class="line number32 index31 alt1">
32</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># ll</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">总用量 595284</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 45109364 9月 30 2019 mysql-community-client-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 318768 9月 30 2019 mysql-community-common-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 7037096 9月 30 2019 mysql-community-devel-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 49329100 9月 30 2019 mysql-community-embedded-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 23354908 9月 30 2019 mysql-community-embedded-compat-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 136837816 9月 30 2019 mysql-community-embedded-devel-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number9 index8 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 4374364 9月 30 2019 mysql-community-libs-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number10 index9 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 1353312 9月 30 2019 mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number11 index10 alt2">
<code class="bash plain">-rw-r--r-- 1 7155 31415 208694824 9月 30 2019 mysql-community-server-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number12 index11 alt1">
<code class="bash plain">-rw-r--r-- 1 7155 31415 133129992 9月 30 2019 mysql-community-</code><code class="bash functions">test</code><code class="bash plain">-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number13 index12 alt2">
<code class="bash plain"></code><code class="bash comments"># sudo rpm -ivh mysql-community-common-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number14 index13 alt1">
<code class="bash plain">警告:mysql-community-common-5.7.28-1.el7.x86_64.rpm: 头V3 DSA</code><code class="bash plain">/SHA1</code> <code class="bash plain">Signature, 密钥 ID 5072e1f5: NOKEY</code>
</div>
<div class="line number15 index14 alt2">
<code class="bash plain">准备中... </code><code class="bash comments">################################# </code>
</div>
<div class="line number16 index15 alt1">
<code class="bash plain">正在升级/安装...</code>
</div>
<div class="line number17 index16 alt2">
<code class="bash spaces"> </code><code class="bash plain">1:mysql-community-common-5.7.28-1.e</code><code class="bash comments">################################# </code>
</div>
<div class="line number18 index17 alt1">
<code class="bash plain"></code><code class="bash comments"># sudo rpm -ivh mysql-community-libs-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number19 index18 alt2">
<code class="bash plain">警告:mysql-community-libs-5.7.28-1.el7.x86_64.rpm: 头V3 DSA</code><code class="bash plain">/SHA1</code> <code class="bash plain">Signature, 密钥 ID 5072e1f5: NOKEY</code>
</div>
<div class="line number20 index19 alt1">
<code class="bash plain">准备中... </code><code class="bash comments">################################# </code>
</div>
<div class="line number21 index20 alt2">
<code class="bash plain">正在升级/安装...</code>
</div>
<div class="line number22 index21 alt1">
<code class="bash spaces"> </code><code class="bash plain">1:mysql-community-libs-5.7.28-1.el7</code><code class="bash comments">################################# </code>
</div>
<div class="line number23 index22 alt2">
<code class="bash plain"></code><code class="bash comments"># sudo rpm -ivh mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number24 index23 alt1">
<code class="bash plain">警告:mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm: 头V3 DSA</code><code class="bash plain">/SHA1</code> <code class="bash plain">Signature, 密钥 ID 5072e1f5: NOKEY</code>
</div>
<div class="line number25 index24 alt2">
<code class="bash plain">准备中... </code><code class="bash comments">################################# </code>
</div>
<div class="line number26 index25 alt1">
<code class="bash plain">正在升级/安装...</code>
</div>
<div class="line number27 index26 alt2">
<code class="bash spaces"> </code><code class="bash plain">1:mysql-community-libs-compat-5.7.2</code><code class="bash comments">################################# </code>
</div>
<div class="line number28 index27 alt1">
<code class="bash plain"></code><code class="bash comments"># sudo rpm -ivh mysql-community-client-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number29 index28 alt2">
<code class="bash plain">警告:mysql-community-client-5.7.28-1.el7.x86_64.rpm: 头V3 DSA</code><code class="bash plain">/SHA1</code> <code class="bash plain">Signature, 密钥 ID 5072e1f5: NOKEY</code>
</div>
<div class="line number30 index29 alt1">
<code class="bash plain">准备中... </code><code class="bash comments">################################# </code>
</div>
<div class="line number31 index30 alt2">
<code class="bash plain">正在升级/安装...</code>
</div>
<div class="line number32 index31 alt1">
<code class="bash spaces"> </code><code class="bash plain">1:mysql-community-client-5.7.28-1.e</code><code class="bash comments">################################# </code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
安装到第5个时,如果centos是最小化安装的,那会报这个问题</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_434826">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># sudo rpm -ivh mysql-community-server-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">警告:mysql-community-server-5.7.28-1.el7.x86_64.rpm: 头V3 DSA</code><code class="bash plain">/SHA1</code> <code class="bash plain">Signature, 密钥 ID 5072e1f5: NOKEY</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">错误:依赖检测失败:</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash spaces"> </code><code class="bash plain">libnuma.so.1()(64bit) 被 mysql-community-server-5.7.28-1.el7.x86_64 需要</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash spaces"> </code><code class="bash plain">libnuma.so.1(libnuma_1.1)(64bit) 被 mysql-community-server-5.7.28-1.el7.x86_64 需要</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash spaces"> </code><code class="bash plain">libnuma.so.1(libnuma_1.2)(64bit) 被 mysql-community-server-5.7.28-1.el7.x86_64 需要</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_921689">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># yum install -y libaio</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain"></code><code class="bash comments"># yum install -y numactl</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
然后再尝试安装就没问题了</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_661762">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># sudo rpm -ivh mysql-community-server-5.7.28-1.el7.x86_64.rpm</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">警告:mysql-community-server-5.7.28-1.el7.x86_64.rpm: 头V3 DSA</code><code class="bash plain">/SHA1</code> <code class="bash plain">Signature, 密钥 ID 5072e1f5: NOKEY</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">准备中... </code><code class="bash comments">################################# </code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">正在升级/安装...</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash spaces"> </code><code class="bash plain">1:mysql-community-server-5.7.28-1.e</code><code class="bash comments">################################# </code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
清理历史残余文件</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_775085">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
<div class="line number22 index21 alt1">
22</div>
<div class="line number23 index22 alt2">
23</div>
<div class="line number24 index23 alt1">
24</div>
<div class="line number25 index24 alt2">
25</div>
<div class="line number26 index25 alt1">
26</div>
<div class="line number27 index26 alt2">
27</div>
<div class="line number28 index27 alt1">
28</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># cat /etc/my.cnf</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash comments"># For advice on how to change settings please see</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash comments"># http://dev.mysql.com/doc/refman/5.7/en/server-configuration-defaults.html</code>
</div>
<div class="line number4 index3 alt1">
</div>
<div class="line number5 index4 alt2">
<code class="bash plain"></code>
</div>
<div class="line number6 index5 alt1">
<code class="bash comments">#</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash comments"># Remove leading # and set to the amount of RAM for the most important data</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash comments"># cache in MySQL. Start at 70% of total RAM for dedicated server, else 10%.</code>
</div>
<div class="line number9 index8 alt2">
<code class="bash comments"># innodb_buffer_pool_size = 128M</code>
</div>
<div class="line number10 index9 alt1">
<code class="bash comments">#</code>
</div>
<div class="line number11 index10 alt2">
<code class="bash comments"># Remove leading # to turn on a very important data integrity option: logging</code>
</div>
<div class="line number12 index11 alt1">
<code class="bash comments"># changes to the binary log between backups.</code>
</div>
<div class="line number13 index12 alt2">
<code class="bash comments"># log_bin</code>
</div>
<div class="line number14 index13 alt1">
<code class="bash comments">#</code>
</div>
<div class="line number15 index14 alt2">
<code class="bash comments"># Remove leading # to set options mainly useful for reporting servers.</code>
</div>
<div class="line number16 index15 alt1">
<code class="bash comments"># The server defaults are faster for transactions and fast SELECTs.</code>
</div>
<div class="line number17 index16 alt2">
<code class="bash comments"># Adjust sizes as needed, experiment to find the optimal values.</code>
</div>
<div class="line number18 index17 alt1">
<code class="bash comments"># join_buffer_size = 128M</code>
</div>
<div class="line number19 index18 alt2">
<code class="bash comments"># sort_buffer_size = 2M</code>
</div>
<div class="line number20 index19 alt1">
<code class="bash comments"># read_rnd_buffer_size = 2M</code>
</div>
<div class="line number21 index20 alt2">
<code class="bash plain">datadir=</code><code class="bash plain">/var/lib/mysql</code>
</div>
<div class="line number22 index21 alt1">
<code class="bash plain">socket=</code><code class="bash plain">/var/lib/mysql/mysql</code><code class="bash plain">.sock</code>
</div>
<div class="line number23 index22 alt2">
</div>
<div class="line number24 index23 alt1">
<code class="bash comments"># Disabling symbolic-links is recommended to prevent assorted security risks</code>
</div>
<div class="line number25 index24 alt2">
<code class="bash plain">symbolic-links=0</code>
</div>
<div class="line number26 index25 alt1">
</div>
<div class="line number27 index26 alt2">
<code class="bash plain">log-error=</code><code class="bash plain">/var/log/mysqld</code><code class="bash plain">.log</code>
</div>
<div class="line number28 index27 alt1">
<code class="bash plain">pid-</code><code class="bash functions">file</code><code class="bash plain">=</code><code class="bash plain">/var/run/mysqld/mysqld</code><code class="bash plain">.pid</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
看到了mysql目录是<code>/var/lib/mysql</code></p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_588011">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash comments">#进入这个地址 看看是否有历史残余文件</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain"></code><code class="bash comments"># cd /var/lib/mysql</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash comments"># 没东西就没问题,有就都删了</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain"></code><code class="bash comments"># ll</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">总用量 0</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
<span><strong>初始化mysql</strong></span></p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_67409">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># sudo mysqld --initialize --user=mysql</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
看下默认密码</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_858781">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># cat /var/log/mysqld.log </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">2020-07-02T07:29:10.095244Z 0 TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation </code><code class="bash keyword">for</code> <code class="bash functions">more</code> <code class="bash plain">details).</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">2020-07-02T07:29:11.331738Z 0 InnoDB: New log files created, LSN=45790</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">2020-07-02T07:29:11.498492Z 0 InnoDB: Creating foreign key constraint system tables.</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">2020-07-02T07:29:11.590436Z 0 No existing UUID has been found, so we assume that this is the first </code><code class="bash functions">time</code> <code class="bash plain">that this server has been started. Generating a new UUID: b94654a6-bc35-11ea-a160-525400f3e388.</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">2020-07-02T07:29:11.600554Z 0 Gtid table is not ready to be used. Table </code><code class="bash string">'mysql.gtid_executed'</code> <code class="bash plain">cannot be opened.</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">2020-07-02T07:29:13.093996Z 0 CA certificate ca.pem is self signed.</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">2020-07-02T07:29:13.522160Z 1 A temporary password is generated </code><code class="bash keyword">for</code> <code class="bash plain">root@localhost: p;oK<M)<_8p/</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
密码是<code>p;oK<M)<_8p/</code>,复制一下,进入mysql</p>
<p>
<strong>进入mysql</strong></p>
<p>
启动mysql服务</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_862756">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># systemctl start mysqld</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain"></code><code class="bash comments"># systemctl status mysqld</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">● mysqld.service - MySQL Server</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash spaces"> </code><code class="bash plain">Loaded: loaded (</code><code class="bash plain">/usr/lib/systemd/system/mysqld</code><code class="bash plain">.service; enabled; vendor preset: disabled)</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash spaces"> </code><code class="bash plain">Active: active (running) since 四 2020-07-02 15:31:00 CST; 10s ago</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash spaces"> </code><code class="bash plain">Docs: </code><code class="bash functions">man</code><code class="bash plain">:mysqld(8)</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash spaces"> </code><code class="bash plain">http:</code><code class="bash plain">//dev</code><code class="bash plain">.mysql.com</code><code class="bash plain">/doc/refman/en/using-systemd</code><code class="bash plain">.html</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash spaces"> </code><code class="bash plain">Process: 5617 ExecStart=</code><code class="bash plain">/usr/sbin/mysqld</code> <code class="bash plain">--daemonize --pid-</code><code class="bash functions">file</code><code class="bash plain">=</code><code class="bash plain">/var/run/mysqld/mysqld</code><code class="bash plain">.pid $MYSQLD_OPTS (code=exited, status=0</code><code class="bash plain">/SUCCESS</code><code class="bash plain">)</code>
</div>
<div class="line number9 index8 alt2">
<code class="bash spaces"> </code><code class="bash plain">Process: 5497 ExecStartPre=</code><code class="bash plain">/usr/bin/mysqld_pre_systemd</code> <code class="bash plain">(code=exited, status=0</code><code class="bash plain">/SUCCESS</code><code class="bash plain">)</code>
</div>
<div class="line number10 index9 alt1">
<code class="bash spaces"> </code><code class="bash plain">Main PID: 5624 (mysqld)</code>
</div>
<div class="line number11 index10 alt2">
<code class="bash spaces"> </code><code class="bash plain">Tasks: 27</code>
</div>
<div class="line number12 index11 alt1">
<code class="bash spaces"> </code><code class="bash plain">Memory: 205.4M</code>
</div>
<div class="line number13 index12 alt2">
<code class="bash spaces"> </code><code class="bash plain">CGroup: </code><code class="bash plain">/system</code><code class="bash plain">.slice</code><code class="bash plain">/mysqld</code><code class="bash plain">.service</code>
</div>
<div class="line number14 index13 alt1">
<code class="bash spaces"> </code><code class="bash plain">└─5624 </code><code class="bash plain">/usr/sbin/mysqld</code> <code class="bash plain">--daemonize --pid-</code><code class="bash functions">file</code><code class="bash plain">=</code><code class="bash plain">/var/run/mysqld/mysqld</code><code class="bash plain">.p...</code>
</div>
<div class="line number15 index14 alt2">
</div>
<div class="line number16 index15 alt1">
<code class="bash plain">7月 02 15:30:55 master systemd: Starting MySQL Server...</code>
</div>
<div class="line number17 index16 alt2">
<code class="bash plain">7月 02 15:31:00 master systemd: Started MySQL Server.</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
进入mysql</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_354212">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">$ mysql -u root -p</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
提示输入密码,输入刚刚复制的密码</p>
<p>
<img title="手把手教你在腾讯云上搭建hive3.1.2的方法" alt="手把手教你在腾讯云上搭建hive3.1.2的方法" src="https://zhuji.jb51.net/uploads/img/202305/1481032cafb93f9e40a07be8da24fb34.jpg"></p>
<p>
成功进入mysql后,设置我们的mysql密码,这个自己记住哈~</p>
<div class="jb51code">
<div>
<div class="syntaxhighlightersql" id="highlighter_723623">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="sql plain">#设置密码为你的密码</code>
</div>
<div class="line number2 index1 alt1">
<code class="sql plain">mysql> </code><code class="sql keyword">set</code> <code class="sql keyword">password</code> <code class="sql plain">= </code><code class="sql keyword">password</code><code class="sql plain">(</code><code class="sql string">"你的密码"</code><code class="sql plain">);</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
接下来设置root用户的权限,允许任意ip连接,为后面的hive连接做准备</p>
<div class="jb51code">
<div>
<div class="syntaxhighlightersql" id="highlighter_568188">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
<div class="line number22 index21 alt1">
22</div>
<div class="line number23 index22 alt2">
23</div>
<div class="line number24 index23 alt1">
24</div>
<div class="line number25 index24 alt2">
25</div>
<div class="line number26 index25 alt1">
26</div>
<div class="line number27 index26 alt2">
27</div>
<div class="line number28 index27 alt1">
28</div>
<div class="line number29 index28 alt2">
29</div>
<div class="line number30 index29 alt1">
30</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="sql plain">mysql> use mysql;</code>
</div>
<div class="line number2 index1 alt1">
<code class="sql plain">mysql> </code><code class="sql keyword">select</code> <code class="sql plain">host,</code><code class="sql color2">user</code> <code class="sql keyword">from</code> <code class="sql color2">user</code><code class="sql plain">;</code>
</div>
<div class="line number3 index2 alt2">
<code class="sql plain">+</code><code class="sql comments">-----------+---------------+</code>
</div>
<div class="line number4 index3 alt1">
<code class="sql plain">| host | </code><code class="sql color2">user</code> <code class="sql plain">|</code>
</div>
<div class="line number5 index4 alt2">
<code class="sql plain">+</code><code class="sql comments">-----------+---------------+</code>
</div>
<div class="line number6 index5 alt1">
<code class="sql plain">| localhost | mysql.session |</code>
</div>
<div class="line number7 index6 alt2">
<code class="sql plain">| localhost | mysql.sys |</code>
</div>
<div class="line number8 index7 alt1">
<code class="sql plain">| localhost | root |</code>
</div>
<div class="line number9 index8 alt2">
<code class="sql plain">+</code><code class="sql comments">-----------+---------------+</code>
</div>
<div class="line number10 index9 alt1">
<code class="sql plain">3 </code><code class="sql keyword">rows</code> <code class="sql color1">in</code> <code class="sql keyword">set</code> <code class="sql plain">(0.00 sec)</code>
</div>
<div class="line number11 index10 alt2">
</div>
<div class="line number12 index11 alt1">
<code class="sql plain">mysql> </code><code class="sql keyword">update</code> <code class="sql plain">mysql.</code><code class="sql color2">user</code> <code class="sql keyword">set</code> <code class="sql plain">host=</code><code class="sql string">'%'</code> <code class="sql keyword">where</code> <code class="sql color2">user</code><code class="sql plain">=</code><code class="sql string">'root'</code><code class="sql plain">;</code>
</div>
<div class="line number13 index12 alt2">
<code class="sql plain">Query OK, 1 row affected (0.00 sec)</code>
</div>
<div class="line number14 index13 alt1">
<code class="sql keyword">Rows</code> <code class="sql plain">matched: 1 Changed: 1 Warnings: 0</code>
</div>
<div class="line number15 index14 alt2">
<code class="sql plain"># 权限高的在最上面(新版本优化的)</code>
</div>
<div class="line number16 index15 alt1">
<code class="sql plain">mysql> </code><code class="sql keyword">select</code> <code class="sql plain">host,</code><code class="sql color2">user</code> <code class="sql keyword">from</code> <code class="sql color2">user</code><code class="sql plain">;</code>
</div>
<div class="line number17 index16 alt2">
<code class="sql plain">+</code><code class="sql comments">-----------+---------------+</code>
</div>
<div class="line number18 index17 alt1">
<code class="sql plain">| host | </code><code class="sql color2">user</code> <code class="sql plain">|</code>
</div>
<div class="line number19 index18 alt2">
<code class="sql plain">+</code><code class="sql comments">-----------+---------------+</code>
</div>
<div class="line number20 index19 alt1">
<code class="sql plain">| % | root |</code>
</div>
<div class="line number21 index20 alt2">
<code class="sql plain">| localhost | mysql.session |</code>
</div>
<div class="line number22 index21 alt1">
<code class="sql plain">| localhost | mysql.sys |</code>
</div>
<div class="line number23 index22 alt2">
<code class="sql plain">+</code><code class="sql comments">-----------+---------------+</code>
</div>
<div class="line number24 index23 alt1">
<code class="sql plain">3 </code><code class="sql keyword">rows</code> <code class="sql color1">in</code> <code class="sql keyword">set</code> <code class="sql plain">(0.00 sec)</code>
</div>
<div class="line number25 index24 alt2">
</div>
<div class="line number26 index25 alt1">
<code class="sql comments">--这步一定要做,是刷新配置的,不然密码无法生效</code>
</div>
<div class="line number27 index26 alt2">
<code class="sql plain">mysql> flush </code><code class="sql keyword">privileges</code><code class="sql plain">;</code>
</div>
<div class="line number28 index27 alt1">
<code class="sql plain">Query OK, 0 </code><code class="sql keyword">rows</code> <code class="sql plain">affected (0.00 sec)</code>
</div>
<div class="line number29 index28 alt2">
</div>
<div class="line number30 index29 alt1">
<code class="sql plain">mysql> quit</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
然后再尝试用更改后的密码登录一下,成功了就是配置好了。</p>
<p>
<span><strong>安装Hive</strong></span></p>
<p>
到/home/centos/software目录下,解压apache-hive-3.1.2-bin.tar.gz到/home/centos/module/目录下面</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_504481">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># tar -zxvf apache-hive-3.1.2-bin.tar.gz -C /home/centos/module/</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
进入module文件夹,把文件名改一下</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_718471">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># ll</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">总用量 12</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">drwxr-xr-x 9 root root 4096 7月 2 15:40 apache-hive-3.1.2-bin</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">drwxr-xr-x 11 centos centos 4096 7月 2 11:51 hadoop-3.1.3</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">drwxr-xr-x 7 10 143 4096 4月 2 2019 jdk1.8.0_212</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain"></code><code class="bash comments"># mv apache-hive-3.1.2-bin/ hive</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain"></code><code class="bash comments"># ll</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">总用量 12</code>
</div>
<div class="line number9 index8 alt2">
<code class="bash plain">drwxr-xr-x 11 centos centos 4096 7月 2 11:51 hadoop-3.1.3</code>
</div>
<div class="line number10 index9 alt1">
<code class="bash plain">drwxr-xr-x 9 root root 4096 7月 2 15:40 hive</code>
</div>
<div class="line number11 index10 alt2">
<code class="bash plain">drwxr-xr-x 7 10 143 4096 4月 2 2019 jdk1.8.0_212</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
配置环境变量</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_891680">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># vim /etc/profile.d/my_env.sh </code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_787296">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash comments">#HIVE_HOME</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash functions">export</code> <code class="bash plain">HIVE_HOME=</code><code class="bash plain">/home/centos/module/hive</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash functions">export</code> <code class="bash plain">PATH=$PATH:$HIVE_HOME</code><code class="bash plain">/bin</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
加载环境变量,并验证是否成功</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_543383">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># source /etc/profile</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain"></code><code class="bash comments"># echo $HIVE_HOME</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">/home/centos/module/hive</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
解决日志Jar包冲突</p>
<p>
hadoop和hive之间的log4j版本冲突,要把hive的lib文件夹中的jar包名字改一下,无法启用即可。就直接在文件名后加.bak即可。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_662180">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">$ </code><code class="bash functions">mv</code> <code class="bash plain">log4j-slf4j-impl-2.10.0.jar log4j-slf4j-impl-2.10.0.jar.bak</code>
</div>
<div class="line number2 index1 alt1">
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">$ ll | </code><code class="bash functions">grep</code> <code class="bash plain">log4j</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">-rw-rw-r--. 1 atguigu atguigu 63835 4月 15 00:34 log4j-1.2-api-2.10.0.jar</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">-rw-rw-r--. 1 atguigu atguigu 255485 4月 15 00:24 log4j-api-2.10.0.jar</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">-rw-rw-r--. 1 atguigu atguigu 1597622 4月 15 00:24 log4j-core-2.10.0.jar</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">-rw-rw-r--. 1 atguigu atguigu 24173 4月 15 00:24 log4j-slf4j-impl-2.10.0.jar.bak</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">-rw-rw-r--. 1 atguigu atguigu 32060 4月 15 00:34 log4j-web-2.10.0.jar</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
<span><strong>hive元数据配置到mysql</strong></span></p>
<p>
将MySQL的JDBC驱动拷贝到Hive的lib目录下</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_814543">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># cp /home/centos/software/mysql-connector-java-5.1.37.jar ./</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
看看是否拷贝成功</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_948228">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># ll | grep mysql-con</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">-rw-r--r-- 1 root root 985600 7月 2 15:47 mysql-connector-java-5.1.37.jar</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
<strong>配置metastore到mysql</strong></p>
<p>
在$HIVE_HOME/conf目录下新建hive-site.xml文件,</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_340813">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># vim hive-site.xml</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
有三个值需要你改一下</p>
<ul>
<li>
腾讯云内网ip</li>
<li>
mysql密码</li>
<li>
本机hostname</li>
</ul>
<div class="jb51code">
<div>
<div class="syntaxhighlighterxml" id="highlighter_806735">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
<div class="line number22 index21 alt1">
22</div>
<div class="line number23 index22 alt2">
23</div>
<div class="line number24 index23 alt1">
24</div>
<div class="line number25 index24 alt2">
25</div>
<div class="line number26 index25 alt1">
26</div>
<div class="line number27 index26 alt2">
27</div>
<div class="line number28 index27 alt1">
28</div>
<div class="line number29 index28 alt2">
29</div>
<div class="line number30 index29 alt1">
30</div>
<div class="line number31 index30 alt2">
31</div>
<div class="line number32 index31 alt1">
32</div>
<div class="line number33 index32 alt2">
33</div>
<div class="line number34 index33 alt1">
34</div>
<div class="line number35 index34 alt2">
35</div>
<div class="line number36 index35 alt1">
36</div>
<div class="line number37 index36 alt2">
37</div>
<div class="line number38 index37 alt1">
38</div>
<div class="line number39 index38 alt2">
39</div>
<div class="line number40 index39 alt1">
40</div>
<div class="line number41 index40 alt2">
41</div>
<div class="line number42 index41 alt1">
42</div>
<div class="line number43 index42 alt2">
43</div>
<div class="line number44 index43 alt1">
44</div>
<div class="line number45 index44 alt2">
45</div>
<div class="line number46 index45 alt1">
46</div>
<div class="line number47 index46 alt2">
47</div>
<div class="line number48 index47 alt1">
48</div>
<div class="line number49 index48 alt2">
49</div>
<div class="line number50 index49 alt1">
50</div>
<div class="line number51 index50 alt2">
51</div>
<div class="line number52 index51 alt1">
52</div>
<div class="line number53 index52 alt2">
53</div>
<div class="line number54 index53 alt1">
54</div>
<div class="line number55 index54 alt2">
55</div>
<div class="line number56 index55 alt1">
56</div>
<div class="line number57 index56 alt2">
57</div>
<div class="line number58 index57 alt1">
58</div>
<div class="line number59 index58 alt2">
59</div>
<div class="line number60 index59 alt1">
60</div>
<div class="line number61 index60 alt2">
61</div>
<div class="line number62 index61 alt1">
62</div>
<div class="line number63 index62 alt2">
63</div>
<div class="line number64 index63 alt1">
64</div>
<div class="line number65 index64 alt2">
65</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="xml plain"><?</code><code class="xml keyword">xml</code> <code class="xml color1">version</code><code class="xml plain">=</code><code class="xml string">"1.0"</code><code class="xml plain">?></code>
</div>
<div class="line number2 index1 alt1">
<code class="xml plain"><?</code><code class="xml keyword">xml-stylesheet</code> <code class="xml color1">type</code><code class="xml plain">=</code><code class="xml string">"text/xsl"</code> <code class="xml color1">href</code><code class="xml plain">=</code><code class="xml string">"configuration.xsl"</code> <code class="xml color1">rel</code><code class="xml plain">=</code><code class="xml string">"external nofollow"</code> <code class="xml plain">?></code>
</div>
<div class="line number3 index2 alt2">
<code class="xml plain"><</code><code class="xml keyword">configuration</code><code class="xml plain">></code>
</div>
<div class="line number4 index3 alt1">
<code class="xml spaces"> </code><code class="xml comments"><!-- jdbc连接的URL --></code>
</div>
<div class="line number5 index4 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number6 index5 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>javax.jdo.option.ConnectionURL</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number7 index6 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>jdbc:mysql://腾讯云内网ip:3306/metastore?useSSL=false</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number8 index7 alt1">
<code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number9 index8 alt2">
</div>
<div class="line number10 index9 alt1">
<code class="xml spaces"> </code><code class="xml comments"><!-- jdbc连接的Driver--></code>
</div>
<div class="line number11 index10 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number12 index11 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>javax.jdo.option.ConnectionDriverName</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number13 index12 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>com.mysql.jdbc.Driver</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number14 index13 alt1">
<code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number15 index14 alt2">
</div>
<div class="line number16 index15 alt1">
<code class="xml spaces"> </code><code class="xml comments"><!-- jdbc连接的username--></code>
</div>
<div class="line number17 index16 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number18 index17 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>javax.jdo.option.ConnectionUserName</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number19 index18 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>root</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number20 index19 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number21 index20 alt2">
</div>
<div class="line number22 index21 alt1">
<code class="xml spaces"> </code><code class="xml comments"><!-- jdbc连接的password --></code>
</div>
<div class="line number23 index22 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number24 index23 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>javax.jdo.option.ConnectionPassword</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number25 index24 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>你的mysql密码</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number26 index25 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number27 index26 alt2">
<code class="xml spaces"> </code><code class="xml comments"><!-- Hive默认在HDFS的工作目录 --></code>
</div>
<div class="line number28 index27 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number29 index28 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>hive.metastore.warehouse.dir</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number30 index29 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>/user/hive/warehouse</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number31 index30 alt2">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number32 index31 alt1">
<code class="xml spaces"> </code>
</div>
<div class="line number33 index32 alt2">
<code class="xml spaces"> </code><code class="xml comments"><!-- Hive元数据存储版本的验证 --></code>
</div>
<div class="line number34 index33 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number35 index34 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>hive.metastore.schema.verification</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number36 index35 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>false</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number37 index36 alt2">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number38 index37 alt1">
<code class="xml spaces"> </code><code class="xml comments"><!-- 指定存储元数据要连接的地址 --></code>
</div>
<div class="line number39 index38 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number40 index39 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>hive.metastore.uris</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number41 index40 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>thrift://腾讯云内网ip:9083</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number42 index41 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number43 index42 alt2">
<code class="xml spaces"> </code><code class="xml comments"><!-- 指定hiveserver2连接的端口号 --></code>
</div>
<div class="line number44 index43 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number45 index44 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>hive.server2.thrift.port</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number46 index45 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>10000</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number47 index46 alt2">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number48 index47 alt1">
<code class="xml spaces"> </code><code class="xml comments"><!-- 指定hiveserver2连接的host --></code>
</div>
<div class="line number49 index48 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number50 index49 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>hive.server2.thrift.bind.host</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number51 index50 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>你本机的hostname</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number52 index51 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number53 index52 alt2">
<code class="xml spaces"> </code><code class="xml comments"><!-- 元数据存储授权 --></code>
</div>
<div class="line number54 index53 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number55 index54 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>hive.metastore.event.db.notification.api.auth</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number56 index55 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>false</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number57 index56 alt2">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number58 index57 alt1">
<code class="xml spaces"> </code>
</div>
<div class="line number59 index58 alt2">
<code class="xml spaces"> </code><code class="xml comments"><!-- hiveserver2的高可用参数,开启此参数可以提高hiveserver2的启动速度 --></code>
</div>
<div class="line number60 index59 alt1">
<code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number61 index60 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>hive.server2.active.passive.ha.enable</</code><code class="xml keyword">name</code><code class="xml plain">></code>
</div>
<div class="line number62 index61 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>true</</code><code class="xml keyword">value</code><code class="xml plain">></code>
</div>
<div class="line number63 index62 alt2">
<code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">></code>
</div>
<div class="line number64 index63 alt1">
</div>
<div class="line number65 index64 alt2">
<code class="xml plain"></</code><code class="xml keyword">configuration</code><code class="xml plain">></code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
把改好的内容粘进去后,保存退出</p>
<p>
<span><strong>启动hive</strong></span></p>
<p>
<strong>初始化元数据库</strong></p>
<p>
登录mysql,创建hive元数据库</p>
<div class="jb51code">
<div>
<div class="syntaxhighlightersql" id="highlighter_509958">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="sql plain">mysql> </code><code class="sql keyword">create</code> <code class="sql keyword">database</code> <code class="sql plain">metastore;</code>
</div>
<div class="line number2 index1 alt1">
<code class="sql plain">Query OK, 1 row affected (0.00 sec)</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
退出,初始化hive元数据库</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_537238">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash comments"># 让hive在metastore中创建初始化的表</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">$ schematool -initSchema -dbType mysql -verbos</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
再次进入mysql,检查一下,可以看到已经创建好了(有74张表)</p>
<div class="jb51code">
<div>
<div class="syntaxhighlightersql" id="highlighter_499477">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="sql plain">mysql> use metastore;</code>
</div>
<div class="line number2 index1 alt1">
<code class="sql plain">mysql> show tables;</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
创建一个启动脚本,不然每次写那么长让它后台启动实在太烦了。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_945341">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># vim hs.sh</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
添加如下内容</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_387103">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
<div class="line number22 index21 alt1">
22</div>
<div class="line number23 index22 alt2">
23</div>
<div class="line number24 index23 alt1">
24</div>
<div class="line number25 index24 alt2">
25</div>
<div class="line number26 index25 alt1">
26</div>
<div class="line number27 index26 alt2">
27</div>
<div class="line number28 index27 alt1">
28</div>
<div class="line number29 index28 alt2">
29</div>
<div class="line number30 index29 alt1">
30</div>
<div class="line number31 index30 alt2">
31</div>
<div class="line number32 index31 alt1">
32</div>
<div class="line number33 index32 alt2">
33</div>
<div class="line number34 index33 alt1">
34</div>
<div class="line number35 index34 alt2">
35</div>
<div class="line number36 index35 alt1">
36</div>
<div class="line number37 index36 alt2">
37</div>
<div class="line number38 index37 alt1">
38</div>
<div class="line number39 index38 alt2">
39</div>
<div class="line number40 index39 alt1">
40</div>
<div class="line number41 index40 alt2">
41</div>
<div class="line number42 index41 alt1">
42</div>
<div class="line number43 index42 alt2">
43</div>
<div class="line number44 index43 alt1">
44</div>
<div class="line number45 index44 alt2">
45</div>
<div class="line number46 index45 alt1">
46</div>
<div class="line number47 index46 alt2">
47</div>
<div class="line number48 index47 alt1">
48</div>
<div class="line number49 index48 alt2">
49</div>
<div class="line number50 index49 alt1">
50</div>
<div class="line number51 index50 alt2">
51</div>
<div class="line number52 index51 alt1">
52</div>
<div class="line number53 index52 alt2">
53</div>
<div class="line number54 index53 alt1">
54</div>
<div class="line number55 index54 alt2">
55</div>
<div class="line number56 index55 alt1">
56</div>
<div class="line number57 index56 alt2">
57</div>
<div class="line number58 index57 alt1">
58</div>
<div class="line number59 index58 alt2">
59</div>
<div class="line number60 index59 alt1">
60</div>
<div class="line number61 index60 alt2">
61</div>
<div class="line number62 index61 alt1">
62</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash preprocessor bold">#!/bin/bash</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">HIVE_LOG_DIR=$HIVE_HOME</code><code class="bash plain">/logs</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash comments">#判断有没有这个目录,没有就创建</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash keyword">if</code> <code class="bash plain">[ ! -d $HIVE_LOG_DIR ]</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash keyword">then</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash spaces"> </code><code class="bash functions">mkdir</code> <code class="bash plain">-p $HIVE_LOG_DIR</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash keyword">fi</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash comments">#检查进程是否运行正常,参数1为进程名,参数2为进程端口</code>
</div>
<div class="line number9 index8 alt2">
<code class="bash comments">#status</code>
</div>
<div class="line number10 index9 alt1">
<code class="bash keyword">function</code> <code class="bash plain">check_process()</code>
</div>
<div class="line number11 index10 alt2">
<code class="bash plain">{</code>
</div>
<div class="line number12 index11 alt1">
<code class="bash spaces"> </code><code class="bash comments">#/dev/null 黑洞 不要的流都放到这里销毁</code>
</div>
<div class="line number13 index12 alt2">
<code class="bash spaces"> </code><code class="bash plain">pid=$(</code><code class="bash functions">ps</code> <code class="bash plain">-ef 2></code><code class="bash plain">/dev/null</code> <code class="bash plain">| </code><code class="bash functions">grep</code> <code class="bash plain">-</code><code class="bash functions">v</code> <code class="bash functions">grep</code> <code class="bash plain">| </code><code class="bash functions">grep</code> <code class="bash plain">-i $1 | </code><code class="bash functions">awk</code> <code class="bash string">'{print $2}'</code><code class="bash plain">)</code>
</div>
<div class="line number14 index13 alt1">
<code class="bash spaces"> </code><code class="bash plain">ppid=$(</code><code class="bash functions">netstat</code> <code class="bash plain">-nltp 2></code><code class="bash plain">/dev/null</code> <code class="bash plain">| </code><code class="bash functions">grep</code> <code class="bash plain">$2 | </code><code class="bash functions">awk</code> <code class="bash string">'{print $7}'</code> <code class="bash plain">| </code><code class="bash functions">cut</code> <code class="bash plain">-d </code><code class="bash string">'/'</code> <code class="bash plain">-f 1)</code>
</div>
<div class="line number15 index14 alt2">
<code class="bash spaces"> </code><code class="bash functions">echo</code> <code class="bash plain">$pid</code>
</div>
<div class="line number16 index15 alt1">
<code class="bash spaces"> </code><code class="bash plain">[[ </code><code class="bash string">"$pid"</code> <code class="bash plain">=~ </code><code class="bash string">"$ppid"</code> <code class="bash plain">]] && [ </code><code class="bash string">"$ppid"</code> <code class="bash plain">] && </code><code class="bash keyword">return</code> <code class="bash plain">0 || </code><code class="bash keyword">return</code> <code class="bash plain">1</code>
</div>
<div class="line number17 index16 alt2">
<code class="bash plain">}</code>
</div>
<div class="line number18 index17 alt1">
</div>
<div class="line number19 index18 alt2">
<code class="bash comments">#start</code>
</div>
<div class="line number20 index19 alt1">
<code class="bash keyword">function</code> <code class="bash plain">hive_start()</code>
</div>
<div class="line number21 index20 alt2">
<code class="bash plain">{</code>
</div>
<div class="line number22 index21 alt1">
<code class="bash spaces"> </code><code class="bash plain">metapid=$(check_process HiveMetastore 9083)</code>
</div>
<div class="line number23 index22 alt2">
<code class="bash spaces"> </code><code class="bash comments">#看懂这行即可 ,这行是让服务后台启动的</code>
</div>
<div class="line number24 index23 alt1">
<code class="bash spaces"> </code><code class="bash plain">cmd=</code><code class="bash string">"nohup hive --service metastore >$HIVE_LOG_DIR/metastore.log 2>&1 &"</code>
</div>
<div class="line number25 index24 alt2">
<code class="bash spaces"> </code><code class="bash plain">cmd=$cmd</code><code class="bash string">" sleep 4; hdfs dfsadmin -safemode wait >/dev/null 2>&1"</code>
</div>
<div class="line number26 index25 alt1">
<code class="bash spaces"> </code><code class="bash plain">[ -z </code><code class="bash string">"$metapid"</code> <code class="bash plain">] && </code><code class="bash functions">eval</code> <code class="bash plain">$cmd || </code><code class="bash functions">echo</code> <code class="bash string">"Metastroe服务已启动"</code>
</div>
<div class="line number27 index26 alt2">
<code class="bash spaces"> </code><code class="bash plain">server2pid=$(check_process HiveServer2 10000)</code>
</div>
<div class="line number28 index27 alt1">
<code class="bash spaces"> </code><code class="bash comments">#看懂这行即可 ,这行是让服务后台启动的</code>
</div>
<div class="line number29 index28 alt2">
<code class="bash spaces"> </code><code class="bash plain">cmd=</code><code class="bash string">"nohup hive --service hiveserver2 >$HIVE_LOG_DIR/hiveServer2.log 2>&1 &"</code>
</div>
<div class="line number30 index29 alt1">
<code class="bash spaces"> </code><code class="bash plain">[ -z </code><code class="bash string">"$server2pid"</code> <code class="bash plain">] && </code><code class="bash functions">eval</code> <code class="bash plain">$cmd || </code><code class="bash functions">echo</code> <code class="bash string">"HiveServer2服务已启动"</code>
</div>
<div class="line number31 index30 alt2">
<code class="bash plain">}</code>
</div>
<div class="line number32 index31 alt1">
</div>
<div class="line number33 index32 alt2">
<code class="bash comments">#stop</code>
</div>
<div class="line number34 index33 alt1">
<code class="bash keyword">function</code> <code class="bash plain">hive_stop()</code>
</div>
<div class="line number35 index34 alt2">
<code class="bash plain">{</code>
</div>
<div class="line number36 index35 alt1">
<code class="bash spaces"> </code><code class="bash plain">metapid=$(check_process HiveMetastore 9083)</code>
</div>
<div class="line number37 index36 alt2">
<code class="bash spaces"> </code><code class="bash plain">[ </code><code class="bash string">"$metapid"</code> <code class="bash plain">] && </code><code class="bash functions">kill</code> <code class="bash plain">$metapid || </code><code class="bash functions">echo</code> <code class="bash string">"Metastore服务未启动"</code>
</div>
<div class="line number38 index37 alt1">
<code class="bash spaces"> </code><code class="bash plain">server2pid=$(check_process HiveServer2 10000)</code>
</div>
<div class="line number39 index38 alt2">
<code class="bash spaces"> </code><code class="bash plain">[ </code><code class="bash string">"$server2pid"</code> <code class="bash plain">] && </code><code class="bash functions">kill</code> <code class="bash plain">$server2pid || </code><code class="bash functions">echo</code> <code class="bash string">"HiveServer2服务未启动"</code>
</div>
<div class="line number40 index39 alt1">
<code class="bash plain">}</code>
</div>
<div class="line number41 index40 alt2">
</div>
<div class="line number42 index41 alt1">
<code class="bash keyword">case</code> <code class="bash plain">$1 </code><code class="bash keyword">in</code>
</div>
<div class="line number43 index42 alt2">
<code class="bash string">"start"</code><code class="bash plain">)</code>
</div>
<div class="line number44 index43 alt1">
<code class="bash spaces"> </code><code class="bash plain">hive_start</code>
</div>
<div class="line number45 index44 alt2">
<code class="bash spaces"> </code><code class="bash plain">;;</code>
</div>
<div class="line number46 index45 alt1">
<code class="bash string">"stop"</code><code class="bash plain">)</code>
</div>
<div class="line number47 index46 alt2">
<code class="bash spaces"> </code><code class="bash plain">hive_stop</code>
</div>
<div class="line number48 index47 alt1">
<code class="bash spaces"> </code><code class="bash plain">;;</code>
</div>
<div class="line number49 index48 alt2">
<code class="bash string">"restart"</code><code class="bash plain">)</code>
</div>
<div class="line number50 index49 alt1">
<code class="bash spaces"> </code><code class="bash plain">hive_stop</code>
</div>
<div class="line number51 index50 alt2">
<code class="bash spaces"> </code><code class="bash functions">sleep</code> <code class="bash plain">2</code>
</div>
<div class="line number52 index51 alt1">
<code class="bash spaces"> </code><code class="bash plain">hive_start</code>
</div>
<div class="line number53 index52 alt2">
<code class="bash spaces"> </code><code class="bash plain">;;</code>
</div>
<div class="line number54 index53 alt1">
<code class="bash string">"status"</code><code class="bash plain">)</code>
</div>
<div class="line number55 index54 alt2">
<code class="bash spaces"> </code><code class="bash plain">check_process HiveMetastore 9083 ></code><code class="bash plain">/dev/null</code> <code class="bash plain">&& </code><code class="bash functions">echo</code> <code class="bash string">"Metastore服务运行正常"</code> <code class="bash plain">|| </code><code class="bash functions">echo</code> <code class="bash string">"Metastore服务运行异常"</code>
</div>
<div class="line number56 index55 alt1">
<code class="bash spaces"> </code><code class="bash plain">check_process HiveServer2 10000 ></code><code class="bash plain">/dev/null</code> <code class="bash plain">&& </code><code class="bash functions">echo</code> <code class="bash string">"HiveServer2服务运行正常"</code> <code class="bash plain">|| </code><code class="bash functions">echo</code> <code class="bash string">"HiveServer2服务运行异常"</code>
</div>
<div class="line number57 index56 alt2">
<code class="bash spaces"> </code><code class="bash plain">;;</code>
</div>
<div class="line number58 index57 alt1">
<code class="bash plain">*)</code>
</div>
<div class="line number59 index58 alt2">
<code class="bash spaces"> </code><code class="bash functions">echo</code> <code class="bash plain">Invalid Args!</code>
</div>
<div class="line number60 index59 alt1">
<code class="bash spaces"> </code><code class="bash functions">echo</code> <code class="bash string">'Usage: '</code><code class="bash plain">$(</code><code class="bash functions">basename</code> <code class="bash plain">$0)</code><code class="bash string">' start|stop|restart|status'</code>
</div>
<div class="line number61 index60 alt2">
<code class="bash spaces"> </code><code class="bash plain">;;</code>
</div>
<div class="line number62 index61 alt1">
<code class="bash plain">esac</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
保存退出,给脚本加权限</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_900421">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">$ </code><code class="bash functions">chmod</code> <code class="bash plain">+x hs.sh</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
现在来启动吧(启动前要确认hadoop是已启动,且运行正常的哦)</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_989339">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># hs.sh start</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain"></code><code class="bash comments"># jps</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">32177 SecondaryNameNode</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">514 NodeManager</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">20788 Jps</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">31396 NameNode</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">32652 ResourceManager</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">20253 RunJar</code>
</div>
<div class="line number9 index8 alt2">
<code class="bash plain">31757 DataNode</code>
</div>
<div class="line number10 index9 alt1">
<code class="bash plain">991 JobHistoryServer</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
可以看到启动成功了,我们用脚本来看下状态</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_538805">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># hs.sh status</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">Metastore服务运行异常</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">HiveServer2服务运行异常</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
你会惊奇的发现,居然有一个运行异常,这是怎么回事?其实是因为它启动比较慢,不信你过了两分钟再看</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_61844">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain"></code><code class="bash comments"># hs.sh status</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">Metastore服务运行正常</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">HiveServer2服务运行正常</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
<span><strong>hive jdbc访问</strong></span></p>
<p>
<strong>beeline</strong></p>
<p>
如果你不是用root来搭建的hadoop,那这里根据自己的设置更改</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_641514">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash comments">#必须用root访问,因为jdbc的管理员是root,不然没权限 -n后面是要登录的用户</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">$ beeline -u jdbc:hive2:</code><code class="bash plain">//master</code><code class="bash plain">:10000 -n root</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">Connecting to jdbc:hive2:</code><code class="bash plain">//master</code><code class="bash plain">:10000</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">Connected to: Apache Hive (version 3.1.2)</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">Driver: Hive JDBC (version 3.1.2)</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">Transaction isolation: TRANSACTION_REPEATABLE_READ</code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">Beeline version 3.1.2 by Apache Hive</code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">0: jdbc:hive2:</code><code class="bash plain">//master</code><code class="bash plain">:10000></code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
这样就是成功进入了,退出的话</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_624889">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">0: jdbc:hive2:</code><code class="bash plain">//master</code><code class="bash plain">:10000> !quit</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">Closing: 0: jdbc:hive2:</code><code class="bash plain">//master</code><code class="bash plain">:10000</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
<span><strong>hive命令行</strong></span></p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_723319">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">$ hive</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash comments">#一堆信息</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">hive></code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
这样就是成功进入了,退出的话是<code>quit;</code>接下来就可以玩hive啦!</p>
<p>
<strong>历史记录</strong></p>
<p>
他俩的历史记录都在家目录中</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_207060">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">$ </code><code class="bash functions">cd</code> <code class="bash plain">~</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">$ </code><code class="bash functions">ls</code> <code class="bash plain">-a</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
可以到有一个<code>.hivehistory</code>文件和<code>.beeline</code>文件夹,历史记录会在你quit这个JDBC后写入。</p>
<p>
<strong>hive运行日志配置</strong></p>
<p>
Hive的log默认存放在当前用户名下下,我们把hive本身的运行日志也放到这个logs里,方便以后查看。</p>
<p>
(1)修改<code>$HIVE_HOME/conf/hive-log4j.properties.template</code>文件名称为<code>hive-log4j.properties</code></p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_210974">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">$ </code><code class="bash functions">mv</code> <code class="bash plain">hive-log4j2.properties.template hive-log4j.properties</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">$ vim hive-log4j.properties</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
(2)在hive-log4j.properties文件中修改log存放位置</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterplain" id="highlighter_335321">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="plain plain">property.hive.log.dir=/home/centos/module/hive/logs</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
<img title="手把手教你在腾讯云上搭建hive3.1.2的方法" alt="手把手教你在腾讯云上搭建hive3.1.2的方法" src="https://zhuji.jb51.net/uploads/img/202305/fad00ff0dcdf9397e5c2f116fcde0024.jpg"></p>
<p>
<strong>hive启动jvm堆内存设置</strong></p>
<p>
新版本的hive启动的时候,默认申请的jvm堆内存大小为256M,jvm堆内存申请的太小,导致后期开启本地模式,执行复杂的sql时经常会报错:<code>java.lang.OutOfMemoryError: Java heap space</code>,因此最好提前调整一下<code>HADOOP_HEAPSIZE</code>这个参数。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_962175">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">$ </code><code class="bash functions">cp</code> <code class="bash plain">hive-</code><code class="bash functions">env</code><code class="bash plain">.sh.template hive-</code><code class="bash functions">env</code><code class="bash plain">.sh</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">$ vim hive-</code><code class="bash functions">env</code><code class="bash plain">.sh</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
<div class="codetool" id="codetool">
<div class="code_n">
<textarea></textarea>
</div>
</div>
</div>
<p>
将hive-env.sh其中的参数 <code>export HADOOP_HEAPSIZE=1024</code>的注释放开</p>
<p>
<img title="手把手教你在腾讯云上搭建hive3.1.2的方法" alt="手把手教你在腾讯云上搭建hive3.1.2的方法" src="https://zhuji.jb51.net/uploads/img/202305/e849e4e2c36c200fc3a782ab0b32d98c.jpg"></p>
<p>
做完以上所有配置,重启hive。</p>
<p>
<span><strong>windows端连接hive</strong></span></p>
<p>
推荐dbeaver,连接前记得来到安全组,开放10000端口</p>
<p>
<img title="手把手教你在腾讯云上搭建hive3.1.2的方法" alt="手把手教你在腾讯云上搭建hive3.1.2的方法" src="https://zhuji.jb51.net/uploads/img/202305/f6253bf0afcb5becd5500a9913bdb355.jpg"></p>
<p>
具体配置步骤如下</p>
<p>
<img title="手把手教你在腾讯云上搭建hive3.1.2的方法" alt="手把手教你在腾讯云上搭建hive3.1.2的方法" src="https://zhuji.jb51.net/uploads/img/202305/5fc38269d1b6deb2de05c8962ba5c049.jpg"></p>
<p>
然后</p>
<p>
<img title="手把手教你在腾讯云上搭建hive3.1.2的方法" alt="手把手教你在腾讯云上搭建hive3.1.2的方法" src="https://zhuji.jb51.net/uploads/img/202305/6f4627b4b9ea606cad31d2bdc32b1e04.jpg"></p>
<p>
测试连接,等个1分钟左右基本上就可以成功了<br>
后面就在Windows上好好玩hive吧~</p>
<p>
到此这篇关于手把手教你在腾讯云上搭建hive3.1.2的方法的文章就介绍到这了,更多相关腾讯云上搭建hive3.1.2内容请搜索服务器之家以前的文章或继续浏览下面的相关文章希望大家以后多多支持服务器之家!</p>
<p>
原文链接:https://blog.csdn.net/axy_shelly/article/details/107087174</p>
頁:
[1]