Centos安装Cloudera Manager 6.3.0和CDH 6.3.2
<h1>前言</h1><p> 闲暇之时，羚羊给大家分享一下羚羊在Centos7 下安装Cloudera Manager 6.3.0和cloudera cdh 6.3.2的过程和安装过程中遇到的坑。至于为什么要选择CDH,Cloudera Manager和cdh是什么，之间又是什么关系，在这里羚羊就不做介绍了。</p>
<p>为什么选择CDH6.3.2这个版本，给大家看个Cloudera公司今年初发布的消息：</p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702132220074-506782714.png" width="800" loading="lazy"></p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702132305161-192709458.png" width="800" loading="lazy"></p>
<p>上面大概是说6.3.3版本以上，需要许可证，有帐号才能下载安装包，意思就是收费。所以羚羊就安装了6.3.2。至于为什么用的是Cloudera Manager 6.3.0，其实没什么问题。Cloudera Manager和CHD之间的版本兼容方面，官方是这么说：</p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702132821657-2004776803.png" width="800" loading="lazy"></p>
<p> 对于Cloudera Manager和CDH，Cloudera公司使用主版本和次版本来管理：主版本+次版本+维护版本，像Cloudera Manager 6.3.0，它的主版本是6，次版本是3，维护版本是0。然后版本兼容规则是这样：<span><span>Cloudera Manager </span></span><var class="keyword varname"><span><span><主要></span></span></var><span><span> + </span></span><var class="keyword varname"><span><span><次要></span></span></var><span><span>版本必须始终等于或大于CDH </span></span><var class="keyword varname"><span><span><主要></span></span></var><span><span> + </span></span><var class="keyword varname"><span><span><次要></span></span></var><span><span>版本。</span><span>较旧版本的Cloudera Manager可能识别不出CDH的高版本安装包来，就是不兼容。当然，最好也不要使用高版本的Cloudera Manager去安装低版本的CDH。更多信息大家多花时间去看看官网就获取更多的消息了。下面羚羊开始记录羚羊的安装过程。</span></span></p>
<h1>安装</h1>
<h2>Cloudera Manager 6.3.0安装</h2>
<p>由于在线安装下载比较慢，羚羊都先下载到本地后离线安装啦。</p>
<div>环境：</div>
<div>
<table border="2" align="left"><colgroup><col><col><col></colgroup>
<tbody>
<tr>
<td style="text-align: center" data-cell-id="5355-1593668699990">
<div class="table-cell-line"><span style="background-color: rgba(255, 255, 255, 1)">IP</span></div>
</td>
<td style="text-align: center" data-cell-id="6535-1593668699990">
<div class="table-cell-line"><span style="background-color: rgba(255, 255, 255, 1)">HostName</span></div>
</td>
<td style="text-align: center" data-cell-id="1750-1593668699990">
<div class="table-cell-line"><span style="background-color: rgba(255, 255, 255, 1)">OS</span></div>
</td>
<td style="text-align: center" data-cell-id="1750-1593668699990">
<div class="table-cell-line">安装用户</div>
</td>
<td style="text-align: center" data-cell-id="1750-1593668699990">
<div class="table-cell-line">备注</div>
</td>
</tr>
<tr>
<td style="text-align: center" data-cell-id="9856-1593668699990">
<div class="table-cell-line">10.111.15.162</div>
</td>
<td style="text-align: center" data-cell-id="4925-1593668699990">
<div class="table-cell-line">cdh6-master</div>
</td>
<td style="text-align: center" data-cell-id="9984-1593668699990">
<div class="table-cell-line">CentOS 7.5</div>
</td>
<td style="text-align: center" data-cell-id="9984-1593668699990">hadoop</td>
<td style="text-align: center" data-cell-id="9984-1593668699990">
<div class="table-cell-line"> </div>
</td>
</tr>
<tr>
<td style="text-align: center" data-cell-id="9993-1593668699990">
<div class="table-cell-line">10.111.15.163</div>
</td>
<td style="text-align: center" data-cell-id="2519-1593668699990">
<div class="table-cell-line">cdh6-slave1</div>
</td>
<td style="text-align: center" data-cell-id="1323-1593668699990">
<div class="table-cell-line">CentOS 7.5</div>
</td>
<td style="text-align: center" data-cell-id="1323-1593668699990">hadoop</td>
<td style="text-align: center" data-cell-id="1323-1593668699990"> </td>
</tr>
<tr>
<td style="text-align: center" data-cell-id="7513-1593668699990">
<div class="table-cell-line">10.111.15.164</div>
</td>
<td style="text-align: center" data-cell-id="6373-1593668699990">
<div class="table-cell-line">cdh6-slave2</div>
</td>
<td style="text-align: center" data-cell-id="1964-1593668699990">
<div class="table-cell-line">CentOS 7.5</div>
</td>
<td style="text-align: center" data-cell-id="1964-1593668699990">hadoop</td>
<td style="text-align: center" data-cell-id="1964-1593668699990"> </td>
</tr>
<tr>
<td style="text-align: center" data-cell-id="3270-1593668699990">
<div class="table-cell-line">10.111.15.166</div>
</td>
<td style="text-align: center" data-cell-id="3092-1593668699991">
<div class="table-cell-line">cdh6-slave3</div>
</td>
<td style="text-align: center" data-cell-id="9789-1593668699991">
<div class="table-cell-line">CentOS 7.5</div>
</td>
<td style="text-align: center" data-cell-id="9789-1593668699991">hadoop</td>
<td style="text-align: center" data-cell-id="9789-1593668699991"> </td>
</tr>
<tr>
<td style="text-align: center" data-cell-id="3324-1593668699991">
<div class="table-cell-line">10.111.15.167</div>
</td>
<td style="text-align: center" data-cell-id="3077-1593668699991">
<div class="table-cell-line">mysql数据库</div>
</td>
<td style="text-align: center" data-cell-id="7372-1593668699991"> CentOS 7.5</td>
<td style="text-align: center" data-cell-id="7372-1593668699991">hadoop</td>
<td style="text-align: center" data-cell-id="7372-1593668699991">也可以跟CM master同一台机器</td>
</tr>
</tbody>
</table>
</div>
<div> </div>
<div> </div>
<div> </div>
<div> </div>
<div> </div>
<div> </div>
<div> </div>
<div> </div>
<div> </div>
<div> </div>
<h3 style="text-align: left">hosts配置 </h3>
<p>在hosts文件末尾加配置：sudo vim /etc/hosts</p>
<div>10.111.15.162 cdh6-master</div>
<div>10.111.15.163 cdh6-slave1</div>
<div>10.111.15.164 cdh6-slave2</div>
<div>10.111.15.166 cdh6-slave3 </div>
<h3>JDK安装</h3>
<div class="cnblogs_code">
<pre>cd /usr/<span style="color: rgba(0, 0, 0, 1)">java
tar </span>-xvf jdk-8u251-linux-<span style="color: rgba(0, 0, 0, 1)">x64.tar.gz
vim </span>~/.bash_profile</pre>
</div>
<p>加入内容：</p>
<div class="cnblogs_Highlighter">
<pre class="brush:javascript;gutter:true;">export JAVA_HOME=/usr/java/jdk1.8.0_251
export PATH=$JAVA_HOME/bin:$PATH
export JRE_HOME=$JAVA_HOME/jre</pre>
</div>
<div class="cnblogs_code">
<pre>source ~/.bash_profile</pre>
</div>
<p>验证是否安装成功：java -version</p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702172301875-1582788708.png" width="400" loading="lazy"></p>
<p> <strong>注意：一定要64位，如果系统是64位，不然启动hdfs的时候会提示：libhadoop.so.1.0.0 无法加载的问题，原因是libhadoop依赖 64位的libjvm.so</strong> </p>
<h3>关闭selinux</h3>
<div class="cnblogs_code">
<pre>sudo vim /etc/selinux/<span style="color: rgba(0, 0, 0, 1)">config
SELINUX</span>=disabled </pre>
</div>
<h3>安装依赖</h3>
<div class="cnblogs_code">
<pre>sudo yum install -y bind-utils psmisc libxslt cyrus-sasl-plain cyrus-sasl-gssapi fuse portmap fuse-libs httpd mod_ssl openssl-devel python-psycopg2 MySQL-python /lib/lsb/init-functions libpq.so.<span style="color: rgba(128, 0, 128, 1)">5</span></pre>
</div>
<div class="cnblogs_code">
<pre>wget http:<span style="color: rgba(0, 128, 0, 1)">//</span><span style="color: rgba(0, 128, 0, 1)">www.percona.com/redir/downloads/Percona-XtraDB-Cluster/5.5.37-25.10/RPM/rhel6/x86_64/Percona-XtraDB-Cluster-shared-55-5.5.37-25.10.756.el6.x86_64.rpm</span>
sudo rpm -ivh Percona-XtraDB-Cluster-shared-<span style="color: rgba(128, 0, 128, 1)">55</span>-<span style="color: rgba(128, 0, 128, 1)">5.5</span>.<span style="color: rgba(128, 0, 128, 1)">37</span>-<span style="color: rgba(128, 0, 128, 1)">25.10</span>.<span style="color: rgba(128, 0, 128, 1)">756</span>.el6.x86_64.rpm</pre>
</div>
<div class="cnblogs_code">
<pre>sudo yum install python27 </pre>
</div>
<h3>SSH免登录配置 </h3>
<div>当前目录执行：ssh-keygen</div>
<div>在/home/用户/.ssh下生成公私钥</div>
<div>
<div class="cnblogs_code">
<pre> cd /home/hadoop/<span style="color: rgba(0, 0, 0, 1)">.ssh
ssh</span>-copy-id -p <span style="color: rgba(128, 0, 128, 1)">41122</span> -i ./id_rsa.pub hadoop@cdh6-<span style="color: rgba(0, 0, 0, 1)">master
ssh</span>-copy-id -p <span style="color: rgba(128, 0, 128, 1)">41122</span> -i ./id_rsa.pub hadoop@cdh6-<span style="color: rgba(0, 0, 0, 1)">slave1
ssh</span>-copy-id -p <span style="color: rgba(128, 0, 128, 1)">41122</span> -i ./id_rsa.pub hadoop@cdh6-<span style="color: rgba(0, 0, 0, 1)">slave2
ssh</span>-copy-id -p <span style="color: rgba(128, 0, 128, 1)">41122</span> -i ./id_rsa.pub hadoop@cdh6-slave3</pre>
</div>
</div>
<h3>NTP安装</h3>
<div class="cnblogs_code">
<pre> sudo yum -<span style="color: rgba(0, 0, 0, 1)">y install ntp
sudo </span>/etc/ntp.conf<br> ## 加入时间服务器：</pre>
<div style="margin-left: 30px">server 0.asia.pool.ntp.org</div>
<div style="margin-left: 30px">server 1.asia.pool.ntp.org</div>
<div style="margin-left: 30px">server 2.asia.pool.ntp.org</div>
<div style="margin-left: 30px">server 3.asia.pool.ntp.org</div>
</div>
<p>PS: 或在https://www.pool.ntp.org/zone/asia找最适合的时间服务器</p>
<div class="cnblogs_code">
<pre> sudo service ntpd restart </pre>
</div>
<div>查看与时间同步服务器的时间偏差：ntpdc -c loopinfo </div>
<div>查看当前同步的时间服务器：ntpq -p </div>
<div>查看状态：ntpstat </div>
<h3>安装 6.3.0yum源</h3>
<p>所有节点上执行：</p>
<div class="cnblogs_code">
<pre>sudo curl -o /etc/yum.repos.d/cloudera-manager.repo https:<span style="color: rgba(0, 128, 0, 1)">//</span><span style="color: rgba(0, 128, 0, 1)">archive.cloudera.com/cm6/6.3.0/redhat7/yum/cloudera-manager.repo</span>
rpm --import https:<span style="color: rgba(0, 128, 0, 1)">//</span><span style="color: rgba(0, 128, 0, 1)">archive.cloudera.com/cm6/6.3.0/redhat7/yum/RPM-GPG-KEY-cloudera</span> </pre>
</div>
<h3>各节点安装mysql驱动<span style="font-size: 1.17em"> </span></h3>
<div class="cnblogs_code">
<pre>wget https:<span style="color: rgba(0, 128, 0, 1)">//</span><span style="color: rgba(0, 128, 0, 1)">dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.46.tar.gz</span>
<span style="color: rgba(0, 0, 0, 1)"># 解压
tar </span>-zxf mysql-connector-java-<span style="color: rgba(128, 0, 128, 1)">5.1</span>.<span style="color: rgba(128, 0, 128, 1)">46</span><span style="color: rgba(0, 0, 0, 1)">.tar.gz
# 放到指定目录
（一定要</span>改名为mysql-connector-java.jar）sudo cp mysql-connector-java-<span style="color: rgba(128, 0, 128, 1)">5.1</span>.<span style="color: rgba(128, 0, 128, 1)">46</span>/mysql-connector-java-<span style="color: rgba(128, 0, 128, 1)">5.1</span>.<span style="color: rgba(128, 0, 128, 1)">46</span>-bin.jar /usr/share/java/mysql-connector-java.jar</pre>
</div>
<h3>master节点安装cloudera-manager server</h3>
<div>
<div class="cnblogs_code">
<pre>sudo yum localinstall ./cloudera-manager-daemons-<span style="color: rgba(128, 0, 128, 1)">6.3</span>.<span style="color: rgba(128, 0, 128, 1)">0</span>-<span style="color: rgba(128, 0, 128, 1)">2117683</span>.el7.x86_64.rpm ./cloudera-manager-server-<span style="color: rgba(128, 0, 128, 1)">6.3</span>.<span style="color: rgba(128, 0, 128, 1)">0</span>-<span style="color: rgba(128, 0, 128, 1)">2117683</span><span style="color: rgba(0, 0, 0, 1)">.el7.x86_64.rpm
cloudera</span>-manager-server -y</pre>
</div>
</div>
<p style="margin-left: 30px"></p>
<div class="cnblogs_code">
<pre>cd /opt/cloudera/cm</pre>
</div>
<p>可以看到安装目录下很多文件：</p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702181514965-1975102728.png" width="400" loading="lazy"></p>
<div>查看是否成功</div>
<div>
<div class="cnblogs_code">
<pre>rpm -qa|grep cloudera-manager</pre>
</div>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702181722793-1865347677.png" width="400" loading="lazy"></p>
</div>
<h3>连接数据库配置</h3>
<div class="cnblogs_code">
<pre>sudo vim /etc/cloudera-scm-server/db.properties</pre>
</div>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702183002377-1807886893.png" width="400" loading="lazy"> </p>
<h3>创建数据库</h3>
<p>各角色如：scm、amon、rman、hue、metastore、sentry、nav、navms、oozie，需要用到数据。需要先创建好</p>
<div class="cnblogs_code">
<pre>CREATE DATABASE scm DEFAULT CHARACTER SET utf8 DEFAULT<span> COLLATE utf8_general_ci;
CREATE DATABASE amon DEFAULT CHARACTER SET utf8 DEFAULT<span> COLLATE utf8_general_ci;
CREATE DATABASE rman DEFAULT CHARACTER SET utf8 DEFAULT<span> COLLATE utf8_general_ci;
CREATE DATABASE hue DEFAULT CHARACTER SET utf8 DEFAULT<span> COLLATE utf8_general_ci;
CREATE DATABASE metastore DEFAULT CHARACTER SET utf8 DEFAULT<span> COLLATE utf8_general_ci;
CREATE DATABASE sentry DEFAULT CHARACTER SET utf8 DEFAULT<span> COLLATE utf8_general_ci;
CREATE DATABASE nav DEFAULT CHARACTER SET utf8 DEFAULT<span> COLLATE utf8_general_ci;
CREATE DATABASE navms DEFAULT CHARACTER SET utf8 DEFAULT<span> COLLATE utf8_general_ci;
CREATE DATABASE oozie DEFAULT CHARACTER SET utf8 DEFAULT<span> COLLATE utf8_general_ci;
CREATE DATABASE hive DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;</span></span></span></span></span></span></span></span></span></pre>
</div>
<p> 数据库跟master不在同一台机器上，需要授权访问</p>
<div class="cnblogs_code">
<pre>grant all privileges on *.* to 'hadoop'@'101.111.14.123' identified by 'xxxxxx' with grant option<span>;
grant all privileges on *.* to 'scm'@'master.cdh6' identified by 'xxxxxx' with grant option<span>;
flush privileges;</span></span> </pre>
</div>
<h3>master节点上执行脚本 </h3>
<div class="cnblogs_code">
<pre>/opt/cloudera/cm/schema/scm_prepare_database.sh mysql -h 10.111.15.167 --scm-host cdh6-master scm scm</pre>
</div>
<p><strong>PS：开启gtid模式，可能会报错：Error Code: 1786 Statement violates GTID consistency: CREATE TABLE ... SELECT</strong></p>
<h3>启动</h3>
<div class="cnblogs_code">
<pre>sudo systemctl start cloudera-scm-server</pre>
</div>
<h3>查看启动日志</h3>
<div class="cnblogs_code">
<pre>sudo tail -100f /<span style="color: rgba(0, 0, 255, 1)">var</span>/log/cloudera-scm-server/cloudera-scm-server.log </pre>
</div>
<h3>各从节点安装Agent</h3>
<div class="cnblogs_code">
<pre>sudo yum localinstall ./cloudera-manager-agent-<span style="color: rgba(128, 0, 128, 1)">6.3</span>.<span style="color: rgba(128, 0, 128, 1)">0</span>-<span style="color: rgba(128, 0, 128, 1)">2117683</span>.el7.x86_64.rpm ./cloudera-manager-daemons-<span style="color: rgba(128, 0, 128, 1)">6.3</span>.<span style="color: rgba(128, 0, 128, 1)">0</span>-<span style="color: rgba(128, 0, 128, 1)">2117683</span>.el7.x86_64.rpmcloudera-manager-agent-y</pre>
</div>
<h3>修改所有子节点的CM主机地址 </h3>
<div class="cnblogs_code">
<pre>sudo vim /etc/cloudera-scm-agent/<span style="color: rgba(0, 0, 0, 1)">config.ini
# 将server_host修改为CM</span>-<span style="color: rgba(0, 0, 0, 1)">Server所在的主机名
server_host</span>=cdh6-master</pre>
</div>
<h3>启动</h3>
<div class="cnblogs_code">
<pre>sudo systemctl start cloudera-scm-agent</pre>
</div>
<h3>查看日志</h3>
<div class="cnblogs_code">
<pre>sudo tail -100f /<span style="color: rgba(0, 0, 255, 1)">var</span>/log/cloudera-scm-agent/cloudera-scm-agent.log</pre>
</div>
<h3>登录(admin/admin)</h3>
<div>http://10.111.15.162:7208/</div>
<div>出现登录界面说明master安装成功</div>
<h2>CDH 6.3.2安装</h2>
<h3>下载CDH6安装包</h3>
<p>下载地址：https://archive.cloudera.com/cdh6/6.3.2/parcels/</p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702185553776-2014267800.png" width="400" loading="lazy"></p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702190207142-1433824706.png" width="400" loading="lazy"></p>
<p>只下载红圈文件即可，其中7代表centos7</p>
<div class="cnblogs_code">
<pre><span style="color: rgba(0, 0, 0, 1)">#全部下载
nohup sudo wget </span>--recursive --no-parent --no-host-directories https:<span style="color: rgba(0, 128, 0, 1)">//</span><span style="color: rgba(0, 128, 0, 1)">archive.cloudera.com/cdh6/6.3.2/parcels/ -P /var/www/html/cloudera-repos &</span>
nohup sudo wget --recursive --no-parent --no-host-directories https:<span style="color: rgba(0, 128, 0, 1)">//</span><span style="color: rgba(0, 128, 0, 1)">archive.cloudera.com/gplextras6/6.3.2/parcels/ -P /var/www/html/cloudera-repos &</span></pre>
</div>
<h3>安装Apache HTTP Server</h3>
<div class="cnblogs_code">
<pre>sudo yum install httpd</pre>
</div>
<h3>启动</h3>
<div class="cnblogs_code">
<pre>systemctl start httpd</pre>
</div>
<h3>界面向导安装</h3>
<p>登录http://10.111.15.162:7208/</p>
<div style="margin-left: 30px"><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702184224583-335011503.png" width="800" loading="lazy"></div>
<div style="margin-left: 30px"><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702184605935-1935789442.png" width="800" loading="lazy">
<p> </p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702184655832-1084910704.png" width="800" loading="lazy"></p>
<div>选择已安装好的agent节点：</div>
<p> <img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702184929901-1429150339.png" width="800" loading="lazy"></p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702191505122-1578427350.png" width="800" loading="lazy"></p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702191604408-1815275425.png" width="800" loading="lazy"></p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702191645889-1905426239.png" width="800" loading="lazy"></p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702191915886-1502180168.png" width="800" loading="lazy"></p>
<p> <img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702192020798-1083438945.png" width="800" loading="lazy"></p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702192145215-931913555.png" width="800" loading="lazy"></p>
<div>官方建议在master机器上安装Hue</div>
<p></p>
<p> <img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702192741003-973504171.png" width="800" loading="lazy"> <img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702192844523-769573573.png" width="800" loading="lazy"> <img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702192940474-260778883.png" width="800" loading="lazy"></p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200706175436332-1478354933.png" width="800" loading="lazy"></p>
<p>上图是启动服务后的界面效果，配置方面还需要调整和优化。羚羊运气不太好，所以安装过程遇到很多问题，下面羚羊就分享比较有代表性的问题</p>
</div>
<h1>问题</h1>
<h3>一、安装CDH时出现：com.cloudera.server.web.cmf.csrf.CsrfRefererInterceptor: Rejecting request originating from refering </h3>
<div><strong>解决</strong>：在安装CMS目录下(/opt/cloudera/cm)注释掉CsrfRefererInterceptor bean</div>
<div>vim ./webapp/WEB-INF/spring/mvc-config.xml</div>
<h3>二、安装agent出现问题：</h3>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702194750436-907789813.png" width="800" loading="lazy"></p>
<div><strong>解决：</strong></div>
<div>wget http://www.percona.com/redir/downloads/Percona-XtraDB-Cluster/5.5.37-25.10/RPM/rhel6/x86_64/Percona-XtraDB-Cluster-shared-55-5.5.37-25.10.756.el6.x86_64.rpm rpm -ivh Percona-XtraDB-Cluster-shared-55-5.5.37-25.10.756.el6.x86_64.rpm</div>
<h3>三、测试hue数据库连接异常：</h3>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702195209996-894915051.png" width="800" loading="lazy"></p>
<p> 对应异常日志：</p>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702195306215-147903576.png" width="800" loading="lazy"> </p>
<p> <strong>解决：</strong></p>
<p>下载或从别的机器copy libmysqlclient.so.18包</p>
<div class="cnblogs_code">
<pre>sudo ln -s /usr/lib64/mysql/libmysqlclient.so.<span style="color: rgba(128, 0, 128, 1)">18.0</span>.<span style="color: rgba(128, 0, 128, 1)">0</span> /usr/lib64/mysql/libmysqlclient.so.<span style="color: rgba(128, 0, 128, 1)">18</span></pre>
</div>
<div class="cnblogs_code">
<pre>sudo vim /etc/<span style="color: rgba(0, 0, 0, 1)">ld.so.conf
#加libmysqlclient.so.18所在的目录
</span>/usr/lib64/mysql </pre>
<div>sudo ldconfig</div>
<pre> </pre>
</div>
<h3>四、角色启动目录权限问题</h3>
<p><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702195823318-553475802.png" width="800" loading="lazy"></p>
<div><strong>解决：</strong></div>
<div> <strong><strong><strong><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702195937656-153819565.png" width="800" loading="lazy"></strong></strong></strong>
<div>其它角色启动如果有目录权限问题，一样先要创建工作根目录即可解决</div>
</div>
<h3>五、web界面经常报"查询 Service Monitor 时发生内部错误</h3>
<div><strong>解决：</strong>原因是内存太小，资源管理配置下堆栈大小</div>
<div><img src="https://img2020.cnblogs.com/blog/238710/202007/238710-20200702200201457-1694001673.png" width="800" loading="lazy"></div>
<div>
<h3>六、hive初始化数据：schematool -initSchema -dbType mysql失败，无法启动hive</h3>
</div>
<div class="cnblogs_Highlighter">
<pre class="brush:java;gutter:true;">Metastore connection URL: jdbc:derby:;databaseName=metastore_db;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 2.1.0
Initialization script hive-schema-2.1.1.mysql.sql
Error: Syntax error: Encountered “” at line 1, column 64. (state=42X01,code=30000)
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
Underlying cause: java.io.IOException : Schema script failed, errorcode 2
Use --verbose for detailed stacktrace.
*** schemaTool failed ***
</pre>
</div>
<p><strong>解决：</strong>在hive-size.xml加如下内容 </p>
<div class="cnblogs_code">
<pre><span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">property</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">name</span><span style="color: rgba(0, 0, 255, 1)">></span>javax.jdo.option.ConnectionURL<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">name</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">value</span><span style="color: rgba(0, 0, 255, 1)">></span>jdbc:mysql://msyql_ip:3306/hive?useUnicode=true<span style="color: rgba(255, 0, 0, 1)">&amp;</span>characterEncoding=UTF-8<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">value</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">property</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">property</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">name</span><span style="color: rgba(0, 0, 255, 1)">></span>javax.jdo.option.ConnectionDriverName<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">name</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">value</span><span style="color: rgba(0, 0, 255, 1)">></span>com.mysql.jdbc.Driver<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">value</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">property</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">property</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">name</span><span style="color: rgba(0, 0, 255, 1)">></span>javax.jdo.option.ConnectionUserName<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">name</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">value</span><span style="color: rgba(0, 0, 255, 1)">></span>user<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">value</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">property</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">property</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">name</span><span style="color: rgba(0, 0, 255, 1)">></span>javax.jdo.option.ConnectionPassword<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">name</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">value</span><span style="color: rgba(0, 0, 255, 1)">></span>passwd<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">value</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"></</span><span style="color: rgba(128, 0, 0, 1)">property</span><span style="color: rgba(0, 0, 255, 1)">></span>
<span style="color: rgba(0, 0, 255, 1)"><</span><span style="color: rgba(128, 0, 0, 1)">property</span><span style="color: rgba(0, 0, 255, 1)">></span></pre>
</div>
<p><strong>【版权声明】</strong></p>
<p><strong>本文版权归作者(<span style="text-decoration: underline; color: rgba(51, 102, 255, 1)"><span style="color: rgba(51, 102, 255, 1); text-decoration: underline">深圳伊人网网络有限公司</span></span>)和博客园共有，欢迎转载，但未经作者同意必须在文章页面给出原文链接，否则保留追究法律责任的权利。<strong>如您有任何商业合作或者授权方面的协商，请给我留言：siqing0822@163.com</strong></strong></p>
<p></p><br><br>
来源：https://www.cnblogs.com/dengbangpang/p/13224244.html
頁:
[1]