详解Ubuntu16.04下Hadoop 2.7.3的安装与配置
<p><strong>一、java环境搭建</strong></p>
<p>
（1）下载jdk并解压（当前操作系统为ubuntu16.04，jdk版本为jdk-8u111-linux-x64.tar.gz）</p>
<p>
新建/usr/java目录，切换到jdk-8u111-linux-x64.tar.gz所在目录，将这个文件解压缩到/usr/java目录下。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_341329">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">tar</code> <code class="bash plain">-zxvf jdk-8u101-linux-x64.</code><code class="bash functions">tar</code><code class="bash plain">.gz -c </code><code class="bash plain">/usr/java/</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
（2）设置环境变量</p>
<p>
修改.bashrc，在最后一行写入下列内容。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_717723">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">vim ~/.bashrc</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_849907">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">export</code> <code class="bash plain">java_home=</code><code class="bash plain">/usr/java/jdk1</code><code class="bash plain">.8.0_111 </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash functions">export</code> <code class="bash plain">classpath=.:$java_home</code><code class="bash plain">/lib/dt</code><code class="bash plain">.jar:$java_home</code><code class="bash plain">/lib/tools</code><code class="bash plain">.jar </code>
</div>
<div class="line number3 index2 alt2">
<code class="bash functions">export</code> <code class="bash plain">path=$java_home</code><code class="bash plain">/bin</code><code class="bash plain">:$path</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/a4c0469d4a2e5fb261df10b4e1fc8075.jpg"></p>
<p>
运行如下命令使环境变量生效。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_610656">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">source</code> <code class="bash plain">~/.bashrc</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
打开profile文件，插入java环境配置节。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_406806">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">vim </code><code class="bash plain">/etc/profile</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_592212">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">export</code> <code class="bash plain">java_home=</code><code class="bash plain">/usr/java/jdk1</code><code class="bash plain">.8.0_111 </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash functions">export</code> <code class="bash plain">java_bin=$java_home</code><code class="bash plain">/bin</code>
</div>
<div class="line number3 index2 alt2">
<code class="bash functions">export</code> <code class="bash plain">java_lib=$java_home</code><code class="bash plain">/lib</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash functions">export</code> <code class="bash plain">classpath=.:$java_lib</code><code class="bash plain">/tools</code><code class="bash plain">.jar:$java_lib</code><code class="bash plain">/dt</code><code class="bash plain">.jar </code>
</div>
<div class="line number5 index4 alt2">
<code class="bash functions">export</code> <code class="bash plain">path=$java_home</code><code class="bash plain">/bin</code><code class="bash plain">:$path</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/8a6a6bc594686c0ecdd1d7d47734f885.jpg"></p>
<p>
打开environment 文件，追加jdk目录和jdk下的lib的目录，如下所示。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_579325">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">vim </code><code class="bash plain">/etc/environment</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
</p>
<div class="codetitle">
<span><u>复制代码</u></span> 代码如下:</div>
<div class="codebody" id="code28222">
<br>
path="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/java/jdk1.8.0_111/lib:/usr/java/jdk1.8.0_111" </div>
<p>
</p>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/780a55d84d66735a8ef6a8303b41233e.jpg"></p>
<p>
使配置生效</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_583159">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">source</code> <code class="bash plain">/etc/environment</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
验证java环境是否配置成功</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_763248">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">java -version</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<strong>二、安装ssh-server并实现免密码登录</strong></p>
<p>
（1）下载ssh-server</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_800661">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">apt-get </code><code class="bash functions">install</code> <code class="bash plain">openssh-server</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
（2）启动ssh</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_718376">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">/etc/init</code><code class="bash plain">.d</code><code class="bash plain">/ssh</code> <code class="bash plain">start</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
（3）查看ssh服务是否启动，如果有显示相关ssh字样则表示成功。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_199052">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">ps</code> <code class="bash plain">-ef|</code><code class="bash functions">grep</code> <code class="bash functions">ssh</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/12400491a8ccf512521f5c5ebd106724.jpg"></p>
<p>
（4）设置免密码登录</p>
<p>
使用如下命令，一直回车，直到生成了rsa。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_722212">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">ssh</code><code class="bash plain">-keygen -t rsa</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
导入authorized_keys</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_733584">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">cat</code> <code class="bash plain">~/.</code><code class="bash functions">ssh</code><code class="bash plain">/id_rsa</code><code class="bash plain">.pub >> ~/.</code><code class="bash functions">ssh</code><code class="bash plain">/authorized_keys</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
测试是否免密码登录localhost</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_201519">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">ssh</code> <code class="bash plain">localhost</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
关闭防火墙</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_209069">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">ufw disable</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<strong>三、安装hadoop单机模式和伪分布模式。</strong></p>
<p>
（1）下载hadoop-2.7.3.tar.gz，解压到/usr/local（单机模式搭建）。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_970118">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash functions">tar</code> <code class="bash plain">zxvf hadoop-2.7.3.</code><code class="bash functions">tar</code><code class="bash plain">.gz -c </code><code class="bash plain">/usr/local</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
切换到/usr/local下，将hadoop-2.7.3重命名为hadoop，并给/usr/local/hadoop设置访问权限。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_96364">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">cd</code> <code class="bash plain">/usr/local</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash functions">sudo</code> <code class="bash functions">mv</code> <code class="bash plain">hadoop-2.7.3 hadoop </code>
</div>
<div class="line number3 index2 alt2">
<code class="bash functions">sudo</code> <code class="bash functions">chmod</code> <code class="bash plain">777 </code><code class="bash plain">/usr/local/hadoop</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
（2）配置.bashrc文件</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_557669">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">vim ~/.bashrc</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
（如果没有安装vim，请用 sudo apt install vim 安装。）</p>
<p>
在文件末尾追加下面内容，然后保存。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_516208">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash comments">#hadoop variables start </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash functions">export</code> <code class="bash plain">java_home=</code><code class="bash plain">/usr/java/jdk1</code><code class="bash plain">.8.0_111 </code>
</div>
<div class="line number3 index2 alt2">
<code class="bash functions">export</code> <code class="bash plain">hadoop_install=</code><code class="bash plain">/usr/local/hadoop</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash functions">export</code> <code class="bash plain">path=$path:$hadoop_install</code><code class="bash plain">/bin</code>
</div>
<div class="line number5 index4 alt2">
<code class="bash functions">export</code> <code class="bash plain">path=$path:$hadoop_install</code><code class="bash plain">/sbin</code>
</div>
<div class="line number6 index5 alt1">
<code class="bash functions">export</code> <code class="bash plain">hadoop_mapred_home=$hadoop_install </code>
</div>
<div class="line number7 index6 alt2">
<code class="bash functions">export</code> <code class="bash plain">hadoop_common_home=$hadoop_install </code>
</div>
<div class="line number8 index7 alt1">
<code class="bash functions">export</code> <code class="bash plain">hadoop_hdfs_home=$hadoop_install </code>
</div>
<div class="line number9 index8 alt2">
<code class="bash functions">export</code> <code class="bash plain">yarn_home=$hadoop_install </code>
</div>
<div class="line number10 index9 alt1">
<code class="bash functions">export</code> <code class="bash plain">hadoop_common_lib_native_dir=$hadoop_install</code><code class="bash plain">/lib/native</code>
</div>
<div class="line number11 index10 alt2">
<code class="bash functions">export</code> <code class="bash plain">hadoop_opts=</code><code class="bash string">"-djava.library.path=$hadoop_install/lib"</code>
</div>
<div class="line number12 index11 alt1">
<code class="bash comments">#hadoop variables end </code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/e24c53767a351fb18941b7b02e1384bf.jpg"></p>
<p>
执行下面命令，使添加的环境变量生效：</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_58581">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">source</code> <code class="bash plain">~/.bashrc</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
（3）hadoop配置 (伪分布模式搭建)</p>
<p>
配置hadoop-env.sh</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_574823">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">vim </code><code class="bash plain">/usr/local/hadoop/etc/hadoop/hadoop-env</code><code class="bash plain">.sh</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_44707">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash comments"># the java implementation to use. </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash functions">export</code> <code class="bash plain">java_home=</code><code class="bash plain">/usr/java/jdk1</code><code class="bash plain">.8.0_111 </code>
</div>
<div class="line number3 index2 alt2">
<code class="bash functions">export</code> <code class="bash plain">hadoop=</code><code class="bash plain">/usr/local/hadoop</code>
</div>
<div class="line number4 index3 alt1">
<code class="bash functions">export</code> <code class="bash plain">path=$path:</code><code class="bash plain">/usr/local/hadoop/bin</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/d802c44a43252103751bf42e4ff65ec5.jpg"></p>
<p>
配置yarn-env.sh</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_906334">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">vim </code><code class="bash plain">/usr/local/hadoop/etc/hadoop/yarn-env</code><code class="bash plain">.sh</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_342580">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash comments"># export java_home=/home/y/libexec/jdk1.6.0/ </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">java_home=</code><code class="bash plain">/usr/java/jdk1</code><code class="bash plain">.8.0_111</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/6cf83664751554efa5e279c2cb843a9b.jpg"></p>
<p>
配置core-site.xml，在home目录下创建 /home/lyh/hadoop_tmp目录，然后在core-site.xml中添加下列内容。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_228162">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash functions">mkdir</code> <code class="bash plain">/home/lyh/hadoop_tmp</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_639744">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">vim </code><code class="bash plain">/usr/local/hadoop/etc/hadoop/core-site</code><code class="bash plain">.xml</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterxml" id="highlighter_505782">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="xml plain"><</code><code class="xml keyword">configuration</code><code class="xml plain">> </code>
</div>
<div class="line number2 index1 alt1">
<code class="xml spaces"> </code><code class="xml comments"><!-- 指定hdfs老大（namenode）的通信地址 --></code>
</div>
<div class="line number3 index2 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number4 index3 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>fs.defaultfs</</code><code class="xml keyword">name</code><code class="xml plain">> </code>
</div>
<div class="line number5 index4 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>hdfs://localhost:9000</</code><code class="xml keyword">value</code><code class="xml plain">> </code>
</div>
<div class="line number6 index5 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number7 index6 alt2">
<code class="xml spaces"> </code><code class="xml comments"><!-- 指定hadoop运行时产生文件的存储目录 --></code>
</div>
<div class="line number8 index7 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number9 index8 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>hadoop.tmp.dir</</code><code class="xml keyword">name</code><code class="xml plain">> </code>
</div>
<div class="line number10 index9 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>/home/lyh/hadoop_tmp</</code><code class="xml keyword">value</code><code class="xml plain">> </code>
</div>
<div class="line number11 index10 alt2">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number12 index11 alt1">
<code class="xml plain"></</code><code class="xml keyword">configuration</code><code class="xml plain">></code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/21ae154130f1978b2383a928234c42b0.jpg"></p>
<p>
配置hdfs-site.xml</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_533206">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">vim </code><code class="bash plain">/usr/local/hadoop/etc/hadoop/hdfs-site</code><code class="bash plain">.xml</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterxml" id="highlighter_840808">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="xml plain"><</code><code class="xml keyword">configuration</code><code class="xml plain">> </code>
</div>
<div class="line number2 index1 alt1">
<code class="xml spaces"> </code><code class="xml comments"><!-- 指定hdfs副本的数量 --></code>
</div>
<div class="line number3 index2 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number4 index3 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>dfs.replication</</code><code class="xml keyword">name</code><code class="xml plain">> </code>
</div>
<div class="line number5 index4 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>1</</code><code class="xml keyword">value</code><code class="xml plain">> </code>
</div>
<div class="line number6 index5 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number7 index6 alt2">
<code class="xml plain"></</code><code class="xml keyword">configuration</code><code class="xml plain">></code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/32590130104a16405f371405c49aff0f.jpg"></p>
<p>
配置yarn-site.xml</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_219695">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash functions">sudo</code> <code class="bash plain">vim </code><code class="bash plain">/usr/local/hadoop/etc/hadoop/yarn-site</code><code class="bash plain">.xml </code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<div class="jb51code">
<div>
<div class="syntaxhighlighterxml" id="highlighter_697768">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
<div class="line number22 index21 alt1">
22</div>
<div class="line number23 index22 alt2">
23</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="xml plain"><</code><code class="xml keyword">configuration</code><code class="xml plain">> </code>
</div>
<div class="line number2 index1 alt1">
<code class="xml comments"><!-- site specific yarn configuration properties --></code>
</div>
<div class="line number3 index2 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number4 index3 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>yarn.nodemanager.aux-services</</code><code class="xml keyword">name</code><code class="xml plain">> </code>
</div>
<div class="line number5 index4 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>mapreduce_shuffle</</code><code class="xml keyword">value</code><code class="xml plain">> </code>
</div>
<div class="line number6 index5 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number7 index6 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number8 index7 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>yarn.nodemanager.aux-services.mapreduce.shuffle.class</</code><code class="xml keyword">name</code><code class="xml plain">> </code>
</div>
<div class="line number9 index8 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>org.apache.hadoop.mapred.shufflehandler</</code><code class="xml keyword">value</code><code class="xml plain">> </code>
</div>
<div class="line number10 index9 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number11 index10 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number12 index11 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>yarn.resourcemanager.address</</code><code class="xml keyword">name</code><code class="xml plain">> </code>
</div>
<div class="line number13 index12 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>127.0.0.1:8032</</code><code class="xml keyword">value</code><code class="xml plain">> </code>
</div>
<div class="line number14 index13 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number15 index14 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number16 index15 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>yarn.resourcemanager.scheduler.address</</code><code class="xml keyword">name</code><code class="xml plain">> </code>
</div>
<div class="line number17 index16 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>127.0.0.1:8030</</code><code class="xml keyword">value</code><code class="xml plain">> </code>
</div>
<div class="line number18 index17 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number19 index18 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number20 index19 alt1">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">name</code><code class="xml plain">>yarn.resourcemanager.resource-tracker.address</</code><code class="xml keyword">name</code><code class="xml plain">> </code>
</div>
<div class="line number21 index20 alt2">
<code class="xml spaces"> </code><code class="xml plain"><</code><code class="xml keyword">value</code><code class="xml plain">>127.0.0.1:8031</</code><code class="xml keyword">value</code><code class="xml plain">> </code>
</div>
<div class="line number22 index21 alt1">
<code class="xml spaces"> </code><code class="xml plain"></</code><code class="xml keyword">property</code><code class="xml plain">> </code>
</div>
<div class="line number23 index22 alt2">
<code class="xml plain"></</code><code class="xml keyword">configuration</code><code class="xml plain">></code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/6d90244697f1c502c5742d2e5ce75550.jpg"></p>
<p>
（4）关机重启系统。</p>
<p>
<strong>四、测试hadoop是否安装并配置成功。</strong></p>
<p>
（1）验证hadoop单机模式安装完成</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_465051">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">hadoop version</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
能够显示hadoop的版本号即可说明单机模式已经配置完成。</p>
<p>
（2）启动hdfs使用为分布模式。</p>
<p>
格式化namenode</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_235071">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">hdfs namenode -</code><code class="bash functions">format</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
有 "……has been successfully formatted" 等字样出现即说明格式化成功。注意：每次格式化都会生成一个namenode对应的id，多次格式化之后，如果不改变datanode对应的id号，运行wordcount向input中上传文件时会失败。</p>
<p>
启动hdfs</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_383830">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">start-all.sh</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/0c5ded0b2c572ae99d2458375a5dbc49.jpg"></p>
<p>
显示进程</p>
<p>
jps </p>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/36cd13546429b85207e0b6d9ad03722a.jpg"></p>
<p>
在浏览器中输入http://localhost:50070/，出现如下页面</p>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/609098521d063672958185cb095d5654.jpg"></p>
<p>
输入 http://localhost:8088/，出现如下页面</p>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/a7f479e17005e40965e7488e6a6f025f.jpg"></p>
<p>
则说明伪分布安装配置成功了。</p>
<p>
停止hdfs</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_323814">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">stop-all.sh</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/2d60ffe42bdc75d72f3f8b972db04122.jpg"></p>
<p>
<strong>五、运行wordcount</strong></p>
<p>
（1）启动hdfs。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_105862">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">start-all.sh</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
（2）查看hdfs底下包含的文件目录</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_785623">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">hadoop dfs -</code><code class="bash functions">ls</code> <code class="bash plain">/</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
如果是第一次运行hdfs，则什么都不会显示。</p>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/6efea9b0491f88172cf4bbd8520066e8.jpg"></p>
<p>
（3）在hdfs中创建一个文件目录input，将/usr/local/hadoop/readme.txt上传至input中。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_605781">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">hdfs dfs -</code><code class="bash functions">mkdir</code> <code class="bash plain">/input</code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">hadoop fs -put </code><code class="bash plain">/usr/local/hadoop/readme</code><code class="bash plain">.txt </code><code class="bash plain">/input</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/ba88169d4a93cef2f74f6c89d883d95a.jpg"></p>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/f32102a7b6a2c85d6c2a4147b84c7e42.jpg"></p>
<p>
（4）执行以下命令运行wordcount，并将结果输出到output中。</p>
<p>
</p>
<div class="codetitle">
<span><u>复制代码</u></span> 代码如下:</div>
<div class="codebody" id="code19936">
<br>
hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount /input /output </div>
<br><p>
</p>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/347a582bfce01291d7b70b2417dba584.jpg"></p>
<p>
出现类似上图的页面说明wordcount运行成功。注意：请将图中红色线框中的内容替换为自己的hadoop-mapreduce-examples-2.7.3.jar文件的路径信息。</p>
<p>
（5）执行成功后output 目录底下会生成两个文件 _success 成功标志的文件，里面没有内容。 一个是 part-r-00000 ，通过以下命令查看执行的结果，如下图。</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_552009">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">hadoop fs -</code><code class="bash functions">cat</code> <code class="bash plain">/output/part-r-00000</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
<img style="max-width:100%!important;height:auto!important;"title="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" alt="详解Ubuntu16.04下Hadoop 2.7.3的安装与配置" src="https://zhuji.jb51.net/uploads/img/202305/36396513d8917f2ab4d55a81605e6496.jpg"></p>
<p>
附：hdfs常用命令</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterbash" id="highlighter_831598">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="bash plain">hadoop fs -</code><code class="bash functions">mkdir</code> <code class="bash plain">/tmp/input</code> <code class="bash plain">在hdfs上新建文件夹 </code>
</div>
<div class="line number2 index1 alt1">
<code class="bash plain">hadoop fs -put input1.txt </code><code class="bash plain">/tmp/input</code> <code class="bash plain">把本地文件input1.txt传到hdfs的</code><code class="bash plain">/tmp/input</code><code class="bash plain">目录下 </code>
</div>
<div class="line number3 index2 alt2">
<code class="bash plain">hadoop fs -get input1.txt </code><code class="bash plain">/tmp/input/input1</code><code class="bash plain">.txt 把hdfs文件拉到本地 </code>
</div>
<div class="line number4 index3 alt1">
<code class="bash plain">hadoop fs -</code><code class="bash functions">ls</code> <code class="bash plain">/tmp/output</code> <code class="bash plain">列出hdfs的某目录 </code>
</div>
<div class="line number5 index4 alt2">
<code class="bash plain">hadoop fs -</code><code class="bash functions">cat</code> <code class="bash plain">/tmp/ouput/output1</code><code class="bash plain">.txt 查看hdfs上的文件 </code>
</div>
<div class="line number6 index5 alt1">
<code class="bash plain">hadoop fs -rmr </code><code class="bash plain">/home/less/hadoop/tmp/output</code> <code class="bash plain">删除hdfs上的目录 </code>
</div>
<div class="line number7 index6 alt2">
<code class="bash plain">hadoop dfsadmin -report 查看hdfs状态，比如有哪些datanode，每个datanode的情况 </code>
</div>
<div class="line number8 index7 alt1">
<code class="bash plain">hadoop dfsadmin -safemode leave 离开安全模式 </code>
</div>
<div class="line number9 index8 alt2">
<code class="bash plain">hadoop dfsadmin -safemode enter 进入安全模式</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
以上就是本文的全部内容，希望对大家的学习有所帮助，也希望大家多多支持。</p>
<p>
原文链接：http://blog.csdn.net/lyhvoyage/article/details/54411836</p>
頁:
[1]