<强>前言:
前几篇文章我们介绍了HDFS组件的配置及启动,纱是Hadoop集群的资源与作业调度平台,下面介绍下纱线的伪分布部署及MapReduce简单使用。
<代码类=" language-shell "> [hadoop@hadoop000 hadoop] $ pwd/opt/软件/hadoop-2.8.1/etc/hadoop [hadoop@hadoop000 hadoop] cp mapred-site.xml美元。模板mapred-site.xml [hadoop@hadoop000 hadoop] vi mapred-site.xml美元 & lt; configuration> & lt; property> & lt; name> mapreduce.framework.name & lt; value> yarn & lt;/property> & lt;/configuration> [hadoop@hadoop000 hadoop] vi yarn-site.xml美元 & lt; configuration> & lt; property> & lt; name> yarn.nodemanager.aux-services & lt; value> mapreduce_shuffle & lt;/property> & lt;/configuration> [hadoop@hadoop000 hadoop] $ cd/opt/软件/hadoop-2.8.1 [hadoop@hadoop000 hadoop-2.8.1] sbin/start-yarn.sh美元 从纱线守护进程 resourcemanager开始,日志/opt/软件/hadoop-2.8.1/日志/yarn-hadoop-resourcemanager-hadoop000.out 192.168.6.217:nodemanager开始,日志/opt/软件/hadoop-2.8.1/日志/yarn-hadoop-nodemanager-hadoop000.out [hadoop@hadoop000 hadoop-2.8.1] jps美元 10512 ResourceManager——纱的进程 10004年SecondaryNameNode 9655年NameNode 10936年译本 9806年DataNode 10623 NodeManager——纱的进程 #纱线的两个进程: ResourceManager(资源管理) NodeManager(节点管理) #可参考官网:http://hadoop.apache.org/docs/r2.8.4/hadoop-project-dist/hadoop-common/SingleCluster.html<编辑> 2.纱网站测试
<代码类=" language-shell "> [hadoop@hadoop000 hadoop-2.8.1] $ pwd/opt/软件/hadoop-2.8.1 [hadoop@hadoop000 hadoop-2.8.1]找到。美元/- name“* *”例子 。/lib/本地/例子 。/分享/hadoop/mapreduce//hadoop-mapreduce-examples-2.8.1-test-sources.jar来源 。/分享/hadoop/mapreduce//hadoop-mapreduce-examples-2.8.1-sources.jar来源/分享/hadoop mapreduce/lib-examples/分享/hadoop mapreduce/hadoop-mapreduce-examples-2.8.1.jar/分享/doc/hadoop/hadoop-mapreduce-examples 。/分享/doc/hadoop/hadoop-yarn/hadoop-yarn-common apidocs/org/apache/hadoop/yarn/webapp/example/分享/doc/hadoop/hadoop-auth-examples//doc/hadoop/api/org/apache/hadoop/examples分享//doc/hadoop/api/org/apache/hadoop/security/authentication/examples分享 ,/etc/hadoop/ssl-server.xml.example ,/etc/hadoop/ssl-client.xml.example [hadoop@hadoop000 hadoop-2.8.1] bin/hadoop jar。美元/分享/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.1。jarπ5 10<编辑> 4 .结果解读
