hadoop动态添加datanode启动失败的经验

  

动态添加datanode节点,主机名node14.cn
<代码> shell& gt; hadoop-daemon.sh开始datanode
<代码> shell& gt; jps #查看datanode进程是否已启动
发现datanode进程启动后立即消失,查询日志发现一下记录:

  
 <代码> 2018-04-15 org.apache.hadoop.hdfs.server.namenode.NameNode 00:08:43,158信息:注册UNIX信号处理程序(项,玫瑰,INT)
  2018-04-15 00:08:43,168信息org.apache.hadoop.hdfs.server.namenode.NameNode: createNameNode []
  2018-04-15 org.apache.hadoop.metrics2.impl 00:08:43,673信息。从hadoop-metrics2.properties MetricsConfig:加载属性
  2018-04-15 org.apache.hadoop.metrics2.impl 00:08:43,837信息。MetricsSystemImpl:预定的快照时间10秒。
  2018-04-15 org.apache.hadoop.metrics2.impl 00:08:43,837信息。MetricsSystemImpl: NameNode度量系统开始
  2018-04-15 00:08:43,839信息org.apache.hadoop.hdfs.server.namenode.NameNode: fs.defaultFS是node11.cn: 9000
  2018-04-15 00:08:44,138警告org.apache.hadoop.fs。文件系统:“node11.cn: 9000”是一个弃用文件系统名称。使用“hdfs://node11.cn: 9000/薄?
  2018-04-15 org.apache.hadoop.hdfs 00:08:44,196信息。DFSUtil: hdfs在启动服务器:http://node11.cn: 9001
  2018-04-15 org.mortbay 00:08:44,266信息。日志:记录org.slf4j.impl.Log4jLoggerAdapter通过org.mortbay.log.Slf4jLog (org.mortbay.log)
  2018-04-15 org.apache.hadoop.http 00:08:44,273信息。HttpRequestLog: Http请求日志http.requests.namenode没有定义
  2018-04-15 org.apache.hadoop.http 00:08:44,293信息。HttpServer2:添加全球过滤器“安全”(类=org.apache.hadoop.http.HttpServer2 QuotingInputFilter美元)
  2018-04-15 org.apache.hadoop.http 00:08:44,298信息。HttpServer2:添加过滤器static_user_filter(类=org.apache.hadoop.http.lib.StaticUserWebFilter StaticUserFilter美元)上下文hdfs
  2018-04-15 org.apache.hadoop.http 00:08:44,298信息。HttpServer2:添加过滤器static_user_filter(类=org.apache.hadoop.http.lib.StaticUserWebFilter StaticUserFilter美元)上下文日志
  2018-04-15 org.apache.hadoop.http 00:08:44,298信息。HttpServer2:添加过滤器static_user_filter(类=org.apache.hadoop.http.lib.StaticUserWebFilter StaticUserFilter美元)静态上下文
  2018-04-15 org.apache.hadoop.http 00:08:44,374信息。org.apache.hadoop.hdfs.web HttpServer2:添加过滤器”。=org.apache.hadoop.hdfs.web.AuthFilter AuthFilter”(类)
  2018-04-15 org.apache.hadoop.http 00:08:44,377信息。HttpServer2: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources; org.apache.hadoop.hdfs.web.resource
  年代,pathSpec=/webhdfs/v1/*
  2018-04-15 org.apache.hadoop.http 00:08:44,411信息。HttpServer2: HttpServer.start()把一个非绑定IOException
  java.net.BindException:港口使用:node11.cn: 9001
  org.apache.hadoop.http.HttpServer2.openListeners (HttpServer2.java: 892)
  org.apache.hadoop.http.HttpServer2.start (HttpServer2.java: 828)
  org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start (NameNodeHttpServer.java: 142)
  org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer (NameNode.java: 706)
  org.apache.hadoop.hdfs.server.namenode.NameNode.initialize (NameNode.java: 593)
  在org.apache.hadoop.hdfs.server.namenode.NameNode灵活;init> (NameNode.java: 765)
  在org.apache.hadoop.hdfs.server.namenode.NameNode灵活;init> (NameNode.java: 749)
  org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode (NameNode.java: 1446)
  引起的:java.net.BindException:不能分配请求的地址
  在sun.nio.ch.Net上。bind0(本地方法)
  sun.nio.ch.Net.bind (Net.java: 433)
  sun.nio.ch.Net.bind (Net.java: 425)
  sun.nio.ch.ServerSocketChannelImpl.bind (ServerSocketChannelImpl.java: 223)
  sun.nio.ch.ServerSocketAdaptor.bind (ServerSocketAdaptor.java: 74)
  org.mortbay.jetty.nio.SelectChannelConnector.open (SelectChannelConnector.java: 216)
  org.apache.hadoop.http.HttpServer2.openListeners (HttpServer2.java: 887)
  …8更多
  2018-04-15 org.apache.hadoop.metrics2.impl 00:08:44,414信息。MetricsSystemImpl:停止NameNode度量系统……
  2018-04-15 org.apache.hadoop.metrics2.impl 00:08:44,415信息。MetricsSystemImpl: NameNode度量系统停止。 
  

2018-04-15 org.apache.hadoop.metrics2.impl 00:08:44,415信息。MetricsSystemImpl: NameNode度量系统关闭完成。
2018-04-15 00:08:44,415致命org.apache.hadoop.hdfs.server.namenode.NameNode:未能开始namenode。

  
 <代码> java.net.BindException:港口使用:node11.cn: 9001
  org.apache.hadoop.http.HttpServer2.openListeners (HttpServer2.java: 892)
  org.apache.hadoop.http.HttpServer2.start (HttpServer2.java: 828)
  org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start (NameNodeHttpServer.java: 142)
  org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer (NameNode.java: 706)
  org.apache.hadoop.hdfs.server.namenode.NameNode.initialize (NameNode.java: 593)
  在org.apache.hadoop.hdfs.server.namenode.NameNode灵活;init> (NameNode.java: 765)
  在org.apache.hadoop.hdfs.server.namenode.NameNode灵活;init> (NameNode.java: 749)
  org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode (NameNode.java: 1446)
  null
  null
  null
  null
  null
  null
  null
  null
  null
  null
  null
  null
  null
  null
  null
  null
  null
  null

hadoop动态添加datanode启动失败的经验