`
lymyun
  • 浏览: 906 次
最近访客 更多访客>>
文章分类
社区版块
存档分类
最新评论

hadoop验证map/reduce失败,ERROR security.UserGroupInformation: PriviledgedAc

 
阅读更多
在 hadoop2集群  master1上, 执行 HADOOP自带的例子, wordcount 包,命令如下
cd /usr/local/hadoop/hadoop-2.0.2-alpha/share/hadoop/mapreduce
hadoop jar hadoop-mapreduce-examples-2.0.2-alpha.jar wordcount hdfs://192.168.1.33:9000/input hdfs://192.168.1.33:9000/output
出现错误:
13/06/24 05:48:06 ERROR security.UserGroupInformation: PriviledgedActionException as:hadoop (auth:SIMPLE) cause:java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
        at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:121)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:83)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:76)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1188)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1184)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1367)
        at org.apache.hadoop.mapreduce.Job.connect(Job.java:1183)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1212)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1236)
        at org.apache.hadoop.examples.WordCount.main(WordCount.java:84)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
        at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
但是我通过start-all.sh启动之后,jps查看 master机器上:ResourceManager和NameNode都已启动,slave机器上NodeManager和DataNode也已经启动了,查看启动日志均无报错,但是验证map/reduce时就报这个错误,请指点迷津,不胜感谢
分享到:
评论

相关推荐

    Windows平台下Hadoop的Map/Reduce开发

    讲述了Windows平台的Hadoop安装... 最后,以最简单的求和为例,剖析Hadoop的Map/Reduce工作机制,对于初学Hadoop及Map/Reduce的读者有很大的帮助。相信通过最简单的求和为例,读者可步入Hadoop的Map/Reduce开发者行列。

    hadoop中map/reduce

    hadoop中map/reduce自学资料合集

    hadoop-core-1.1.1.jar

    12/04/24 15:32:44 ERROR security.UserGroupInformation: PriviledgedActionException as:Administrator cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-Administrator\mapred\...

    hadoop-native-lib-x64-2.7.3.tar.gz

    hadoop 2.7.3 的本地接口库,snappy 使用的是1.1.3版本。使用时直接把包解压后放到$HADOOP_HOME/lib/native目录下即可。 [root@pseudo ~]# hadoop checknative -a 17/09/11 14:30:49 WARN bzip2.Bzip2Factory: ...

    hadoop-2.2.0.tar.gz 64位 part1 hadoop源码包编译为linux64位版本

    本人经过4个小时顺利将hadoop官方的32位编译为64位,通过测试可用,方便在64位linux安装hadoop的用户使用,编译时间很长,也很苦啊,解决了很多报错的问题,所以分多要一点,还望理解! 注:*****因为本人CSDN等级...

    org.apache.hadoop.ipc.Client: Retrying connect to server

    NULL 博文链接:https://ouyida3.iteye.com/blog/1144326

    Hadoop 源代码分析 [完整版]

    109页pdf。 Google 的核心竞争技术是它的计算平台。Google 的大牛们用了下面 5 篇文章,介绉了它们的计算设施。...径快,Apache 上就出现了一个类似的解决方案,目前它们都属亍 Apache 的 Hadoop 项目

    HDFS上传文件报错org.apache.hadoop.fs.ChecksumException: Checksum error: file:/hyk/data/hyk.txt

    当从本地上传文件到HDFS中...org.apache.hadoop.fs.ChecksumException: Checksum error: file:/hyk/data/hyk.txt [root@node01 data]# hadoop fs -put hyk.txt /hyk/test 20/02/18 12:54:39 INFO fs.FSInputChecker: Fo

    hadoop-2.6.0-hadoop.dll-winutils.exe

     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)  at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)  at org.apache.hadoop.mapreduce.Job....

    hadoop 2.7.6 eclipse插件

    18/05/25 19:51:49 INFO mapreduce.Job: map 0% reduce 0% 18/05/25 19:52:20 INFO mapreduce.Job: map 100% reduce 0% 18/05/25 19:52:29 INFO mapreduce.Job: map 100% reduce 100% 18/05/25 19:52:31 INFO ...

    Hadoop源码分析完整版

    Google的核心竞争技术是它的计算平台。Google的大牛们用了下面5篇文章,介绉了它们的计算设施。... HDFS作为一个分布式文件系统,是所有返...由亍Hadoop的HDFS和MapReduce是同一个项目,我们就把他们放在一块,进行分析。

    hadoop之map/reduce

    hadoop开发文档

    hadoop-core-0.20.2-cdh3u3.jar

    export CLASSPATH="$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:${HADOOP_HOME}/lib/commons-logging-1.0.4.jar:${HADOOP_HOME}/lib/guava-r09-jarjar.jar:${HADOOP_HOME}/hadoop-core-0.20.2-cdh3u3.jar:/usr/...

    jdk7+ubuntu14.04_32位下编译的hadoop2.6.0的libhadoop.so.1.0.0

    jdk7+ubuntu14.04_32位下编译的hadoop2.6.0的libhadoop.so.1.0.0 hadoop-2.6.0 默认系统是64位的,要想在32位系统下运行需重新编译 这个是编译好的文件(注意环境),替换hadoop-2.6.0/lib/native/libhadoop.so....

    hadoop-core-1.2.1.jar

    解决windows下远程调试hadoop权限问题( ERROR security.UserGroupInformation: PriviledgedActionException as:Administrator cause:java.io.IOException: Failed to set permissions of path:)重新编译了hadoop-...

    winutils.exe:解决hadoop在windows运行出现的bug

    如果出现如下bug:“Could not locate executable null\bin\winutils.exe in the Hadoop binaries”,则下载该文件,放入hadoop的bin文件夹下,并设置环境变量HADOOP_HOME:F:\hadoop2.7.x即可。

    大数据hadoop winutils.exe

    支持windows开发hadoop的连接,解决报警Did not find winutils.exe: java.io.FileNotFoundException

    Hadoop集群搭建

    Hadoop集群搭建: 1.CentOS 6.7 minimal http://mirror.neu.edu.cn/centos/6.7/isos/x86_64/CentOS-6.7-x86_64-minimal.iso 2.Hadoop 2.6.3 ...

    hadoop常见问题及解决办法

    在网上搜集的以及本人自己总结的hadoop集群常见问题及解决办法,融合了网上常常搜到的一些文档以及个人自己的经验。

Global site tag (gtag.js) - Google Analytics