A newbie note.<\/p>\n
I got this while running a streaming job:<\/p>\n
12\/06\/26 05:43:05 ERROR streaming.StreamJob: Error Launching job : java.io.IOException: java.lang.NullPointerException
\nat org.apache.hadoop.mapred.QueueManager.getQueueACL(QueueManager.java:382)
\nat org.apache.hadoop.mapred.JobTracker.getQueueAdmins(JobTracker.java:4444)
\nat sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
\nat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
\nat java.lang.reflect.Method.invoke(Method.java:597)
\nat org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
\nat org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1434)
\nat org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1430)
\nat java.security.AccessController.doPrivileged(Native Method)
\nat javax.security.auth.Subject.doAs(Subject.java:396)
\nat org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
\nat org.apache.hadoop.ipc.Server$Handler.run(Server.java:1428)<\/p>\n
Turned out it’s an ACL problem. Running “hadoop queue -showacls” gives me the list of queues that I have access, then relaunch the task with:<\/p>\n
hadoop jar $HADOOP_HOME\/contrib\/streaming\/hadoop-streaming-0.20.2-cdh3u1.jar \\
\n-Dmapred.job.queue.name=queue_i_have_access \\
\n….<\/p>\n
and everything runs smootly.<\/p>\n
I will post more newbie comments here.<\/p>\n","protected":false},"excerpt":{"rendered":"
A newbie note. I got this while running a streaming job: 12\/06\/26 05:43:05 ERROR streaming.StreamJob: Error Launching job : java.io.IOException: java.lang.NullPointerException at org.apache.hadoop.mapred.QueueManager.getQueueACL(QueueManager.java:382) at org.apache.hadoop.mapred.JobTracker.getQueueAdmins(JobTracker.java:4444) at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1434) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1430) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1428) Turned out it’s an ACL problem. Running “hadoop […]<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[186,230,347,346],"_links":{"self":[{"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/posts\/1358"}],"collection":[{"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/comments?post=1358"}],"version-history":[{"count":1,"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/posts\/1358\/revisions"}],"predecessor-version":[{"id":1359,"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/posts\/1358\/revisions\/1359"}],"wp:attachment":[{"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/media?parent=1358"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/categories?post=1358"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/xiehang.com\/blog\/wp-json\/wp\/v2\/tags?post=1358"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}