Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bikas Saha <bi...@hortonworks.com>
Subject RE: Error when submit a hbase rowcounter job on Tez
Date Tue, 15 Jul 2014 16:29:38 GMT
What build of Tez and YARN are you using?



Bikas



*From:* 袁奎(震河) [mailto:zhenhe.yk@taobao.com]
*Sent:* Tuesday, July 15, 2014 1:15 AM
*To:* user@tez.incubator.apache.org
*Subject:* Error when submit a hbase rowcounter job on Tez



I deploy tez on my gateway,config the tea-site.xml as the  Install/Deploy
Instructions <http://tez.incubator.apache.org/install.html>



command:

            hadoop jar ~/hbase/hbase.jar rowcounter table_name



then I submit a rowcounter job, it fails as below.



I have no idea what’s wrong, anyone have any idea?



-----------------------------------------------------------

14/07/15 16:10:49 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1404997729523_0326

14/07/15 16:10:49 INFO client.YARNRunner: Number of stages: 1

14/07/15 16:10:49 INFO client.TezClient: Submitting DAG to YARN,
applicationId=application_1404997729523_0326

14/07/15 16:10:49 INFO impl.YarnClientImpl: Submitted application
application_1404997729523_0326 to ResourceManager at r101072037.sqa.zmf/
10.101.72.37:18040

14/07/15 16:10:49 INFO client.RMProxy: Connecting to ResourceManager at
r101072037.sqa.zmf/10.101.72.37:18040

14/07/15 16:10:49 INFO client.RMProxy: Connecting to ResourceManager at
r101072037.sqa.zmf/10.101.72.37:18040

14/07/15 16:10:49 INFO mapreduce.Job: The url to track the job:
r101072037.sqa.zmf:18088/proxy/application_1404997729523_0326/

14/07/15 16:10:49 INFO mapreduce.Job: Running job: job_1404997729523_0326

14/07/15 16:10:55 INFO mapreduce.Job: Job job_1404997729523_0326 running in
uber mode : false

14/07/15 16:10:55 INFO mapreduce.Job:  map 0% reduce 0%

14/07/15 16:11:03 INFO mapreduce.Job: Job job_1404997729523_0326 failed
with state FAILED due to: Vertex failed, vertexName=initialmap,
vertexId=vertex_1404997729523_0326_1_00, diagnostics=[Task failed,
taskId=task_1404997729523_0326_1_00_000000,
diagnostics=[AttemptID:attempt_1404997729523_0326_1_00_000000_0
Info:Container launch failed for container_1404997729523_0326_01_000004 :
java.lang.NullPointerException

        at
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy.getProxy(ContainerManagementProtocolProxy.java:115)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl.getCMProxy(ContainerLauncherImpl.java:352)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:148)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:379)

        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:744)



Container released by application,
AttemptID:attempt_1404997729523_0326_1_00_000000_1 Info:Container launch
failed for container_1404997729523_0326_01_000007 :
java.lang.NullPointerException

        at
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy.getProxy(ContainerManagementProtocolProxy.java:115)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl.getCMProxy(ContainerLauncherImpl.java:352)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:148)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:379)

        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:744)



Container released by application,
AttemptID:attempt_1404997729523_0326_1_00_000000_2 Info:Container launch
failed for container_1404997729523_0326_01_000012 :
java.lang.NullPointerException

        at
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy.getProxy(ContainerManagementProtocolProxy.java:115)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl.getCMProxy(ContainerLauncherImpl.java:352)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:148)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:379)

        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:744)



Container released by application,
AttemptID:attempt_1404997729523_0326_1_00_000000_3 Info:Container launch
failed for container_1404997729523_0326_01_000017 :
java.lang.NullPointerException

        at
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy.getProxy(ContainerManagementProtocolProxy.java:115)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl.getCMProxy(ContainerLauncherImpl.java:352)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:148)

        at
org.apache.tez.dag.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:379)

        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:744)

], Vertex failed as one or more tasks failed. failedTasks:1]. DAG failed
due to vertex failure. failedVertices:1 killedVertices:0

14/07/15 16:11:03 INFO mapreduce.Job: Counters: 0

✉

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Mime
View raw message