Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hitesh Shah <hit...@apache.org>
Subject Re: Tez taskcount log visualization
Date Mon, 27 Apr 2015 15:19:16 GMT
As a general point for other users, although this is not fully supported, you can try running
0.5.3 with the ATS history logging enabled and then setup the UI using the 0.6 build with
the UI configured to point to the ATS server. 
Almost all of the required data published to ATS should be in the 0.5 branch so the UI should
likely work for the most part. 

Unfortunately, in your case, you are running hadoop-2.3 and timeline/ATS support was introduced
in hadoop 2.4 so the above will not work for you.

thanks
 Hitesh

On Apr 27, 2015, at 2:50 AM, r7raul1984@163.com wrote:

> Thank you!  Ummm....Firstlly , I should upgrade my hadoop2.3.0 cluster to hadoop 2.6.0
and hive 1.1.0 to use tez 0.60......    But hive docs say support tez0.52....
> 
> r7raul1984@163.com
>  
> From: Rajesh Balamohan
> Date: 2015-04-27 14:28
> To: user
> Subject: Re: Tez taskcount log visualization
> Significant amount of effort has gone in building Tez-UI which is part of tez-0.6.  If
you could make use tez-0.6, you can view DAG, Task, Task Attempt level counters in Tez-UI
itself.  Tez-UI is very helpful for admin, dev, perf as well.
> 
> Tez UI relies on ATS data; You might want to setup ATS serve (http://tez.apache.org/tez-ui.html)
> 
> ~Rajesh.B
> 
> On Mon, Apr 27, 2015 at 11:16 AM, r7raul1984@163.com <r7raul1984@163.com> wrote:
> 
> Is there a tool can visualize the task count log? Tez UI ??But my enviroment is hadoop2.3
hive 1.1.0 tez 0.53.
> r7raul1984@163.com
> 
> 
> 
> -- 
> ~Rajesh.B


Mime
View raw message