Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yogendra reddy <yogendra...@gmail.com>
Subject Re: Tez job configuration file
Date Thu, 16 Apr 2015 06:00:26 GMT
Thanks for the info.
This is for telemetry use case wherein I would like to categorize if a hive
job is run on mr or tez.  I was actually looking for hive.execution.engine
property in determining this and I could do this for mr since it emits
configuration file per job but looks like this is not the case in tez
can you let me know the parameter which controls the physical storage of
dag plan?

On Thu, Apr 16, 2015 at 11:03 AM, Jianfeng (Jeff) Zhang <
jzhang@hortonworks.com> wrote:

>
>  Hi Yogendra,
>
>  There’s no job-conf.xml in tez. In tez the configuration is associated
> with Input/Output/Processor, You can get these configuration through ATS
>
>  Please check the dag info by looking at
> http://localhost:8188/ws/v1/timeline/TEZ_DAG_ID/
> <http://localhost:8188/ws/v1/timeline/TEZ_DAG_ID/dag_1428458161048_0057_1>
> [YOUR_DAG_ID]
> It has the dagPlan info where you can see userPayloadAsText which
> contains the configuration.
>
>  BTW, what’s your purpose for checking the configuration ? For
> performance analysis ?
>
>
>  Best Regard,
> Jeff Zhang
>
>
>   From: yogendra reddy <yogendra.60@gmail.com>
> Reply-To: "user@tez.apache.org" <user@tez.apache.org>
> Date: Thursday, April 16, 2015 at 12:24 PM
> To: "user@tez.apache.org" <user@tez.apache.org>
> Subject: Tez job configuration file
>
>   mapreduce stores job-conf.xml for each job run in
> mapreduce.jobhistory.done-dir. Is there a similar file for tez job. If yes,
> where is this stored?
>
>  Thanks,
> Yogendra
>

Mime
View raw message