Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gopal Vijayaraghavan <gop...@apache.org>
Subject Re: Tez job configuration file
Date Thu, 16 Apr 2015 10:05:46 GMT
Hi,

> This is for telemetry use case wherein I would like to categorize if a
>hive job is run on mr or tez.  I was actually looking for
>hive.execution.engine property in determining this


You are looking in the wrong place (and wrong list), if you want to look
at Hive query plans, the ATS data is written directly from Hivešs
ATSHook.java.

The information in that is in enough detail to not just indicate MR or
Tez, but it has deeper information about all tables scanned and all
columns read from each table.

For instance, if I look up one of my queries via a query-id

http://rmhost:8188/ws/v1/timeline/HIVE_QUERY_ID/gopal_20150318071409_1e0200
64-62b1-4ea6-8d57-fde4cddef57f

or lookup the latest one

http://rmhost:8188/ws/v1/timeline/HIVE_QUERY_ID/?limit=1

It should contain the following in JSON.

"TEZ":true,"STATUS":true,"MAPRED":false}

If you want more info on ATSHook, mail the hive user lists.

Cheers,
Gopal



Mime
View raw message