Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gopal V <gop...@apache.org>
Subject Re: Task count
Date Thu, 24 Jul 2014 05:40:00 GMT
On 7/23/14, 6:07 PM, Johannes Zillmann wrote:
> Hey Tez team,
>
> is there some way to get the task count within a vertex from within a task ?
> Some equivalent to mapred.map.tasks and mapred.reduce.tasks for map-reduce ?

Could you explain the use-case for this particular requirement?

I intend to add the vertex parallelism to the task context as part of 
one of my WIP branches.

I uploaded my base patch-set as is (including the TODO markers).

https://issues.apache.org/jira/secure/attachment/12657536/TEZ-broadcast-shuffle%2Bvertex-parallelism.patch

If you can explain what you are actually looking to do with this 
information, perhaps I can roll the two feature reqs together.

Cheers,
Gopal


Mime
View raw message