Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Madhusudan Ramanna <m.rama...@ymail.com>
Subject Re: Zip Exception since commit da4098b9
Date Wed, 28 Sep 2016 05:42:17 GMT
So I downloaded Tez commit 91a397b0ba and built the dist package.  We're not seeing the zip
exception anymore.
However, now Tez UI is completely broken. Not at all sure what is happening here. Please see
attached screenshots.

2016-09-28 05:11:40,903 [INFO] [main] |web.WebUIService|: Tez UI History URL: http://dev-cv2.aws:8080/tez-ui/#/tez-app/application_1475014682883_0027
2016-09-28 05:11:40,908 [INFO] [main] |history.HistoryEventHandler|: Initializing HistoryEventHandler
withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService
2016-09-28 05:11:41,474 [INFO] [main] |impl.TimelineClientImpl|: Timeline service address:
http://ts-ip.aws:8188/ws/v1/timeline/
2016-09-28 05:11:41,474 [INFO] [main] |ats.ATSHistoryLoggingService|: Initializing ATSHistoryLoggingService
with maxEventsPerBatch=5, maxPollingTime(ms)=10, waitTimeForShutdown(ms)=-1, TimelineACLManagerClass=org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager
2016-09-28 05:11:41,644 [INFO] [main] |impl.TimelineClientImpl|: Timeline service address:
http://ts-ip.aws:8188/ws/v1/timeline/

>>> DAG Execution
2016-09-28 05:11:52,779 [INFO] [IPC Server handler 0 on 44039] |history.HistoryEventHandler|:
[HISTORY][DAG:dag_1475014682883_0027_1][Event:DAG_SUBMITTED]: dagID=dag_1475014682883_0027_1,
submitTime=1475039511185

Timeline server is up and running. Tez UI is however not able to display DAG and other details 
thanks,Madhu


    On Saturday, September 24, 2016 12:01 PM, Hitesh Shah <hitesh@apache.org> wrote:
 

 tez-dist tar balls are not published to maven today - only the module specific jars are.
But yes, you could just try a local build to see if you can reproduce the issue with the commit
in question. 

— Hitesh


> On Sep 23, 2016, at 6:23 PM, Madhusudan Ramanna <m.ramanna@ymail.com> wrote:
> 
> Hitesh and Zhiyuan,
> 
> Apache snapshots doesn't seem to have tez-dist 
> 
> http://repository.apache.org/content/groups/snapshots/org/apache/tez/tez-dist/
> 
> The last one seems to be 0.2.0-SNAPSHOT
> 
> Should I just download based on the commit and recompile ? 
> 
> thanks,
> Madhu
> 
> 
> On Friday, September 23, 2016 5:19 PM, Hitesh Shah <hitesh@apache.org> wrote:
> 
> 
> Hello Madhusudan,
> 
> If you look at the MANIFEST.MF inside any of the tez jars, it will provide the commit
hash via the SCM-Revision field.
> 
> The tez client and the DAGAppMaster also log this info at runtime.
> 
> — Hitesh 
> 
> > On Sep 23, 2016, at 4:08 PM, Madhusudan Ramanna <m.ramanna@ymail.com> wrote:
> > 
> > Zhiyuan,
> > 
> > We just pulled down the latest snapshot from Apache repository.  Question, is how
can I figure out branch and commit information from the snapshot artifact ?
> > 
> > thanks,
> > Madhu
> > 
> > 
> > On Friday, September 23, 2016 10:38 AM, zhiyuan yang <sjtu.yzy@gmail.com>
wrote:
> > 
> > 
> > Hi Madhu,
> > 
> > It looks like a Inflater-Deflater mismatch to me. From stack traces I see you cherry-picked
this patch instead of using master branch.
> > Would you mind double check whether the patch is correctly cherry-picked?
> > 
> > Thanks!
> > Zhiyuan
> > 
> >> On Sep 23, 2016, at 10:21 AM, Madhusudan Ramanna <m.ramanna@ymail.com>
wrote:
> >> 
> >> Hello,
> >> 
> >> We're using the Apache snapshot repository to pull latest tez snapshots. 
> >> 
> >> We've started seeing this exception:
> >> 
> >> org.apache.tez.dag.api.TezUncheckedException: java.util.zip.ZipException: incorrect
header check
> >> at org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.handleVertexManagerEvent(ShuffleVertexManager.java:622)
> >> at org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.onVertexManagerEventReceived(ShuffleVertexManager.java:579)
> >> at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEventReceived.invoke(VertexManager.java:606)
> >> at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:647)
> >> at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:642)
> >> at java.security.AccessController.doPrivileged(Native Method)
> >> at javax.security.auth.Subject.doAs(Subject.java:422)
> >> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
> >> at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:642)
> >> at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:631)
> >> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> >> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> >> at java.lang.Thread.run(Thread.java:745)
> >> Caused by: java.util.zip.ZipException: incorrect header check
> >> at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:164)
> >> at java.io.FilterInputStream.read(FilterInputStream.java:107)
> >> at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1792)
> >> at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1769)
> >> at org.apache.commons.io.IOUtils.copy(IOUtils.java:1744)
> >> at org.apache.commons.io.IOUtils.toByteArray(IOUtils.java:462)
> >> 
> >> 
> >> since this commit
> >> 
> >> https://github.com/apache/tez/commit/da4098b9d6f72e6d4aacc1623622a0875408d2ba
> >> 
> >> 
> >> Wanted to bring this to your attention. For now we've locked the snapshot version
down.
> >> 
> >> thanks,
> >> Madhu
> > 
> > 
> > 
> 
> 


   
Mime
View raw message