Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Sprague <sprag...@gmail.com>
Subject tez + union stmt
Date Sat, 24 Dec 2016 18:38:41 GMT
all,

i'm running tez with the sql pattern:

    * create table foo as select * from (select... UNION select... UNION
select...)

in the logs the final step is this:

    * Moving data to directory hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4
from hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/.hive-staging_hive_2016-12-24_10-05-40_048_4896412314807355668-899/-ext-10002


when querying the table i got zero rows returned which made me curious. so
i queried the hdfs location and see this:

  $ hdfs dfs -ls hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4

  Found 3 items
  drwxrwxrwx   - dwr supergroup          0 2016-12-24 10:05 hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4/1
  drwxrwxrwx   - dwr supergroup          0 2016-12-24 10:06 hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4/2
  drwxrwxrwx   - dwr supergroup          0 2016-12-24 10:06 hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4/3

and yes the data files are under these three dirs.

so i ask... i'm not used to seeing sub-directories under the tablename
unless the table is partitioned. is this legit? might there be some config
settings i need to set to see this data via sql?

thanks,
Stephen.

Mime
View raw message