Grokbase Groups Hive user April 2015

Search Discussions

88 discussions - 345 posts

  • The Apache Hive PMC has voted to make Mithun Radhakrishnan a committer on the Apache Hive Project. Please join me in congratulating Mithun. Thanks. - Carl
    Carl SteinbachCarl Steinbach
    Apr 14, 2015 at 9:56 pm
    Apr 16, 2015 at 5:57 pm
  • What will Hive do if querying an external table containing orc files that are still being written to? If the process writing the orc files exits without calling .close()? Sorry for taking the cheap ...
    Grant Overby (groverby)Grant Overby (groverby)
    Apr 14, 2015 at 6:48 pm
    Apr 15, 2015 at 5:18 pm
  • Hi Hive Users, I'm using Hive's 13th Cloudera version. I'm facing an issue while running any of the create statement. Other operations like DML and drop, alter are working fine. below is the sample ...
    Bhagwan S. SoniBhagwan S. Soni
    Apr 24, 2015 at 4:27 pm
    Apr 25, 2015 at 12:29 am
  • Hey Guys, I am see the following error when attempting to connect Hue to the hive metatstore: From hive-site.log 015-04-17 05:12:48,857 INFO [main]: metastore.HiveMetaStore ...
    Gary ClarkGary Clark
    Apr 17, 2015 at 4:27 pm
    Apr 17, 2015 at 7:05 pm
  • Hi All, I am new to Hive. Just set up a 5 nodes Hadoop environment and want to have a try on HiveQL. Is there any dataset I can download to play HiveQL. The dataset should have several tables some I ...
    Xiaohe lanXiaohe lan
    Apr 2, 2015 at 5:28 am
    Apr 15, 2015 at 1:46 pm
  • Hi, I'm implementing a tap to read Hive ORC ACID date into Cascading jobs and I've hit a couple of issues for a particular scenario. The case I have is when data has been written into a transactional ...
    Elliot WestElliot West
    Apr 29, 2015 at 4:42 pm
    May 18, 2015 at 10:08 am
  • Recently I found in the zookeeper log that there were too many client connections and it was hive that was establishing more and more connections. I modified the max client connection property in ...
    Shady XuShady Xu
    Apr 30, 2015 at 2:44 am
    May 7, 2015 at 3:31 am
  • Does the JAR need to be added for every session before using the custom UDF created using "CREATE FUNCTION"? I'm using Hive 0.13 and was able to add a custom UDF successfully and use it in a sample ...
    Buntu DevBuntu Dev
    Apr 24, 2015 at 2:37 am
    Apr 24, 2015 at 9:20 am
  • I have a Storm Trident Bolt for writing ORC File. The files are created; however, they are always zero length. This code eventually causes an OOME. I suspect I am missing some sort of flushing ...
    Grant Overby (groverby)Grant Overby (groverby)
    Apr 7, 2015 at 3:43 pm
    Apr 7, 2015 at 6:09 pm
  • Hello <span class="m_body_email_addr" title="d98685a90d9543c52703799da3a2508b"</span I have about 100 TB of data, approximately 180 billion events, in my HDFS cluster. It is my ...
    Kjell Tore FossbakkKjell Tore Fossbakk
    Apr 22, 2015 at 12:53 pm
    Apr 23, 2015 at 3:49 pm
  • My understanding is that the Optimized Row Columnar (ORC) file format provides a highly efficient way to store Hive data. In a ...
    Mich TalebzadehMich Talebzadeh
    Apr 19, 2015 at 7:33 pm
    Apr 20, 2015 at 5:43 pm
  • Hello Hive, I'm a developer using Hive to process TB level data, and I'm having some difficulty loading the data to table. I have 2 tables now: -- table_1: CREATE EXTERNAL TABLE `table_1`( `keyword` ...
    Tianqi TongTianqi Tong
    Apr 9, 2015 at 5:36 pm
    Apr 17, 2015 at 11:15 pm
  • Hello, How can I stop hiveserver2? I am not able to find the command. Thanks ******************************* This e-mail contains information for the intended recipient only. It may contain ...
    CHEBARO AbdallahCHEBARO Abdallah
    Apr 29, 2015 at 10:57 am
    Apr 29, 2015 at 7:29 pm
  • hi, Guys, I am working on directly READ ORC files from HDFS cluster, and hopefully to leverage HDFS local shortcuit READ ( ...
    Demai NiDemai Ni
    Apr 24, 2015 at 9:46 pm
    Apr 28, 2015 at 6:29 pm
  • Hi gurus, Kindly help me understand the advantage that Impala has over Hive. I read a note that Impala does not use MapReduce engine and is therefore very fast for queries compared to Hive. However, ...
    Ashok KumarAshok Kumar
    Apr 27, 2015 at 8:49 am
    Apr 27, 2015 at 3:31 pm
  • Hi, How to set the configuration hive-site.xml to automatically merge small orc file (output from mapreduce job) in hive 0.14 ? This is my current configuration <property <name ...
    Apr 20, 2015 at 3:30 pm
    Apr 21, 2015 at 12:33 pm
  • Hi there, We've been encountering the exception Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveFatalException: [Error 20004]: Fatal error occurred when node tried to create ...
    Daniel HarperDaniel Harper
    Apr 15, 2015 at 3:49 pm
    Apr 20, 2015 at 2:46 pm
  • I'm having major trouble finding documentation on hive functions isNull and isNotNull. At first I was assuming the function just wasn't available, now I believe these functions are not documented. I ...
    Moore, DouglasMoore, Douglas
    Apr 17, 2015 at 9:23 pm
    Apr 19, 2015 at 12:32 am
  • Hi , We have a scenario to update a table from different set of tables for which we are using hive 0.14.Here are the steps that we are following 1.Parent table is ORC table with ACID property ...
    Nitinpathakala .Nitinpathakala .
    Apr 23, 2015 at 4:15 pm
    May 8, 2015 at 8:51 pm
  • Hi, I am doing a few map side joins in one query to load an user facing ORC table in order to denormalize. Two of the tables I am joining too are pretty large. I am setting ...
    Abe WeinogradAbe Weinograd
    Apr 30, 2015 at 2:02 pm
    Apr 30, 2015 at 5:59 pm
  • Hi All, Can experts share your view on Hive behaviour in below scenario. I am facing below issue on using alter partition locations in hive. *select count(*) from table1 where dt = 201501;* *Total ...
    Harsha NHarsha N
    Apr 30, 2015 at 6:24 am
    Apr 30, 2015 at 2:17 pm
  • Hi, Is there anyone using hortonworks sandbox 2.2? I am trying to use hive on Tez on the sandbox. I set the running engine in hive-site.xml to Tez. <property <name hive.execution.engine</name <value ...
    Apr 24, 2015 at 7:33 am
    Apr 24, 2015 at 11:37 am
  • Hi, I have got complex schema with thousands of inner fields. Most of fields are empty and i would like to display only nonnull fields in results for each query. Is it possible to modify way the ...
    Lukas NalezenecLukas Nalezenec
    Apr 23, 2015 at 3:04 pm
    Apr 24, 2015 at 11:00 am
  • Hi experts I am trying to use an UDF (I have already put that in the metastore using CREATE FUNCTION) as following. select count(FindPattern(s_sitename)) AS testcol from weblogs; However, when I ...
    Xiaoyong ZhuXiaoyong Zhu
    Apr 17, 2015 at 1:45 pm
    Apr 22, 2015 at 12:11 am
  • I need mapreduce program in java for this input and output.... plz help
    Shanthi kShanthi k
    Apr 18, 2015 at 10:09 pm
    Apr 19, 2015 at 2:35 am
  • Is it possible to customize the schema user logs on to? I was thinking of setting some bash environment variable or setting param file (like, hiverc or hive-site.xml…)?
    Apr 14, 2015 at 8:31 pm
    Apr 14, 2015 at 11:08 pm
  • Hi, Today I have noticed the following issue. A simple insert into a table is sting there throwing the following hive insert into table mytest values(1,'test'); Query ID = ...
    Mich TalebzadehMich Talebzadeh
    Apr 7, 2015 at 9:11 pm
    Apr 8, 2015 at 5:36 pm
  • Hi, I turned on concurrency for hive for DML with settings in hive-site.xml as follows: hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager ...
    Mich TalebzadehMich Talebzadeh
    Apr 6, 2015 at 1:53 pm
    Apr 7, 2015 at 7:11 am
  • I have a dumb question on DDL statement "create database" Say if I create a database CREATE DATABASE abcLOCATION '/my/preferred/directory'; When later on someone needs to create a table in this ...
    Chen SongChen Song
    Apr 2, 2015 at 3:17 pm
    Apr 2, 2015 at 9:07 pm
  • Hi all, Could I get edit access to the hive wiki in order to update the hive/hbase integration docs ( Specifically I'd like to: 1 ...
    Andrew MainsAndrew Mains
    Apr 30, 2015 at 11:07 pm
    Apr 30, 2015 at 11:28 pm
  • Hi Everyone Lets say I have hive table in 2 datacenters. Table format can be textfile or Orc. There is scoop job running every day which adds data to the table. Each datacenter has its own instance ...
    Alexander PivovarovAlexander Pivovarov
    Apr 27, 2015 at 8:27 pm
    Apr 27, 2015 at 9:24 pm
  • We have a UDF to collect some counts during Hive execution. It has been working fine until tez is enabled. A bit digging shows that GenericUDF#configure method was not called. So in this case, is it ...
    Frank LuoFrank Luo
    Apr 22, 2015 at 4:02 am
    Apr 24, 2015 at 7:04 pm
  • Hi, One of my users tried to run an HUGE join, which failed due to a lack of space in HDFS. This has resulted in a large amount of data remaining in the Hive scratch directory which I need to clear ...
    Martin BensonMartin Benson
    Apr 20, 2015 at 5:06 pm
    Apr 24, 2015 at 3:41 pm
  • Hi, I'm loading data to a Parquet table with dynamic partitons. I have 40k+ partitions, and I have skipped the partition stats computation step. Somehow it's still exetremely slow loading data into ...
    Tianqi TongTianqi Tong
    Apr 15, 2015 at 9:58 pm
    Apr 16, 2015 at 6:58 pm
  • Greeting all, Glad to join the user group. I am from DBA background Oracle/Sybase/MSSQL. I would like to understand partition and bucketing in Hive and the difference between. Shall be grateful if ...
    Ashok KumarAshok Kumar
    Apr 10, 2015 at 4:52 pm
    Apr 15, 2015 at 3:02 am
  • My tez query seems to error out. I have a map join in which the smaller tables together are 200 MB and trying to have one block of main table be processed by one tez task. Using the following formula ...
    P lvaP lva
    Apr 5, 2015 at 6:25 pm
    Apr 11, 2015 at 4:48 am
  • How to config high availability support for Hive metastore? How to config high availability support for Hiveserver2? <span class="m_body_email_addr" title="7b4f49e505a0ae0d0f8909225c673b11" ...
    Apr 10, 2015 at 2:25 am
    Apr 10, 2015 at 7:03 pm
  • Hi, I have a hive table with 300 columns that are all strings with around 180k rows, when I run analyze table compute statistics it seems to be taking about 40 minutes to complete regardless of the ...
    Roger MarinRoger Marin
    Apr 8, 2015 at 1:00 am
    Apr 8, 2015 at 9:59 pm
  • Hello , I have a issue on hive , with tez engine . When try to execute a query , with tez engine , the query is 9 times slower than map/reduce . The query is a left outer join on two table using orc ...
    Erwan MASErwan MAS
    Apr 2, 2015 at 4:04 pm
    Apr 7, 2015 at 1:23 am
  • Hello! I would like to do a LEFT JOIN LATERAL .. Which is using values on the LHS as parameters on the RHS. Is this sort of thing possible in Hive? -JD ---- Some example SQL: create table lhs ( ...
    Jeremy DavisJeremy Davis
    Apr 4, 2015 at 11:09 pm
    Apr 6, 2015 at 1:13 am
  • Hi, I'm a relatively new user to Hive and was trying to format a column of String datatype from Uppercase to Camel-case. I could see the INITCAP() function in the language manual, and also could find ...
    Vivek veeramaniVivek veeramani
    Apr 1, 2015 at 12:56 pm
    Apr 1, 2015 at 9:04 pm
  • Hi ALL: I have develop three UDF and compile them in one jar. Hive Explainn one udf to antother class Dump INFO as Follow: Hive explain userlost-- shiftAct(), but the return type is boolean, the ...
    Apr 30, 2015 at 7:35 am
    May 1, 2015 at 2:14 pm
  • Hi, I have parquet files that are the product of map-reduce job. I have used AvroParquetOutputFormat in order to produce them, so I have an avro schema file describing the structure of the data. When ...
    Yosi BotzerYosi Botzer
    Apr 29, 2015 at 3:50 pm
    Apr 29, 2015 at 5:24 pm
  • Hi all, Trying to do a direct load from RDBMS to Hive (not using Sqoop). It sends data in files of 9999 rows at a time. Concurrency is enabled. Using Oracle database as metastore. Out of 300,000 rows ...
    Mich TalebzadehMich Talebzadeh
    Apr 23, 2015 at 3:22 pm
    Apr 23, 2015 at 4:45 pm
  • Hi All, I went through below mentioned Facebook engineering page, -optimization-in-apache-hive/470667928919 I set following for auto ...
    Harsha HNHarsha HN
    Apr 16, 2015 at 6:40 am
    Apr 22, 2015 at 7:14 am
  • Hi there, in Hive 0.13.0, I am trying to create a table that should be bucketed by a structured field: CREATE TABLE foo (bar struct<a:string,b:string ) CLUSTERED BY (bar.a) INTO 32 buckets ...
    Michael HäuslerMichael Häusler
    Apr 17, 2015 at 4:37 pm
    Apr 17, 2015 at 7:22 pm
  • Hi All, I'm using CDH 5.3.2 and i use sqoop to load data into hive tables. last statement of the sqoop import shows stats log which always shows [numFiles=<some numbers ,,numRows=0], am i missing any ...
    Suresh Kumar SethuramaswamySuresh Kumar Sethuramaswamy
    Apr 17, 2015 at 3:47 pm
    Apr 17, 2015 at 4:14 pm
  • I'm getting an error in Hive when executing a query on a table in ORC format. After several trials, I succeeded to run the same query on the same table in TEXTFILE format. I 've been able to ...
    Verhaeghe PhilippeVerhaeghe Philippe
    Apr 13, 2015 at 12:29 pm
    Apr 13, 2015 at 2:56 pm
  • Hi, I hit the following error when running a CTAS statment. Looks like a hdfs permission issue since the temp file can not be renamed. Maybe I miss setting some property? my hive version is 0.14.0 ...
    Jie ZhangJie Zhang
    Apr 11, 2015 at 6:08 pm
    Apr 11, 2015 at 10:52 pm
  • It seems that the link (Class TaskController< ) is wrong in this page ...
    Xiaoyong ZhuXiaoyong Zhu
    Apr 7, 2015 at 4:48 am
    Apr 7, 2015 at 5:50 am
Group Navigation
period‹ prev | Apr 2015 | next ›
Group Overview
groupuser @
categorieshive, hadoop

115 users for April 2015

Mich Talebzadeh: 32 posts Gopal Vijayaraghavan: 17 posts Lefty Leverenz: 14 posts Grant Overby (groverby): 12 posts Alan Gates: 10 posts Eugene Koifman: 9 posts @Sanjiv Singh: 9 posts Daniel Haviv: 8 posts Gary Clark: 7 posts Alexander Pivovarov: 6 posts Bhagwan S. Soni: 6 posts Moore, Douglas: 6 posts Patcharee: 6 posts Xiaoyong Zhu: 6 posts Edward Capriolo: 5 posts Abe Weinograd: 4 posts Andrew Mains: 4 posts Buntu Dev: 4 posts Elliot West: 4 posts Harsha HN: 4 posts
show more