Search Discussions

75 discussions - 252 posts

  • Hello, I'm trying to test Hive with Tables including quite a lot of Columns. We are using the data from the KDD Cup 2009 based on anonymised real case dataset ...
    David GayouDavid Gayou
    Jan 28, 2014 at 11:21 am
    Feb 19, 2014 at 3:54 pm
  • The Apache Hive PMC has voted to make Sergey Shelukhin and Jason Dere committers on the Apache Hive Project. Please join me in congratulating Sergey and Jason! Thanks. Carl
    Carl SteinbachCarl Steinbach
    Jan 27, 2014 at 4:37 pm
    Jan 27, 2014 at 8:30 pm
  • The Apache Hive PMC has voted to make Vikram Dixit a committer on the Apache Hive Project. Please join me in congratulating Vikram! Thanks. Carl
    Carl SteinbachCarl Steinbach
    Jan 6, 2014 at 4:59 pm
    Jan 8, 2014 at 12:35 pm
  • One other benefit in rotating chairs is that it exposes more of Hive’s PMC members to the board and other Apache old timers. This is helpful in getting better integrated into Apache and becoming a ...
    Alan GatesAlan Gates
    Jan 3, 2014 at 11:43 pm
    Jan 19, 2014 at 7:50 pm
  • Hi, I am new to Hive, I am reading the doc which is available on Apache site and try to create a correlation between hadoop and Hive. so please help me to understand this: As per my understanding, ...
    Prashant Kumar - ERS, HCL TechPrashant Kumar - ERS, HCL Tech
    Jan 13, 2014 at 5:22 am
    Jan 13, 2014 at 4:29 pm
  • Hi, I have observed that DESCRIBE EXTENDED always shows number of rows to be zero despite the fact that the table has data. Is it a bug? Is it known ? Has anyone else also come across the same ? ...
    Haroon MuhammadHaroon Muhammad
    Jan 22, 2014 at 7:45 pm
    Feb 19, 2014 at 4:24 pm
  • Hi, I have a number of Hive jobs that run during a day. Each individual job is outputting data to Amazon S3. The Hive jobs use dynamic partitioning. The problem is that when different jobs need to ...
    Cosmin Cătălin SandaCosmin Cătălin Sanda
    Jan 28, 2014 at 11:52 pm
    Jan 29, 2014 at 10:17 am
  • Dear all, We are trying to pick the right data storage format for the Hive table with the following requirement and would really appreciate any insights you can provide to help our decision. 1 ...
    Thilina GunarathneThilina Gunarathne
    Jan 27, 2014 at 7:06 pm
    Jan 27, 2014 at 8:14 pm
  • All, I have installed Hive 0.10 in my system and am using postgres 9.3 installed locally as the metastore. When i try to create a table in Hive I get the following error. How can I get rid of this, ...
    Leena GuptaLeena Gupta
    Jan 17, 2014 at 12:18 am
    Jan 18, 2014 at 4:06 am
  • Hello Hive Champs, I have a case statement, where I need to check the date passed through parameter, If date is 1st date of the month then keep it as it as else set the parameter date to 1st date of ...
    Yogesh dhariYogesh dhari
    Jan 2, 2014 at 4:44 pm
    Jan 8, 2014 at 2:07 am
  • Guys, I am using storm to read data stream from our socket server, entry by entry, and then write them to file: one entry per file. At some point, i need to import the data into my hive table. There ...
    Chen WangChen Wang
    Jan 2, 2014 at 7:58 pm
    Jan 8, 2014 at 2:02 am
  • Hi, I am trying to load a data that is in JSON format to Hive table. Can any one suggest what is the method I need to follow? Thanks, Raj
    Raj HadoopRaj Hadoop
    Jan 6, 2014 at 5:41 pm
    Jan 7, 2014 at 10:04 pm
  • Hi, So I can see from http://hive.apache.org/downloads.html that I can download versions 11 and 12 and they will work with Hadoop 1.0.4 which I am currently using. So if I want to start stepping ...
    Peter MarronPeter Marron
    Jan 28, 2014 at 10:39 am
    Jan 28, 2014 at 11:50 pm
  • Hello. I just checked out the hive git repo and ran "mvn clean install" from the project root. It fails in module common in which the class HiveStringUtils tries to use the classes ...
    Thomas LarssonThomas Larsson
    Jan 28, 2014 at 7:37 am
    Jan 28, 2014 at 7:52 am
  • Hi, I have a table that is of the following format create table t1 ( f1 int, f2 array<struct<a1:int, a2:int ); Now I have a custom script that does some computation and generates the value for f2 ...
    Rohan mongaRohan monga
    Jan 13, 2014 at 11:29 pm
    Jan 21, 2014 at 5:16 am
  • Hi, I found lot of examples to map json data into hive complex data types (map, array , struct etc). But I don't see anywhere filling complex data types with nested sql query ( I.e group by few ...
    Bogala, Chandra ReddyBogala, Chandra Reddy
    Jan 17, 2014 at 5:40 am
    Jan 17, 2014 at 4:55 pm
  • The following is a an example for a GenericUDF. I wanted to test this through a Hive query. Basically want to pass parameters some thing like "select ComplexUDFExample('a','b','c') from employees ...
    Raj HadoopRaj Hadoop
    Jan 20, 2014 at 10:22 pm
    Feb 5, 2014 at 9:34 am
  • Hi, I am trying to enforce all Hive tables to be created with EXTERNAL. The way I am doing this is by making the location of the warehouse (/apps/hive/warehouse in my case) to have permissions 000 ...
    Alex NastetskyAlex Nastetsky
    Jan 30, 2014 at 4:28 pm
    Jan 31, 2014 at 3:17 pm
  • Hello Experts, I am trying to write a UDF to parse a logline and provide the output in the form of an array. Basically I want to be able to use LATERAL VIEW explode subsequently to make it into ...
    Sunita ArvindSunita Arvind
    Jan 29, 2014 at 11:09 pm
    Jan 30, 2014 at 11:09 pm
  • Hi, I have a case where I would like to extend Hive to use information from a regular RDBMS. To limit the complexity of the installation I thought I could piggyback on the already existing ...
    Petter von Dolwitz (Hem)Petter von Dolwitz (Hem)
    Jan 22, 2014 at 10:03 am
    Jan 27, 2014 at 4:26 am
  • Hello all, I am working with some existing hive tables and I am having trouble deleting partitions. I get the following error - hive alter table tbl drop partition(p_date='2014-01-22'); FAILED ...
    Prashant gokhalePrashant gokhale
    Jan 23, 2014 at 11:28 pm
    Jan 24, 2014 at 4:00 am
  • Hi, My requirement is to merge ( not concat ) two columns and count number of distinct records. I can use self-join on column A and column B and can count number of records. But looks not optimal way ...
    Bogala, Chandra ReddyBogala, Chandra Reddy
    Jan 8, 2014 at 12:20 pm
    Jan 23, 2014 at 4:24 pm
  • Hello, I'm trying to move a hive table to a different cluster. My table is partitioned. However when I use hive export-distcp-import, the partitions are reversed. /warehouse/db/table/a/b/c in old ...
    P lvaP lva
    Jan 15, 2014 at 6:26 pm
    Jan 17, 2014 at 1:21 am
  • My select does not return data? Any help? The example1 table is there.. hive SELECT COUNT(1) FROM example1; Total MapReduce jobs = 1 Launching Job 1 out of 1 Number of reduce tasks determined at ...
    Kennedy, Sean C.Kennedy, Sean C.
    Jan 14, 2014 at 6:37 pm
    Jan 14, 2014 at 7:18 pm
  • Hi All, Vectorization with ORCFile provides amazing performance. Does vectorization work with RCFile as well? As per explain plan of Hive 0.13 (snapshot), it does not use vectorization with RCFile ...
    Rajesh BalamohanRajesh Balamohan
    Jan 9, 2014 at 2:47 am
    Jan 10, 2014 at 6:35 pm
  • Hi all, Is they any utility/tool out there to inspect orc file? Thanks, Tongjie
    Tongjie ChenTongjie Chen
    Jan 6, 2014 at 11:47 pm
    Jan 7, 2014 at 11:27 am
  • Hi Experts, As per this link http://stackoverflow.com/questions/10276584/hive-table-partition-with-column-in-the-middle I understood that we can create the partitioned table when we have already a ...
    Kishore kumarKishore kumar
    Jan 7, 2014 at 9:13 am
    Jan 7, 2014 at 10:30 am
  • Hi, I have a managed Hive table, which contains only one 150MB file. I then do "select count(*) from tbl" to it, and it uses 2 mappers. I want to set it to a bigger number. First I tried 'set ...
    Ji ZhangJi Zhang
    Jan 2, 2014 at 7:57 am
    Jan 3, 2014 at 6:14 am
  • Hi all! I'm having a performance problem with quering data from hbase using hive. I use CDH 4.5 (hbase-0.94.6, hive-0.10.0 and hadoop-yarn-2.0.0) on a cluster of 10 hosts. Right now it stores 3 TB of ...
    Бородин ВладимирБородин Владимир
    Jan 30, 2014 at 1:32 pm
    Feb 7, 2014 at 3:11 pm
  • Hi, I'm running hive 0.12 on yarn and I'm trying to convert a common join into a map join. My map join fails and from the logs I can see that the memory limit is very low: Starting to launch local ...
    Avrilia FloratouAvrilia Floratou
    Jan 31, 2014 at 8:57 am
    Feb 3, 2014 at 10:35 am
  • Hi, Can someone help me how to delete duplicate records in Hive table, I know that delete and update are not supported by hive but still, if some know's some alternative can help me in this Thanks, ...
    Raj hadoopRaj hadoop
    Jan 30, 2014 at 9:49 am
    Jan 30, 2014 at 10:04 am
  • Hi all, I have a UDTF that returns fields from an XML/SerDe based table. So I have to return varying number of fields from the UDTF based on the number of xpath's in the query file. I am not sure how ...
    Kumar VKumar V
    Jan 29, 2014 at 3:22 pm
    Jan 29, 2014 at 3:49 pm
  • In SQL we have partion by and group by select deptno, count(*) c from emp group by deptno; DEPTNO C ------ - 10 3 20 5 30 6 select deptno, count(*) over (partition by deptno) c from emp; DEPTNO C ...
    Unmesha sreeveniUnmesha sreeveni
    Jan 29, 2014 at 10:42 am
    Jan 29, 2014 at 12:00 pm
  • Hi, We have a requirement to store a large data set (more than 5TB) mapped to a Hive table. This Hive table would be populated (and appended periodically) using a Hive query from another Hive table ...
    Thilina GunarathneThilina Gunarathne
    Jan 29, 2014 at 1:06 am
    Jan 29, 2014 at 2:37 am
  • Hi, I have a table where one column (ts) is of type TIMESTAMP. How am I supposed to use this in my query? The following attempt does not give me a result. SELECT * FROM mytable WHERE ts "2014-01-23 ...
    Petter von Dolwitz (Hem)Petter von Dolwitz (Hem)
    Jan 23, 2014 at 2:20 pm
    Jan 27, 2014 at 8:39 am
  • Hi, guys I upgrade hive 0.70 to hive 0.12.0 recently. We resolve some problems, but the one as follows puzzles me. We have thousands jobs every day and that will have about 40 this errors. I increase ...
    Jander gJander g
    Jan 23, 2014 at 3:23 am
    Jan 23, 2014 at 6:05 am
  • Hi, I would like to come up with a code which automatically formats your hql files. Because, formatting is one of the tedious task and i would like to come up with an utility for that. Please let me ...
    Pandees waranPandees waran
    Jan 22, 2014 at 4:23 am
    Jan 22, 2014 at 2:27 pm
  • write orcfile with compress CompressionKind.ZLIB or CompressionKind.SNAPPY occur exception:(CompressionKind.NONE is ok) Exception in thread "main" java.lang.IndexOutOfBoundsException at ...
    Jan 9, 2014 at 3:46 am
    Jan 15, 2014 at 1:57 am
  • Greetings Hive-ians Great to be writing to this group once more. After using Cloudera CDH distributions in production for almost 2 years , I am using Amazon EMR as part of my new assignment :-) Sanjay
    Subramanian, Sanjay (HQP)Subramanian, Sanjay (HQP)
    Jan 13, 2014 at 6:34 am
    Jan 13, 2014 at 5:29 pm
  • Hi Experts, Is there a way to change multiple column names and types ? -- *Kishore Kumar* ITIM
    Kishore kumarKishore kumar
    Jan 8, 2014 at 10:35 am
    Jan 9, 2014 at 7:12 am
  • hi guys I am trying to optimize a hive join query, I have a join of two big tables. The join between them is taking too long, no matter how many reducers I set, there are always two reducers ...
    Guy DoulbergGuy Doulberg
    Jan 31, 2014 at 12:07 am
    Jan 31, 2014 at 1:43 am
  • Hive metastore is creating mysql instead of Derby. schematool -dbType derby -initSchema Metastore connection URL: jdbc:mysql://localhost/metastore Metastore Connection Driver : com.mysql.jdbc.Driver ...
    Unmesha sreeveniUnmesha sreeveni
    Jan 30, 2014 at 8:59 am
    Jan 30, 2014 at 5:35 pm
  • Hello, I'm attempting to access hdfs from my browser, but when I goto the URL http:// http://dc-bigdata5.bateswhite.com:50070/webhdfs/v1/ I get the following error ...
    Clay McDonaldClay McDonald
    Jan 29, 2014 at 12:42 pm
    Jan 29, 2014 at 12:54 pm
  • Hi, Need to load the data into hive table using mapreduce, using java. Please suggest the code related to hive +mapreduce. Thanks in advance Ranjini R
    Ranjini RathinamRanjini Rathinam
    Jan 21, 2014 at 8:22 am
    Jan 28, 2014 at 12:46 am
  • Hello all, I have a case statement where I need to work like this logic. select as_of_dt as as_of_dt, max_feed_key as max_feed_key, min_feed_key as min_feed_key from table feed_key_temp where ...
    Yogesh dhariYogesh dhari
    Jan 22, 2014 at 5:42 pm
    Jan 23, 2014 at 10:17 am
  • Hello! When i run hive job, it creates large temporary files on /tmp/hive-ben/hive_2014-01-14_15-01-39_521_3015861149916225685-1/ somewhere around 300GB. this number tends to get larger if i use ...
    Ben KimBen Kim
    Jan 14, 2014 at 6:47 am
    Jan 19, 2014 at 11:06 pm
  • Hi, I am trying to compile a basic hive UDF java file. I am using all the jar files in my classpath but I am not able to compile it and getting the following error. I am using CDH4. Can any one ...
    Raj HadoopRaj Hadoop
    Jan 17, 2014 at 8:37 pm
    Jan 17, 2014 at 8:40 pm
  • Hey guys, I am using flume to directly sink data into my hive table. However, there seems to be some schema inconsistency, and I am not sure how to troubleshoot it. I created a hive table 'targeting' ...
    Chen WangChen Wang
    Jan 14, 2014 at 7:46 pm
    Jan 14, 2014 at 8:03 pm
  • Yes; u can do so... 5 individual alter table replace column command will do
    Swagatika TripathySwagatika Tripathy
    Jan 12, 2014 at 6:46 pm
    Jan 13, 2014 at 10:28 am
  • Hi, This is my xml file <Company <Employee <id 100</id <ename ranjini</ename <dept IT1</dept <sal 123456</sal <location nextlevel1</location <Address <Home Chennai1</Home <Office Navallur1</Office ...
    Ranjini RathinamRanjini Rathinam
    Jan 10, 2014 at 7:22 am
    Jan 13, 2014 at 8:14 am
Group Navigation
period‹ prev | Jan 2014 | next ›
Group Overview
groupuser @
categorieshive, hadoop

94 users for January 2014

Stephen Sprague: 16 posts Lefty Leverenz: 12 posts Nitin Pawar: 9 posts Bogala, Chandra Reddy: 7 posts Edward Capriolo: 7 posts Petter von Dolwitz (Hem): 7 posts Thejas Nair: 7 posts Andre Araujo: 6 posts Prasanth Jayachandran: 6 posts Kishore kumar: 5 posts Navis류승우: 5 posts Raj Hadoop: 5 posts Thilina Gunarathne: 5 posts Alan Gates: 4 posts Chen Wang: 4 posts Cosmin Cătălin Sanda: 4 posts Kennedy, Sean C.: 4 posts Subramanian, Sanjay (HQP): 4 posts Sun, Rui: 4 posts Thomas Larsson: 4 posts
show more