Search Discussions
-
Hi I was wondering if it is right to assume: 1. The first time we create a table in hive and load it followed by running the first query like Select * from Table1 will result in a MR job running and ...
Sai Sai
Mar 4, 2013 at 8:31 am
May 27, 2013 at 10:00 am -
Hi team, What we have observed is, hive creates so many connections to metastore (mysql). This makes us change the numer of connections to mysql. Can anyone explain me how does hive manages its ...
Siddharth Tiwari
Mar 19, 2013 at 1:25 am
Jun 7, 2013 at 12:24 pm -
Hi list, I've been using hive to perform queries on data hosted on AWS S3, and my tables point at data by specifying the directory in which the data is stored, eg $ create external table myData (str1 ...
Tony Burton
Mar 26, 2013 at 5:11 pm
Mar 27, 2013 at 6:41 pm -
Recently we tried to upgrade our hive from 0.9 to 0.10, but found some of our hive queries almost 7 times slow. One of such query consists multiple table outer join on the same key. By looking into ...
Wzc
Mar 24, 2013 at 5:04 am
Jul 3, 2013 at 3:28 pm -
Hello, We run M/R jobs to parse and process large and highly complex xml files into AVRO files. Then we build external Hive tables on top the parsed Avro files. The hive tables are partitioned by ...
Sadananda Hegde
Mar 29, 2013 at 9:58 pm
Apr 16, 2013 at 3:14 pm -
Hi, I have a question about HIVE-3675 NaN does not work correctly for round(n). The issue did solve the NaN problem, but the hql below result in a different display with hive0.10. I checked the code ...
Chenchun
Mar 14, 2013 at 7:44 am
Apr 2, 2013 at 3:27 pm -
We have existing log data in directories in the format of YEAR/MONTH/DAY. - How can we create a table over this table without hive modifying and/or moving it? - How can we tell Hive to partition this ...
Mark
Mar 29, 2013 at 5:20 pm
Mar 29, 2013 at 8:38 pm -
HI, I have a table BTTN in Oracle database having 738183 records:-- SQL select count(1) from bttn; COUNT(1) ---------- 738183 Now I want to import this table to HIVE and I have fired the following ...
Ajit Kumar Shreevastava
Mar 6, 2013 at 7:10 am
Mar 16, 2013 at 10:57 pm -
Hi, We have a 6 machine hive cluster. We are getting errors while a query is running and it fails. I found that on all 5 slaves storage is nearly full ( 96%, 98%, 100%, 97%, 98% storage used) . On my ...
Chunky Gupta
Mar 18, 2013 at 10:38 am
Mar 19, 2013 at 6:32 pm -
while trying to create external table in oozie hive action, I am getting following error, hive version is 0.9.0 Caused by: javax.jdo.JDODataStoreException: Insert of object ...
Abhishek Gayakwad
Mar 9, 2013 at 8:01 pm
Mar 12, 2013 at 8:45 am -
Hi, I have a hive table which uses the jar file provided from the elephant-bird, which is a framework integrated between lzo and google protobuf data and hadoop/hive. If I use the hive command like ...
Java8964 java8964
Mar 7, 2013 at 10:48 pm
Mar 9, 2013 at 5:58 pm -
Hello, I was wondering if there is a way to quick-verify a Hive query before it is run against a big dataset? The tables I am querying against have millions of records, and I'd like to verify my Hive ...
Kyle B
Mar 5, 2013 at 6:45 pm
Mar 8, 2013 at 11:30 am -
Hi All, I am using the schema in the Impala VM and trying to create a dynamic partitioned table on date_dim. New table is called date_dim_i and schema for that is defined as: create table date_dim_i ...
Dileep Kumar
Mar 5, 2013 at 1:37 am
Mar 6, 2013 at 10:09 am -
On behalf of the Apache Hive PMC I am pleased to welcome Kevin Wilfong as a member of the Apache Hive PMC. Please join me in congratulating Kevin on his new role! Thanks. Carl
Carl Steinbach
Mar 4, 2013 at 7:55 pm
Mar 5, 2013 at 6:25 am -
Hi, Here is is a nice presentation from Owen from Hortonworks on "Optimizing hive queries" http://www.slideshare.net/oom65/optimize-hivequeriespptx Thanks, Nitin Pawar
Nitin Pawar
Mar 29, 2013 at 5:16 am
Mar 29, 2013 at 6:54 am -
i use sqoop to import 30GB data ( two table employee(aprox 21 GB) and salary(aprox 9GB ) into hadoop(Single Node) via hive. i run a sample query like SELECT ...
Gobinda Paul
Mar 12, 2013 at 9:10 am
Mar 12, 2013 at 11:55 am -
Hi All, I am facing following issue while exporting table from hive to Oracle. Importing table from Oracle to Hive and HDFS is working fine. Please let me know where I lag. I am pasting my screen ...
Ajit Kumar Shreevastava
Mar 5, 2013 at 1:54 pm
Mar 6, 2013 at 8:38 pm -
Hi Everyone I'm trying to use the TABLESAMPLE function to sample data, however it's a little more complicated and I am having trouble getting it to run. I know that this works fine and it will give ...
Robert Li
Mar 20, 2013 at 4:56 pm
Mar 20, 2013 at 9:26 pm -
Hi All, I have the following directory structure in hdfs /test/a/ /test/a/1.avro /test/a/2.avro /test/a/b/ /test/a/b/3.avro I created an external HIVE table using Avro Serde and added /test/a as a ...
Suresh Krishnappa
Mar 7, 2013 at 3:24 pm
Mar 11, 2013 at 2:55 pm -
Using CDH3u3 (Hive 0.7.1), it appears that variable substitution becomes disabled when I use a variable in a query that hasn't been defined. For instance, using the following script: set ...
Matt Tucker
Mar 6, 2013 at 9:14 pm
Mar 7, 2013 at 1:44 am -
Hi, Does LEFT OUTER JOIN returns zero rows when RIGHT SIDE table doesn't have at least one record that matches JOIN condition in Hive? Regards, Kumar
Kumar mr
Mar 1, 2013 at 8:14 pm
Mar 5, 2013 at 12:44 am -
I would like to remove unicode chars that are outside the Basic Multilingual Plane [1] I thought select regexp_replace(some_column,"[^\\u0000-\\uffff]","\ufffd") from my_table would work but while ...
Tom Hall
Mar 1, 2013 at 4:53 pm
Mar 1, 2013 at 6:04 pm -
Hi, Is there any function/method to find the maximum across a row in hive? Suppose i have a table like this: ColA ColB ColC 2 5 7 3 2 1 I want the function to return 7 1 Its urgently required. Any ...
Sachin Sudarshana
Mar 1, 2013 at 4:47 pm
Mar 1, 2013 at 5:50 pm -
Hi, I'm running Hive 0.10 and I want to support HWI (besides CLI and HUE). When I started HWI I didn't get any error. However, when I went to <Hive Server Address :9999/hwi on my browser I saw the ...
Eric Chu
Mar 30, 2013 at 2:45 am
Aug 21, 2013 at 1:56 pm -
I am trying to write a GenericUDF function to collect all of a specific struct field(s) within an array for each record, and return them in an array as well. I wrote the UDF (as below), and it seems ...
Peter Chu
Mar 28, 2013 at 9:17 pm
Apr 5, 2013 at 6:44 pm -
Hi all, I try inserting data into hive table storing by hbase storage handler but fail with the following exception end of mapreduce stage info. however, we didn't have problem accessing ...
Jason Shih
Mar 27, 2013 at 8:26 pm
Mar 28, 2013 at 3:52 am -
Hi All, Can you please let me know how can I bypass this error. I am currently using Apache SQOOP version 1.4.2. [hadoop@NHCLT-PC44-2 sqoop-oper]$ sqoop export --connect ...
Ajit Kumar Shreevastava
Mar 13, 2013 at 1:43 pm
Mar 20, 2013 at 7:32 am -
Hi, We are trying to upgrade hive from 0.9.0 to 0.10.0 (apache). When we deploy the 0.10.0 binaries and start meta thrift server, we got the following error: hadoop@ip-10-4-106-145:~/hive$ ./bin/hive ...
Shangzhong zhu
Mar 14, 2013 at 8:51 am
Mar 15, 2013 at 12:04 am -
My understanding is that renaming and external table doesn't rename the corresponding HDFS directory to match. I would like to do this; I want to rename the table in Hive and also rename the HDFS ...
Keith Wiley
Mar 7, 2013 at 11:29 pm
Mar 9, 2013 at 7:25 pm -
Hi All, I am running a hive query which does insert into a table. What I noticed from the symptom it looks like it got to do with some settings but I am not able to figure out what settings. When I ...
Dileep Kumar
Mar 8, 2013 at 10:09 pm
Mar 9, 2013 at 12:05 am -
We have 5 nodes cluster(Hadoop 1.0.4), It hung a couple of times while running big hive jobs(hive-0.8.1). Basically all the nodes are dead, from that trasktracker's log looks it went into some kinds ...
Daning Wang
Mar 6, 2013 at 8:08 pm
Mar 7, 2013 at 1:28 am -
Hi there, I've setup a virtual machine hosting Hive. My use case is a Web traffic analytics, hence most of requests are : - how many requests today ? - how many request today, grouped by country ? - ...
Sékine Coulibaly
Mar 4, 2013 at 10:34 pm
Mar 6, 2013 at 4:03 pm -
Hi, We use Hive "Insert Overwrite Directory" to copy the hourly logs to hdfs. So there are lots of directories like these: /my/logs/2013-03-08/01/000000_0 /my/logs/2013-03-08/02/000000_0 ...
Ian
Mar 28, 2013 at 5:29 pm
Mar 28, 2013 at 6:27 pm -
ello, Is there a setting where all tables created will default to external? I know this isn't ideal long term but I am setting up the environment and would rather start with all tables being external ...
Babe Ruth
Mar 21, 2013 at 8:56 pm
Mar 28, 2013 at 5:16 am -
hello, about hsql statistics. table mytable date,uid,a,b,c -------------------- 03/13/13 185690475 0 1 1 03/13/13 187270278 0 1 0 03/13/13 185690475 1 1 0 03/13/13 186012530 1 0 1 03/13/13 180286243 ...
周梦想
Mar 27, 2013 at 3:34 am
Mar 27, 2013 at 9:22 am -
hive version:0.10.0 hive from testpoker select transform(ldate,ltime,threadid,gameid,userid,pid,roundbet,fold,allin,cardtype,cards,chipwon) using 'calcpoker.py' as ...
周梦想
Mar 26, 2013 at 9:55 am
Mar 27, 2013 at 2:22 am -
The following query translates into a many-map-single-reduce job (which is common) and also slags through the reduce stage...it's killing the overall query: select * from a where b = 'c' order by b ...
Keith Wiley
Mar 22, 2013 at 11:02 pm
Mar 24, 2013 at 1:30 pm -
Hi. I'm trying to understand what happens to Exceptions that are thrown by custom UDFs. I have a UDF that throws a RuntimeException with useful debugging information, but I don't see it in any logs ...
Marc Limotte
Mar 20, 2013 at 8:02 pm
Mar 21, 2013 at 8:17 am -
Hi, I have the hadoop running in pseudo-distributed mode on my linux box. Right now I face a problem about a Hive, which throws Exception in a table for some data which used my custom SerDe and ...
Java8964 java8964
Mar 20, 2013 at 8:45 pm
Mar 21, 2013 at 1:05 am -
Good day, I wonder how much hive index helps, I had a test before seems it take long time to build index, hope to learn something from folks here that have good experience on it. thanks! echo
Echo Li
Mar 19, 2013 at 6:15 pm
Mar 19, 2013 at 6:47 pm -
I have files like this: 03/11/13 10:59:52 00000ec0 1009 180538126 92041 2300 0 0 7 21|47|20|33|11 0:2775 03/11/13 10:59:52 00000744 1010 178343610 92042 350 1 0 -1 NULL NULL 22 45 the format is ...
周梦想
Mar 11, 2013 at 4:05 am
Mar 18, 2013 at 3:27 pm -
Hi all, I'm using the hive json serde and need to run: "ADD JAR /usr/lib/hive/lib/hive-json-serde-0.2.jar;", before I can use tables that require it. Is it possible to have this jar available ...
Krishna Rao
Mar 13, 2013 at 5:27 pm
Mar 13, 2013 at 5:55 pm -
Hi All, Could anyone describe what the required thread safety for a UDF is? I understand that one is instantiated for each use of the function in an expression, but can there be multiple threads ...
Shaun Clowes
Mar 11, 2013 at 3:13 am
Mar 11, 2013 at 3:55 am -
Hi All, I have a hadoop cluster with data present in large number of directories ( To run HIVE queries over this data I created an external partitioned table and pointed each directory as a partition ...
Suresh Krishnappa
Mar 7, 2013 at 2:31 pm
Mar 9, 2013 at 5:53 pm -
I have two tables which have overlapping but nonidentical schema. I want to creating a new table that unions them, leaving nulls in any given row where a column name doesn't occur in the other ...
Keith Wiley
Mar 6, 2013 at 6:03 pm
Mar 6, 2013 at 6:44 pm -
Hi, I am getting "java.io.FileNotFoundException(File does not exist: /tmp/sb25634/hive_2013-03-01_23-21-43_428_5325193042224363842/-mr-10000/1/emptyFile)' " exception when running any join query ...
Bhaskar, Snehalata
Mar 3, 2013 at 5:53 pm
Mar 4, 2013 at 2:32 pm -
Hi Thejas, thank you for the explanation. So, HiveServer2 is going to be part of Hive 0.11, and I have read that HCatalog is going to be merged in version 0.11 too. What is the target date for Hive ...
Rodrigo Trujillo
Mar 21, 2013 at 5:53 pm
Mar 22, 2013 at 10:36 pm -
Hi fellow Hive users, Any of you know if there is a HUE user group? Thanks, Chalcy
Chalcy Raja
Mar 22, 2013 at 7:13 pm
Mar 22, 2013 at 7:38 pm -
Hi team, What we have observed is, hive creates so many connections to metastore (mysql). This makes us change the numer of connections to mysql. Specifically 2 connections per user out of which one ...
Siddharth Tiwari
Mar 21, 2013 at 2:44 pm
Mar 21, 2013 at 2:50 pm -
Hi, I'm using Hive for dealing with some international characters.Does Hive have collation support so I can specify case sensitivity, ascent sensitivity or width sensitity for string comparison ...
Jon Klein
Mar 19, 2013 at 4:10 am
Mar 20, 2013 at 4:25 pm
Group Overview
group | user |
categories | hive, hadoop |
discussions | 80 |
posts | 344 |
users | 101 |
website | hive.apache.org |
101 users for March 2013
Archives
- June 2016 (177)
- May 2016 (265)
- April 2016 (244)
- March 2016 (368)
- February 2016 (323)
- January 2016 (323)
- December 2015 (347)
- November 2015 (305)
- October 2015 (279)
- September 2015 (386)
- August 2015 (291)
- July 2015 (176)
- June 2015 (305)
- May 2015 (227)
- April 2015 (345)
- March 2015 (332)
- February 2015 (230)
- January 2015 (129)
- December 2014 (252)
- November 2014 (196)
- October 2014 (252)
- September 2014 (288)
- August 2014 (265)
- July 2014 (389)
- June 2014 (274)
- May 2014 (203)
- April 2014 (296)
- March 2014 (270)
- February 2014 (301)
- January 2014 (252)
- December 2013 (230)
- November 2013 (222)
- October 2013 (275)
- September 2013 (315)
- August 2013 (364)
- July 2013 (419)
- June 2013 (407)
- May 2013 (319)
- April 2013 (206)
- March 2013 (344)
- February 2013 (268)
- January 2013 (318)
- December 2012 (313)
- November 2012 (244)
- October 2012 (318)
- September 2012 (373)
- August 2012 (380)
- July 2012 (487)
- June 2012 (454)
- May 2012 (458)
- April 2012 (343)
- March 2012 (337)
- February 2012 (207)
- January 2012 (265)
- December 2011 (235)
- November 2011 (182)
- October 2011 (199)
- September 2011 (211)
- August 2011 (277)
- July 2011 (152)
- June 2011 (149)
- May 2011 (244)
- April 2011 (127)
- March 2011 (265)
- February 2011 (284)
- January 2011 (235)
- December 2010 (143)
- November 2010 (137)
- October 2010 (231)
- September 2010 (254)
- August 2010 (278)
- July 2010 (161)
- June 2010 (262)
- May 2010 (132)
- April 2010 (126)
- March 2010 (178)
- February 2010 (366)
- January 2010 (156)
- December 2009 (110)
- November 2009 (146)
- October 2009 (252)
- September 2009 (215)
- August 2009 (187)
- July 2009 (322)
- June 2009 (106)
- May 2009 (97)
- April 2009 (160)
- March 2009 (173)
- February 2009 (139)
- January 2009 (152)
- December 2008 (105)
- November 2008 (33)