Search Discussions
-
Hi All, We are new to hadoop and hive, we are trying to use hive to run analytical queries and we are using sqoop to import data into hive, in our RDBMS the data updated very frequently and this ...
Ibrahim Yakti
Dec 24, 2012 at 1:09 pm
Dec 26, 2012 at 2:57 pm -
Hi, I try to force the number of map for the mapreduce job with the command : public static void main(String[] args) throws Exception { JobConf conf = new JobConf(WordCount.class) ...
imen Megdiche
Dec 12, 2012 at 10:41 am
Dec 12, 2012 at 3:38 pm -
hi, My hive jobs became very slow from yesterday, it keeps about 5 minutes on pending, but it was only 40sec before. I didn't modify any configuration and there's no other jobs on hadoop cluster. My ...
Neil Guo
Dec 19, 2012 at 4:27 pm
Dec 21, 2012 at 7:54 am -
Hello everybody, I have got a question. I didn't came across any post which says somethign about this. I have got two tables. Lets say A and B. I want to join A & B in HIVE. I am currently using HIVE ...
Souvik Banerjee
Dec 7, 2012 at 7:58 pm
Dec 27, 2012 at 11:06 pm -
Hi Hive Users, I recently noticed an interesting behavior with Hive and I am unable to find the reason for it. Your insights into this is much appreciated. I am trying to compute the distance between ...
Periya.Data
Dec 7, 2012 at 9:28 pm
Dec 18, 2012 at 2:09 am -
I have a silly question on how Hive interpretes a simple query with both map side join and group by. Below query will translate into two jobs, with the 1st one as a map only job doing the join and ...
Chen Song
Dec 12, 2012 at 11:33 pm
Dec 13, 2012 at 7:51 pm -
Hi, We are using Hive 0.7.0 and we are getting error while using "<=" along with "join"... Same query is working fine if we use "=". *Working Query :* hive select count(A1.id) as LVL, A2.id, A2.code, ...
Ramasubramanian Narayanan
Dec 17, 2012 at 12:31 pm
Dec 17, 2012 at 8:46 pm -
I am looking for ways to streamline some of my analytics. One thing I notice is that when I use hive cli, or connect to my hive thrift server, there are a some commands I always end up running for my ...
John Omernik
Dec 9, 2012 at 4:56 pm
Dec 14, 2012 at 2:41 pm -
Hello, I am trying to increase the number of map and reduce tasks for a job and even for the same data size, I noticed that the total time CPU increases but I thought it would decrease. MapReduce is ...
imen Megdiche
Dec 13, 2012 at 10:32 am
Dec 13, 2012 at 2:29 pm -
I am trying to drop a table in Hive and it throws metastore exception. 2012-12-11 01:19:59,225 ERROR exec.DDLTask (SessionState.java:printError(365)) - FAILED: Error in metadata ...
Anandha L Ranganathan
Dec 11, 2012 at 3:29 am
Dec 13, 2012 at 4:47 am -
Hello, I couldn't find any example of how to populate columns that were added to a table. How would Hive tell which row to append by each value of the newly added columns? Does it do a column name ...
Yaboulna
Dec 10, 2012 at 12:36 am
Dec 10, 2012 at 8:02 pm -
Thnaks... sorry to ask you if possible could you pls advice on below points In general in Real time how we will write scripts 1. Java + hive query --could you pls ,if possibl share one program which ...
Kshiva Kps
Dec 25, 2012 at 7:31 am
Dec 26, 2012 at 3:01 am -
Hi all, is it possible to set: mapreduce.map.log.level & mapreduce.reduce.log.level, within some config file? At the moment I have to remember to set these at the start of a hive session, or script ...
Krishna Rao
Dec 14, 2012 at 10:36 am
Dec 18, 2012 at 10:16 am -
Hi All: As I know, HiveHistory.log will replace '\n' with space before writing Entry.value to history file: * val = val.replace('\n', ' ');* but HiveHistoryViewer use BufferedReader.readLine which ...
Qiang Wang
Dec 16, 2012 at 10:23 am
Dec 18, 2012 at 5:27 am -
Hi Hive community I have a custom udf, say myfun, written in Java which I utilize like this select myfun(col_a, col_b) from mytable where ....etc col_b is a string type and sometimes it is null. When ...
Søren
Dec 4, 2012 at 1:32 pm
Dec 6, 2012 at 10:44 am -
I am trying to use BINARY columns and believe I have the perfect use-case for it, but I am missing something. Has anyone used this for true binary data (which may contain newlines)? Here is the ...
Connell, Chuck
Dec 1, 2012 at 4:51 pm
Dec 2, 2012 at 6:27 pm -
Hi, I am struggling with a problem described below. Any help how to resolve this problem is highly appreciated. I have got few tables the structure is over simplified for the sake of describing the ...
Souvik Banerjee
Dec 27, 2012 at 11:17 pm
Dec 30, 2012 at 2:56 am -
Hi, all Refer to https://cwiki.apache.org/Hive/adminmanual-configuration.html, if I set "hive.querylog.location" to an empty string, it won't create structured log. I filed hive-site.xml in ...
Bing Li
Dec 6, 2012 at 8:45 am
Dec 7, 2012 at 9:09 am -
Hi In serde program I need table properties in inputformat file . So can anyone please tell me how can I do this? thanks **************** CAUTION - Disclaimer ***************** This e-mail contains ...
Mohit Chaudhary01
Dec 21, 2012 at 5:35 am
Dec 21, 2012 at 3:04 pm -
Long subject, I know.. let me explain a bit more about the problem: I'm trying to load a file into a hive table (this is on an EMR instance) for that I create an external table, and I set the ...
Fernando Andrés Doglio Turissini
Dec 11, 2012 at 2:06 pm
Dec 17, 2012 at 3:08 pm -
Hi, We are using Hive as our data warehouse to run various queries on large amounts of data. There are some users who would like to get access to the output of these queries and display the data on ...
Leena Gupta
Dec 12, 2012 at 7:46 pm
Dec 13, 2012 at 8:28 am -
Hi, I want to know from the output of the execution of the example of mapreduce wordcount on hadoop : the number of mapreduce job and the time spent for the execution. There is an exceprt from the ...
imen Megdiche
Dec 12, 2012 at 9:24 am
Dec 12, 2012 at 10:07 am -
Hello, How can I map an HBase table with the following layout to Hive using the "CREATE EXTERNAL TABLE" command from shell (or another programmatic way): The HBase table's layout is as follows ...
David Koch
Dec 6, 2012 at 6:56 pm
Dec 10, 2012 at 12:53 am -
Hi everyone, My cluster also runs HBase for real time processing. Hive query (on a big table) occupies all the map tasks so that the other service cannot run properly. Does anyone know how to limit ...
Philips Kokoh Prasetyo
Dec 7, 2012 at 9:02 am
Dec 7, 2012 at 11:44 am -
I am converting the Netezza query in hive.How can i achieve following query in hive -- row_number() over (partition by record_id, event_id order by e_timestamp desc) as rnum
Maya bhardwaj
Dec 14, 2012 at 4:18 pm
Dec 18, 2012 at 7:34 pm -
Hi I am using serde in hive to store data into hive table from xml file. Whenever I retrieve data using command select * from table it give all records from table. But when I want to extract an ...
Mohit Chaudhary01
Dec 17, 2012 at 8:22 am
Dec 18, 2012 at 2:07 am -
Hi, I'm trying to run a program on Hadoop. [Input] tsv file My program does the following. (1) Load tsv into hive load data local inpath 'tsvfile' overwrite into table A partitioned by xx (2) insert ...
Elaine Gan
Dec 12, 2012 at 9:44 am
Dec 14, 2012 at 6:55 am -
Hi, I'm building / designing a back-up and restore tool for hive data for Disaster Recovery scenarios. I'm trying to understand the locking behavior of HIVE that is currently supporting ZooKeeper for ...
Manish Malhotra
Dec 7, 2012 at 7:17 am
Dec 10, 2012 at 8:36 pm -
Hello, We are running into intermittent errors while running the below query. Some background on this, our table (tbl_someTable) that we're altering is an external table, and the query below is run ...
Karlen Lie
Dec 8, 2012 at 2:16 am
Dec 10, 2012 at 5:16 pm -
Hi, I downloaded hive 0.9.0 source and wanted to compile it for hadoop 0.23.4, I ended up using the -Dhadoop.version info found at HIVE-2468 and was able to package it. I wanted to push this to my ...
Viral Bajaria
Dec 5, 2012 at 10:41 am
Dec 5, 2012 at 11:39 am -
Hi, I have an avro table with a schema that is around 8000 chars, and cannot query from it: First i had issue when creating the table, Hive will throw an exception because the field in MySQL ...
Alexandre Fouche
Dec 17, 2012 at 1:25 pm
Jan 22, 2013 at 10:21 pm -
Assume there are strings like 'afewexcvgregre&MovieTitle=321grgrdg&olfll3onsl' or '?MovieTitle=949303sjkskld&sososodn' how to extract 'MovieTitle=321grgrdg' or 'MovieTitle=949303sjkskld' using Hive ...
Qiaoresearcher
Dec 26, 2012 at 6:46 pm
Dec 26, 2012 at 9:01 pm -
Hi, Is there a way to drop a table such that the contents do not go to the .Trash dir? I have limited diskQuota in hadoop and am running large Hive jobs in sequence. I would like to drop tables as ...
Periya.Data
Dec 24, 2012 at 7:47 am
Dec 24, 2012 at 1:37 pm -
Hi, I've written a UDF to convert currency values which are stored in an external table as double together with the currency type as string. The currency udf extends UDF and has one method to convert ...
Oliver Krohne
Dec 23, 2012 at 3:34 pm
Dec 23, 2012 at 3:52 pm -
Hi, I have 2 questions related to the hive behavior when using 'add jar'. I am testing the implementing of my own Hive InputFormat and SerDe in a jar in my single machine cluster running in Pseudo ...
Java8964 java8964
Dec 21, 2012 at 1:02 am
Dec 22, 2012 at 2:00 am -
Hi everyone, May I know if there is any tool available to analyze and tune the performance for Hive queries? And what is the state of the art? I had some experience on tuning Pig, based on manually ...
Jie Li
Dec 14, 2012 at 2:02 am
Dec 14, 2012 at 2:50 am -
We are using Hive 0.9.0, and we have seen frequent Thrift Metastore timeout issues probably due to the Thrift memory leak reported in THRIFT-1468. The current solution is to upgrade Thrift to 0.9.0 I ...
Shangzhong zhu
Dec 11, 2012 at 8:07 pm
Dec 13, 2012 at 8:24 am -
Is there a known deadlock issue or bug when using Hive parallel execution with more parallel hive threads than there are computing nodemanagers ? On my test cluster, i have set Hive parallel excution ...
Alexandre Fouche
Dec 6, 2012 at 1:24 pm
Dec 7, 2012 at 8:19 am -
Hello All, I would like to find the total amount of minutes between two dates. Not sure if this is possible in hive. Any help would be great. Thanks,George
Babe Ruth
Dec 5, 2012 at 8:34 pm
Dec 5, 2012 at 9:37 pm -
hi all, I am trying the below query Create database xxxx Location '/my/preferred/directory' But getting the below error FAILED: Parse Error : line 2:0 mismatched input 'LOCATION' excepting EOF near ...
Abhishek
Dec 4, 2012 at 2:07 pm
Dec 4, 2012 at 3:23 pm -
Hi, Our company current is using CDH3 release, which comes with Hive 0.7.1. Right now, I have the data coming from another team, which also provides the custom InputFormat and RecorderReader, but ...
Java8964 java8964
Dec 3, 2012 at 3:43 pm
Dec 4, 2012 at 2:35 pm -
Hi Hive users, I have Hive CDH - 0.7.1. I want to know if I can do cross-join with this version. I am aware that Cross-Join is fixed in version 0.10 (see ...
Periya.Data
Dec 3, 2012 at 5:26 pm
Dec 4, 2012 at 7:59 am -
Hi, I have Apache Hive and Apache Hadoop on Amazon EC2 machines. If anyone can tell me that can HUE be used with this setup instead of CHD Hadoop cluster. If not, then is there any alternate UI ...
Chunky Gupta
Dec 29, 2012 at 7:30 am
Dec 29, 2012 at 3:18 pm -
I've moved this conversation over to hive-user. You might have better luck on that list than this one.
Nick Dimiduk
Dec 26, 2012 at 5:28 pm
Dec 26, 2012 at 7:45 pm -
Thanks to Ed and Nitin. Even after setting trash interval to zero, I get the following error message. I shall try the brute force "dfs -rmr skipTrash.." now. What does this message mean?: FAILED ...
Periya.Data
Dec 24, 2012 at 3:56 pm
Dec 24, 2012 at 5:14 pm -
Hi everyone. After read through the HiveQL manual, I have no luck in finding the corresponding statement for IN and EXIST query. Can anyone tell me whether Hive supports the standard SQL IN and EXIST ...
Alex.Wang
Dec 24, 2012 at 7:33 am
Dec 24, 2012 at 7:53 am -
Hi, Does anyone know of the SQL limits for Hive? Particularly the following: 1. The maximum number of tables in join, aka, the maximum number of tables in a select query 2. The maximum number of ...
Omer, Farah
Dec 17, 2012 at 7:49 pm
Dec 18, 2012 at 2:02 am -
Hi there, I loaded data from the movielens database into hive, into a u_data table. I wish I could count the total number of rows in that table. Although mapreduce task starts, it ends with a Null ...
Sékine Coulibaly
Dec 16, 2012 at 9:37 pm
Dec 17, 2012 at 12:41 am -
Hello All, I have been using the AWS setup for EMR for some time now and I am currently in the process of implementing spark/shark on my own cluster. I am installing from ...
Erik Thorson
Dec 10, 2012 at 9:46 pm
Dec 14, 2012 at 9:02 am -
Hi Is there a HiveQL statement to load, import or execute another HiveQL script, either local or in HDFS ? (yes, i already search in docs and book) AF
Alexandre Fouche
Dec 13, 2012 at 1:00 pm
Dec 13, 2012 at 11:22 pm
Group Overview
group | user |
categories | hive, hadoop |
discussions | 64 |
posts | 313 |
users | 82 |
website | hive.apache.org |
82 users for December 2012
Archives
- June 2016 (177)
- May 2016 (265)
- April 2016 (244)
- March 2016 (368)
- February 2016 (323)
- January 2016 (323)
- December 2015 (347)
- November 2015 (305)
- October 2015 (279)
- September 2015 (386)
- August 2015 (291)
- July 2015 (176)
- June 2015 (305)
- May 2015 (227)
- April 2015 (345)
- March 2015 (332)
- February 2015 (230)
- January 2015 (129)
- December 2014 (252)
- November 2014 (196)
- October 2014 (252)
- September 2014 (288)
- August 2014 (265)
- July 2014 (389)
- June 2014 (274)
- May 2014 (203)
- April 2014 (296)
- March 2014 (270)
- February 2014 (301)
- January 2014 (252)
- December 2013 (230)
- November 2013 (222)
- October 2013 (275)
- September 2013 (315)
- August 2013 (364)
- July 2013 (419)
- June 2013 (407)
- May 2013 (319)
- April 2013 (206)
- March 2013 (344)
- February 2013 (268)
- January 2013 (318)
- December 2012 (313)
- November 2012 (244)
- October 2012 (318)
- September 2012 (373)
- August 2012 (380)
- July 2012 (487)
- June 2012 (454)
- May 2012 (458)
- April 2012 (343)
- March 2012 (337)
- February 2012 (207)
- January 2012 (265)
- December 2011 (235)
- November 2011 (182)
- October 2011 (199)
- September 2011 (211)
- August 2011 (277)
- July 2011 (152)
- June 2011 (149)
- May 2011 (244)
- April 2011 (127)
- March 2011 (265)
- February 2011 (284)
- January 2011 (235)
- December 2010 (143)
- November 2010 (137)
- October 2010 (231)
- September 2010 (254)
- August 2010 (278)
- July 2010 (161)
- June 2010 (262)
- May 2010 (132)
- April 2010 (126)
- March 2010 (178)
- February 2010 (366)
- January 2010 (156)
- December 2009 (110)
- November 2009 (146)
- October 2009 (252)
- September 2009 (215)
- August 2009 (187)
- July 2009 (322)
- June 2009 (106)
- May 2009 (97)
- April 2009 (160)
- March 2009 (173)
- February 2009 (139)
- January 2009 (152)
- December 2008 (105)
- November 2008 (33)