Search Discussions

64 discussions - 313 posts

  • Hi All, We are new to hadoop and hive, we are trying to use hive to run analytical queries and we are using sqoop to import data into hive, in our RDBMS the data updated very frequently and this ...
    Ibrahim YaktiIbrahim Yakti
    Dec 24, 2012 at 1:09 pm
    Dec 26, 2012 at 2:57 pm
  • Hi, I try to force the number of map for the mapreduce job with the command : public static void main(String[] args) throws Exception { JobConf conf = new JobConf(WordCount.class) ...
    imen Megdicheimen Megdiche
    Dec 12, 2012 at 10:41 am
    Dec 12, 2012 at 3:38 pm
  • hi, My hive jobs became very slow from yesterday, it keeps about 5 minutes on pending, but it was only 40sec before. I didn't modify any configuration and there's no other jobs on hadoop cluster. My ...
    Neil GuoNeil Guo
    Dec 19, 2012 at 4:27 pm
    Dec 21, 2012 at 7:54 am
  • Hello everybody, I have got a question. I didn't came across any post which says somethign about this. I have got two tables. Lets say A and B. I want to join A & B in HIVE. I am currently using HIVE ...
    Souvik BanerjeeSouvik Banerjee
    Dec 7, 2012 at 7:58 pm
    Dec 27, 2012 at 11:06 pm
  • Hi Hive Users, I recently noticed an interesting behavior with Hive and I am unable to find the reason for it. Your insights into this is much appreciated. I am trying to compute the distance between ...
    Dec 7, 2012 at 9:28 pm
    Dec 18, 2012 at 2:09 am
  • I have a silly question on how Hive interpretes a simple query with both map side join and group by. Below query will translate into two jobs, with the 1st one as a map only job doing the join and ...
    Chen SongChen Song
    Dec 12, 2012 at 11:33 pm
    Dec 13, 2012 at 7:51 pm
  • Hi, We are using Hive 0.7.0 and we are getting error while using "<=" along with "join"... Same query is working fine if we use "=". *Working Query :* hive select count(A1.id) as LVL, A2.id, A2.code, ...
    Ramasubramanian NarayananRamasubramanian Narayanan
    Dec 17, 2012 at 12:31 pm
    Dec 17, 2012 at 8:46 pm
  • I am looking for ways to streamline some of my analytics. One thing I notice is that when I use hive cli, or connect to my hive thrift server, there are a some commands I always end up running for my ...
    John OmernikJohn Omernik
    Dec 9, 2012 at 4:56 pm
    Dec 14, 2012 at 2:41 pm
  • Hello, I am trying to increase the number of map and reduce tasks for a job and even for the same data size, I noticed that the total time CPU increases but I thought it would decrease. MapReduce is ...
    imen Megdicheimen Megdiche
    Dec 13, 2012 at 10:32 am
    Dec 13, 2012 at 2:29 pm
  • I am trying to drop a table in Hive and it throws metastore exception. 2012-12-11 01:19:59,225 ERROR exec.DDLTask (SessionState.java:printError(365)) - FAILED: Error in metadata ...
    Anandha L RanganathanAnandha L Ranganathan
    Dec 11, 2012 at 3:29 am
    Dec 13, 2012 at 4:47 am
  • Hello, I couldn't find any example of how to populate columns that were added to a table. How would Hive tell which row to append by each value of the newly added columns? Does it do a column name ...
    Dec 10, 2012 at 12:36 am
    Dec 10, 2012 at 8:02 pm
  • Thnaks... sorry to ask you if possible could you pls advice on below points In general in Real time how we will write scripts 1. Java + hive query --could you pls ,if possibl share one program which ...
    Kshiva KpsKshiva Kps
    Dec 25, 2012 at 7:31 am
    Dec 26, 2012 at 3:01 am
  • Hi all, is it possible to set: mapreduce.map.log.level & mapreduce.reduce.log.level, within some config file? At the moment I have to remember to set these at the start of a hive session, or script ...
    Krishna RaoKrishna Rao
    Dec 14, 2012 at 10:36 am
    Dec 18, 2012 at 10:16 am
  • Hi All: As I know, HiveHistory.log will replace '\n' with space before writing Entry.value to history file: * val = val.replace('\n', ' ');* but HiveHistoryViewer use BufferedReader.readLine which ...
    Qiang WangQiang Wang
    Dec 16, 2012 at 10:23 am
    Dec 18, 2012 at 5:27 am
  • Hi Hive community I have a custom udf, say myfun, written in Java which I utilize like this select myfun(col_a, col_b) from mytable where ....etc col_b is a string type and sometimes it is null. When ...
    Dec 4, 2012 at 1:32 pm
    Dec 6, 2012 at 10:44 am
  • I am trying to use BINARY columns and believe I have the perfect use-case for it, but I am missing something. Has anyone used this for true binary data (which may contain newlines)? Here is the ...
    Connell, ChuckConnell, Chuck
    Dec 1, 2012 at 4:51 pm
    Dec 2, 2012 at 6:27 pm
  • Hi, I am struggling with a problem described below. Any help how to resolve this problem is highly appreciated. I have got few tables the structure is over simplified for the sake of describing the ...
    Souvik BanerjeeSouvik Banerjee
    Dec 27, 2012 at 11:17 pm
    Dec 30, 2012 at 2:56 am
  • Hi, all Refer to https://cwiki.apache.org/Hive/adminmanual-configuration.html, if I set "hive.querylog.location" to an empty string, it won't create structured log. I filed hive-site.xml in ...
    Bing LiBing Li
    Dec 6, 2012 at 8:45 am
    Dec 7, 2012 at 9:09 am
  • Hi In serde program I need table properties in inputformat file . So can anyone please tell me how can I do this? thanks **************** CAUTION - Disclaimer ***************** This e-mail contains ...
    Mohit Chaudhary01Mohit Chaudhary01
    Dec 21, 2012 at 5:35 am
    Dec 21, 2012 at 3:04 pm
  • Long subject, I know.. let me explain a bit more about the problem: I'm trying to load a file into a hive table (this is on an EMR instance) for that I create an external table, and I set the ...
    Fernando Andrés Doglio TurissiniFernando Andrés Doglio Turissini
    Dec 11, 2012 at 2:06 pm
    Dec 17, 2012 at 3:08 pm
  • Hi, We are using Hive as our data warehouse to run various queries on large amounts of data. There are some users who would like to get access to the output of these queries and display the data on ...
    Leena GuptaLeena Gupta
    Dec 12, 2012 at 7:46 pm
    Dec 13, 2012 at 8:28 am
  • Hi, I want to know from the output of the execution of the example of mapreduce wordcount on hadoop : the number of mapreduce job and the time spent for the execution. There is an exceprt from the ...
    imen Megdicheimen Megdiche
    Dec 12, 2012 at 9:24 am
    Dec 12, 2012 at 10:07 am
  • Hello, How can I map an HBase table with the following layout to Hive using the "CREATE EXTERNAL TABLE" command from shell (or another programmatic way): The HBase table's layout is as follows ...
    David KochDavid Koch
    Dec 6, 2012 at 6:56 pm
    Dec 10, 2012 at 12:53 am
  • Hi everyone, My cluster also runs HBase for real time processing. Hive query (on a big table) occupies all the map tasks so that the other service cannot run properly. Does anyone know how to limit ...
    Philips Kokoh PrasetyoPhilips Kokoh Prasetyo
    Dec 7, 2012 at 9:02 am
    Dec 7, 2012 at 11:44 am
  • I am converting the Netezza query in hive.How can i achieve following query in hive -- row_number() over (partition by record_id, event_id order by e_timestamp desc) as rnum
    Maya bhardwajMaya bhardwaj
    Dec 14, 2012 at 4:18 pm
    Dec 18, 2012 at 7:34 pm
  • Hi I am using serde in hive to store data into hive table from xml file. Whenever I retrieve data using command select * from table it give all records from table. But when I want to extract an ...
    Mohit Chaudhary01Mohit Chaudhary01
    Dec 17, 2012 at 8:22 am
    Dec 18, 2012 at 2:07 am
  • Hi, I'm trying to run a program on Hadoop. [Input] tsv file My program does the following. (1) Load tsv into hive load data local inpath 'tsvfile' overwrite into table A partitioned by xx (2) insert ...
    Elaine GanElaine Gan
    Dec 12, 2012 at 9:44 am
    Dec 14, 2012 at 6:55 am
  • Hi, I'm building / designing a back-up and restore tool for hive data for Disaster Recovery scenarios. I'm trying to understand the locking behavior of HIVE that is currently supporting ZooKeeper for ...
    Manish MalhotraManish Malhotra
    Dec 7, 2012 at 7:17 am
    Dec 10, 2012 at 8:36 pm
  • Hello, We are running into intermittent errors while running the below query. Some background on this, our table (tbl_someTable) that we're altering is an external table, and the query below is run ...
    Karlen LieKarlen Lie
    Dec 8, 2012 at 2:16 am
    Dec 10, 2012 at 5:16 pm
  • Hi, I downloaded hive 0.9.0 source and wanted to compile it for hadoop 0.23.4, I ended up using the -Dhadoop.version info found at HIVE-2468 and was able to package it. I wanted to push this to my ...
    Viral BajariaViral Bajaria
    Dec 5, 2012 at 10:41 am
    Dec 5, 2012 at 11:39 am
  • Hi, I have an avro table with a schema that is around 8000 chars, and cannot query from it: First i had issue when creating the table, Hive will throw an exception because the field in MySQL ...
    Alexandre FoucheAlexandre Fouche
    Dec 17, 2012 at 1:25 pm
    Jan 22, 2013 at 10:21 pm
  • Assume there are strings like 'afewexcvgregre&MovieTitle=321grgrdg&olfll3onsl' or '?MovieTitle=949303sjkskld&sososodn' how to extract 'MovieTitle=321grgrdg' or 'MovieTitle=949303sjkskld' using Hive ...
    Dec 26, 2012 at 6:46 pm
    Dec 26, 2012 at 9:01 pm
  • Hi, Is there a way to drop a table such that the contents do not go to the .Trash dir? I have limited diskQuota in hadoop and am running large Hive jobs in sequence. I would like to drop tables as ...
    Dec 24, 2012 at 7:47 am
    Dec 24, 2012 at 1:37 pm
  • Hi, I've written a UDF to convert currency values which are stored in an external table as double together with the currency type as string. The currency udf extends UDF and has one method to convert ...
    Oliver KrohneOliver Krohne
    Dec 23, 2012 at 3:34 pm
    Dec 23, 2012 at 3:52 pm
  • Hi, I have 2 questions related to the hive behavior when using 'add jar'. I am testing the implementing of my own Hive InputFormat and SerDe in a jar in my single machine cluster running in Pseudo ...
    Java8964 java8964Java8964 java8964
    Dec 21, 2012 at 1:02 am
    Dec 22, 2012 at 2:00 am
  • Hi everyone, May I know if there is any tool available to analyze and tune the performance for Hive queries? And what is the state of the art? I had some experience on tuning Pig, based on manually ...
    Jie LiJie Li
    Dec 14, 2012 at 2:02 am
    Dec 14, 2012 at 2:50 am
  • We are using Hive 0.9.0, and we have seen frequent Thrift Metastore timeout issues probably due to the Thrift memory leak reported in THRIFT-1468. The current solution is to upgrade Thrift to 0.9.0 I ...
    Shangzhong zhuShangzhong zhu
    Dec 11, 2012 at 8:07 pm
    Dec 13, 2012 at 8:24 am
  • Is there a known deadlock issue or bug when using Hive parallel execution with more parallel hive threads than there are computing nodemanagers ? On my test cluster, i have set Hive parallel excution ...
    Alexandre FoucheAlexandre Fouche
    Dec 6, 2012 at 1:24 pm
    Dec 7, 2012 at 8:19 am
  • Hello All, I would like to find the total amount of minutes between two dates. Not sure if this is possible in hive. Any help would be great. Thanks,George
    Babe RuthBabe Ruth
    Dec 5, 2012 at 8:34 pm
    Dec 5, 2012 at 9:37 pm
  • hi all, I am trying the below query Create database xxxx Location '/my/preferred/directory' But getting the below error FAILED: Parse Error : line 2:0 mismatched input 'LOCATION' excepting EOF near ...
    Dec 4, 2012 at 2:07 pm
    Dec 4, 2012 at 3:23 pm
  • Hi, Our company current is using CDH3 release, which comes with Hive 0.7.1. Right now, I have the data coming from another team, which also provides the custom InputFormat and RecorderReader, but ...
    Java8964 java8964Java8964 java8964
    Dec 3, 2012 at 3:43 pm
    Dec 4, 2012 at 2:35 pm
  • Hi Hive users, I have Hive CDH - 0.7.1. I want to know if I can do cross-join with this version. I am aware that Cross-Join is fixed in version 0.10 (see ...
    Dec 3, 2012 at 5:26 pm
    Dec 4, 2012 at 7:59 am
  • Hi, I have Apache Hive and Apache Hadoop on Amazon EC2 machines. If anyone can tell me that can HUE be used with this setup instead of CHD Hadoop cluster. If not, then is there any alternate UI ...
    Chunky GuptaChunky Gupta
    Dec 29, 2012 at 7:30 am
    Dec 29, 2012 at 3:18 pm
  • I've moved this conversation over to hive-user. You might have better luck on that list than this one.
    Nick DimidukNick Dimiduk
    Dec 26, 2012 at 5:28 pm
    Dec 26, 2012 at 7:45 pm
  • Thanks to Ed and Nitin. Even after setting trash interval to zero, I get the following error message. I shall try the brute force "dfs -rmr skipTrash.." now. What does this message mean?: FAILED ...
    Dec 24, 2012 at 3:56 pm
    Dec 24, 2012 at 5:14 pm
  • Hi everyone. After read through the HiveQL manual, I have no luck in finding the corresponding statement for IN and EXIST query. Can anyone tell me whether Hive supports the standard SQL IN and EXIST ...
    Dec 24, 2012 at 7:33 am
    Dec 24, 2012 at 7:53 am
  • Hi, Does anyone know of the SQL limits for Hive? Particularly the following: 1. The maximum number of tables in join, aka, the maximum number of tables in a select query 2. The maximum number of ...
    Omer, FarahOmer, Farah
    Dec 17, 2012 at 7:49 pm
    Dec 18, 2012 at 2:02 am
  • Hi there, I loaded data from the movielens database into hive, into a u_data table. I wish I could count the total number of rows in that table. Although mapreduce task starts, it ends with a Null ...
    Sékine CoulibalySékine Coulibaly
    Dec 16, 2012 at 9:37 pm
    Dec 17, 2012 at 12:41 am
  • Hello All, I have been using the AWS setup for EMR for some time now and I am currently in the process of implementing spark/shark on my own cluster. I am installing from ...
    Erik ThorsonErik Thorson
    Dec 10, 2012 at 9:46 pm
    Dec 14, 2012 at 9:02 am
  • Hi Is there a HiveQL statement to load, import or execute another HiveQL script, either local or in HDFS ? (yes, i already search in docs and book) AF
    Alexandre FoucheAlexandre Fouche
    Dec 13, 2012 at 1:00 pm
    Dec 13, 2012 at 11:22 pm
Group Navigation
period‹ prev | Dec 2012 | next ›
Group Overview
groupuser @
categorieshive, hadoop

82 users for December 2012

Nitin Pawar: 25 posts Mark Grover: 24 posts Mohammad Tariq: 24 posts imen Megdiche: 20 posts Ibrahim Yakti: 12 posts Edward Capriolo: 11 posts Java8964 java8964: 10 posts Souvik Banerjee: 10 posts Neil Guo: 8 posts Periya.Data: 8 posts Dean Wampler: 7 posts Chen Song: 6 posts Connell, Chuck: 6 posts Alexandre Fouche: 5 posts Bing Li: 5 posts John Omernik: 5 posts Krishna Rao: 5 posts Manish Malhotra: 5 posts Bejoy_ks: 4 posts David Koch: 4 posts
show more