Grokbase Groups Hive user April 2012

Search Discussions

83 discussions - 343 posts

  • It seems there's enough information to be found on how to setup and use partitions and buckets. But I'm more interested in how to figure out when and what columns you should be partitioning and ...
    Ruben de VriesRuben de Vries
    Apr 23, 2012 at 3:19 pm
    Apr 26, 2012 at 9:06 am
  • Hi, Is there something like a 'lag' function in HIVE? The requirement is to calculate difference for the same column for every 2 subsequent records. For example. Row, Column A, Column B 1, 10, 100 2, ...
    Karanveer SinghKaranveer Singh
    Apr 10, 2012 at 1:45 pm
    Apr 11, 2012 at 9:39 pm
  • hi all, I do feel frustrated when starting the thrift server. I tried different version of hadoop(1.0.1 and 0.20.2), but when I tried 'hive --service hiveserver', the server hung there and printed ...
    Apr 10, 2012 at 12:33 pm
    Apr 11, 2012 at 7:57 pm
  • I'm trying to migrate a part of our current hadoop jobs from normal mapreduce jobs to hive, Previously the data was stored in sequencefiles with the keys containing valueable data! However if I load ...
    Ruben de VriesRuben de Vries
    Apr 19, 2012 at 10:08 am
    Apr 19, 2012 at 6:13 pm
  • Resending, as I forgot to change the subject line in my last post. Pls respond to this email. Does HIVE support SQL 99 'WITH' clause yet? I dod not find definitive answer in the web. I am in thr ...
    Sukhendu ChakrabortySukhendu Chakraborty
    Apr 17, 2012 at 6:02 pm
    Apr 18, 2012 at 8:45 pm
  • Hi All, Is it possible to install hive on a machine that is not a member of Hadoop cluster (and it does not have hadoop installation on it, i.e. no HADOOP_HOME or its entry in path)? Thanks, Keshav ...
    Savant, KeshavSavant, Keshav
    Apr 25, 2012 at 7:45 am
    May 1, 2012 at 5:51 pm
  • Is there a way to query using Hive on existing table records in HBase?
    Vishal M. KatkarVishal M. Katkar
    Apr 7, 2012 at 6:43 pm
    Apr 10, 2012 at 8:20 am
  • Hi, When I run a query that uses a custom UDF I made, one of the lines it prints out is: Number of reduce tasks determined at compile time: 1 And this causes the MapReduce job to have only 1 ...
    Ryabin, ThomasRyabin, Thomas
    Apr 27, 2012 at 8:49 pm
    Apr 30, 2012 at 5:27 pm
  • Hi All, We did a successful setup of hadoop- and hive-0.7.1. We also loaded a large number of CSV files into HDFS successfully. We can query through hive CLI. Now we want to search for an ...
    Garg, RinkuGarg, Rinku
    Apr 19, 2012 at 12:19 pm
    Apr 30, 2012 at 10:02 am
  • Hello all, I want to deploy my task on Amazon EMR. But as I am new to Amazon Web Services I am confused in understanding the concepts. My Use Case: I want to import the large data from EC2 through ...
    Bhavesh ShahBhavesh Shah
    Apr 23, 2012 at 12:42 pm
    Apr 27, 2012 at 9:46 am
  • Hi, What's the lifecycle of a hive udf. If I call select MyUDF(field1,field2) from table; Then MyUDF is instantiated once per mapper, and within each mapper execute(field1, field2) is called for each ...
    Ranjan BagchiRanjan Bagchi
    Apr 18, 2012 at 11:22 pm
    Apr 24, 2012 at 7:45 am
  • Hi all, Adding a column by alter table mytable add column (mynewcolumn string); works well for me. This adds a field to the end of the schema. Is there a way to add a column in between two columns? ...
    Chalcy RajaChalcy Raja
    Apr 30, 2012 at 10:43 pm
    May 2, 2012 at 1:00 pm
  • Hi, I have a table partitioned by local_date. When I write a query with WHERE local_date = =date_add('2011-12-07',3) , hive executes the UDF ahead and looks only into the specific partitions. But ...
    Apr 19, 2012 at 9:57 am
    May 1, 2012 at 1:43 pm
  • Hello Everyone , We have a pig based ETL process and output of those are processed csv files. Now just want to learn about best practices on how you guys insert the data in dynamically generated ...
    Apr 20, 2012 at 3:08 pm
    Apr 20, 2012 at 5:06 pm
  • Hi I want to import the updated data from my source (PostgreSQL) to hive based on a column (lastmodifiedtime) in postgreSQL *The command I am using* /app/sqoop/bin/sqoop import --hive-table users ...
    Roshan PradeepRoshan Pradeep
    Apr 13, 2012 at 6:54 am
    Apr 16, 2012 at 5:48 am
  • Hello All I am trying to start Thrift server on HIVE My configuration for Hadoop is Pseudo mode When i say hive --service hiveserver It just prints Starting Hive Thrift Server WARNING ...
    Shin ChanShin Chan
    Apr 5, 2012 at 3:44 pm
    Apr 5, 2012 at 5:01 pm
  • Hello all, I launched my instance on Amazon EMR. And I run the job yesterday on it and I got the following error in log fies (Log Files of JobTracker) DataStreamer Exception ...
    Bhavesh ShahBhavesh Shah
    Apr 26, 2012 at 2:06 pm
    Apr 26, 2012 at 8:55 pm
  • Hi, I know that it is possible to use regex column specification with the SELECT clause like so: SELECT `employee.*` FROM employees; I was wondering if it is possible to use it with the WHERE clause ...
    Ryabin, ThomasRyabin, Thomas
    Apr 23, 2012 at 1:44 pm
    Apr 24, 2012 at 1:37 pm
  • hi,all; I have a problem. I have an hbase table, with key-value pair like "user1001:12,1223,string". And now how can I split the value into three fields "ID,phone,and memo" and then insert into hive ...
    Apr 18, 2012 at 7:36 am
    Apr 18, 2012 at 8:26 am
  • Hi, guys I ran Hive-0.8.0 UT with - Hadoop-1.0.0 ( applied patches for HIVE-2631 and HIVE-2629) - HBase-0.92.0 - Zookeeper-3.4.2 But got the following error message: [echo] Project: hbase-handler ...
    Bing LiBing Li
    Apr 13, 2012 at 10:34 am
    Apr 14, 2012 at 3:00 am
  • Hi, Is there some way I can do graph, plotting, etc. within Hive? Are there any UDF's for same? Regards, Karan This e-mail and any attachments are confidential and intended solely for the addressee ...
    Karanveer SinghKaranveer Singh
    Apr 11, 2012 at 5:51 am
    Apr 12, 2012 at 11:18 am
  • Okay first off; so JOIN + LATERAL VIEW together isn't working so I moved my JOIN into a subquery and that makes the query work properly However when I added a MAPJOIN hint for the JOIN in the ...
    Ruben de VriesRuben de Vries
    Apr 26, 2012 at 1:17 pm
    May 1, 2012 at 12:06 pm
  • I have a hive table tab3 with two columns (c1 int, c2 int) hive load data local inpath '/tmp/orhc466fb981' into table tab3; Copying data from file:/tmp/orhc466fb981 Copying file ...
    Sukhendu ChakrabortySukhendu Chakraborty
    Apr 24, 2012 at 12:55 am
    Apr 24, 2012 at 11:40 am
  • Hi, Scenario: I have started my Hadoop processes (dfs and mapred). I have also started by Hive thrift server using the command: $bin/hive --service hiveserver. I want to execute a query file {nothing ...
    Chandan B.KChandan B.K
    Apr 17, 2012 at 11:02 am
    Apr 19, 2012 at 3:26 pm
  • Hi, I wanted to create an HBase table with pre-split regions in the beginning using HBase-Hive Integration. I have read and I wanted to know *what ...
    Narayanan KNarayanan K
    Apr 17, 2012 at 3:23 pm
    Apr 18, 2012 at 8:05 am
  • hi, all. I see something strange. the defaule delimiter is \001 and I want to change to '||'. So I just run my command : CREATE TABLE table1( channelid INT,serviceno STRING,regid STRING,pageurl ...
    Apr 13, 2012 at 1:24 pm
    Apr 13, 2012 at 2:07 pm
  • Hey all, Running 0.7.1 We are using a combination of hive-thrift+ zookeeper for locking. All works well for a couple days until eventually we hit this condition. HiveServerException(message:Query ...
    Edward CaprioloEdward Capriolo
    Apr 11, 2012 at 2:30 pm
    Apr 11, 2012 at 3:04 pm
  • Hi All, I am trying to use hive inside an OSGi enviornment. So far I faced several OSGi issues in hive and some issues related to JDO implementation used (datanucleaus) under the OSGi enviornemnt and ...
    Buddhika chamithBuddhika chamith
    Apr 5, 2012 at 5:13 pm
    Apr 9, 2012 at 8:48 am
  • Hi, I have this external jar with UDFs . I do not want to everyone in the company using these functions to run add jar blah.jar; create temporary function blah as ''; . I want ...
    Sam WilliamSam William
    Apr 5, 2012 at 7:35 pm
    Apr 5, 2012 at 8:49 pm
  • I have a file which has fields delimited by chr(28) - fs. How do I specify this in field delimited by? Thanks, Stefanie Chen
    Chen, Stefanie (GBI)Chen, Stefanie (GBI)
    Apr 4, 2012 at 8:12 pm
    Apr 5, 2012 at 1:07 am
  • I am trying to understand what are some of the options/settings available to tune the performance of Hive Queries. I have seen the benefits of Map side joins and Partitioning/Clustering. However I ...
    Ladda, AnandLadda, Anand
    Apr 1, 2012 at 6:30 pm
    Apr 3, 2012 at 1:33 pm
  • Hi All, I see there are some hadoop packages present inside hive-exec jar. (for example org.apache.hadoop.fs etc.). My guess is that these classes extend some hadoop interfaces/ functionality ...
    Buddhika chamithBuddhika chamith
    Apr 2, 2012 at 9:55 am
    Apr 2, 2012 at 5:02 pm
  • I've been trying to figure this out for a couple days now and I haven't gotten very far. Looking for your guidance on the matter. As a test, I'm trying to import Facebook Open Graph API data into ...
    Anurag GulatiAnurag Gulati
    Apr 2, 2012 at 1:38 am
    Apr 2, 2012 at 9:00 am
  • Hello all, I’m a fresher with hadoop/hbase/hive, there is a requirement with our biz, I need to build the env with hive and hbase for audit log data store and analytics. I just tried to integrate ...
    Peyton PengPeyton Peng
    Apr 26, 2012 at 7:44 am
    Apr 26, 2012 at 8:23 am
  • Hello all, I have written this small program But I am getting error. Program: ------------- import; import; import java.sql.Connection; import ...
    Bhavesh ShahBhavesh Shah
    Apr 26, 2012 at 6:14 am
    Apr 26, 2012 at 7:40 am
  • Hi, How do I get the current date in Hive? Specifically, I’m looking for the equivalent of following SQL where clause: where LOCAL_DT = current date - 3 day I tried using where local_dt = ...
    Saurabh SSaurabh S
    Apr 26, 2012 at 12:49 am
    Apr 26, 2012 at 7:39 am
  • Hi, I'm planning to start using Amazon RDS as the metastore for Hive (running of Amazon EMR). Is there any ball park figure for the size of the RDS instance required? I guess this depends on number ...
    Pedro FigueiredoPedro Figueiredo
    Apr 25, 2012 at 11:17 pm
    Apr 26, 2012 at 12:14 am
  • In Hive, I'm having issues doing an insert overwrite table to a table that is in avro format. So my existing table (table1) is read from a hdfs directory where the files are in avro format. I created ...
    Anson AbrahamAnson Abraham
    Apr 25, 2012 at 2:40 pm
    Apr 25, 2012 at 5:53 pm
  • It's a bit of a weird case but I thought I might share it and hopefully find someone who can confirm this to be a bug or tell me I should do things differently! Here you can find a pastie with the ...
    Ruben de VriesRuben de Vries
    Apr 23, 2012 at 1:08 pm
    Apr 25, 2012 at 7:15 am
  • Hello, I would like to embed Hive (client) in my application to execute a sequence of queries. Right now I do it using CLI (hive -f myScript.sql). Problem with this approach is that I do not get an ...
    Vinod SinghVinod Singh
    Apr 25, 2012 at 5:33 am
    Apr 25, 2012 at 5:53 am
  • Hello, I have created a custom UDTF called "test_udtf". This function takes 4 parameters. Right now I can use this function like so in the following query: SELECT test_udtf(product, store, 'test0', ...
    Ryabin, ThomasRyabin, Thomas
    Apr 24, 2012 at 4:46 pm
    Apr 24, 2012 at 7:49 pm
  • I have managed to get the hbase table throught hive using: ResultSet rs = stmt.executeQuery("select split(value,',') from table1"); but how is the result set look like? and if I want to put this ...
    Apr 19, 2012 at 1:55 am
    Apr 19, 2012 at 10:59 am
  • Hi Guys, Any idea, how to calculate median in Hive? Do we have any inbuilt function for it? Thanks for any help. Sonia
    Sonia gehlotSonia gehlot
    Apr 18, 2012 at 10:33 pm
    Apr 18, 2012 at 11:25 pm
  • Dear Hive User, We want your interesting case study for our upcoming book titled 'Programming Hive' from O'Reilly. How you use Hive, either high level or low level code details are both encouraged! ...
    Jason RutherglenJason Rutherglen
    Apr 11, 2012 at 5:48 pm
    Apr 17, 2012 at 2:23 pm
  • Hello all, I want to query like below in Hive: Select a.* FROM tblA a JOIN tblB b ON a.field1 = b.field1 where (a.field2 is null or not exists(select field2 from tblB where filed2 is not null) But I ...
    Bhavesh ShahBhavesh Shah
    Apr 11, 2012 at 1:00 pm
    Apr 11, 2012 at 2:16 pm
  • Are hive jars available on any public maven repos ? If not, is there a way to ask ant to install the built jars to my local ~/.m2/repository ? Sam William
    Sam WilliamSam William
    Apr 10, 2012 at 7:35 pm
    Apr 10, 2012 at 7:43 pm
  • Hello all, I am trying to check age in hive. select * from tbl_name where datediff(date,dob)/365 = 18; Is it right to check date condition in hive? Or do I need to do something else. Pls suggest me ...
    Bhavesh ShahBhavesh Shah
    Apr 2, 2012 at 7:35 am
    Apr 2, 2012 at 8:35 am
  • HI, Is this (Ability to define functions in HQL) likely to be in for the next release ? I think this a very useful feature. Basically, Im trying to ...
    Sam WilliamSam William
    Apr 30, 2012 at 8:22 pm
    Apr 30, 2012 at 8:29 pm
  • Hi, I would like to update/fix some sections in the hive confluence wiki. Please grant write access. My user name is thejas. Thanks, Thejas
    Thejas NairThejas Nair
    Apr 30, 2012 at 5:44 pm
    Apr 30, 2012 at 8:02 pm
  • Hi While using dynamic partitions can we do something like this FROM stage_customer sh INSERT OVERWRITE TABLE Fact_Customer PARTITION(year ...
    Shin ChanShin Chan
    Apr 25, 2012 at 9:52 am
    Apr 25, 2012 at 2:10 pm
Group Navigation
period‹ prev | Apr 2012 | next ›
Group Overview
groupuser @
categorieshive, hadoop

87 users for April 2012

Nitin Pawar: 24 posts Edward Capriolo: 22 posts Bejoy KS: 21 posts Ruben de Vries: 18 posts Ylyy-1985: 16 posts Bhavesh Shah: 15 posts Shashwat shriparv: 12 posts Binhnt22: 11 posts Mark Grover: 11 posts Karanveer Singh: 9 posts Ladda, Anand: 9 posts Ryabin, Thomas: 8 posts Buddhika chamith: 7 posts Vishal M. Katkar: 7 posts Ashwanth Kumar: 6 posts Bing Li: 6 posts David Kulp: 6 posts Philip Tromans: 6 posts Sukhendu Chakraborty: 6 posts Tim Robertson: 6 posts
show more