Grokbase Groups Hive user August 2012
FAQ

Search Discussions

107 discussions - 380 posts

  • I have my below query in *test1.hql file. *I am trying to pass the date * (dt)* as the command line argument. *select * from lip_data_quality where dt = '${hiveconf: start_date}';* So whenever I try ...
    Techy TeckTechy Teck
    Aug 3, 2012 at 10:49 pm
    Aug 4, 2012 at 2:19 pm
  • *Problem* I created the below UserDefinedFunction to get the yesterday's day in the format I wanted as I will be passing the format into this below method from the query. *public final class ...
    Raihan JamalRaihan Jamal
    Aug 7, 2012 at 1:40 am
    Aug 8, 2012 at 11:41 pm
  • Hi, there I'm writing mapreduce to replace some hive query and I find that my mapper is slow than hive's mapper. The Hive query is like: select sum(column1) from table group by column2, column3; My ...
    Yue GuanYue Guan
    Aug 1, 2012 at 2:29 pm
    Aug 6, 2012 at 12:16 pm
  • is there a way to derive information (schema) off a hive table? doing a describe only shows the clolumn w/ types. But i want to know if a table is like this: ROW FORMAT DELIMITED FIELDS TERMINATED BY ...
    Anson AbrahamAnson Abraham
    Aug 2, 2012 at 7:05 pm
    Aug 2, 2012 at 10:14 pm
  • I have the data in s3 bucket in the following manner s3://logs/ad1date2.log.gz s3://logs/ad1date3.log.gz s3://logs/ad1date4.log.gz s3://logs/ad2date1.log.gz s3://logs/ad2date2.log.gz ...
    Ravi ShetyeRavi Shetye
    Aug 24, 2012 at 12:24 pm
    Aug 27, 2012 at 2:34 pm
  • Hi All, One of my Query output looks like- Alpha Beta Gamma 123 xyz 1.0 123 abc 0.5 123 pqr 1.3 123 def 2.1 456 xyz 0.1 456 abc 0.6 456 pqr 1.9 456 def 3.2 456 lmn 1.1 456 sdf 1.2 I want the output ...
    Richin JainRichin Jain
    Aug 7, 2012 at 8:58 pm
    Aug 16, 2012 at 2:40 pm
  • Hi, The column names in hive are by default case insensitive. I was wondering if there is any way, I could make the column names case sensitive? I am running a model on a data, the data is now stored ...
    Mayank BansalMayank Bansal
    Aug 14, 2012 at 3:27 pm
    Aug 15, 2012 at 8:48 pm
  • I have used the following to output a hive table to a file: DROP TABLE IF EXISTS myoutputable; CREATE TABLE myoutputtable ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' STORED AS TEXTFILE AS select * ...
    Zuohua zhangZuohua zhang
    Aug 7, 2012 at 4:09 am
    Sep 5, 2012 at 1:58 pm
  • Hi all, How to avoid serialization and deserialization overhead in hive join query ? will this optimize my query performance. Regards sudeep
    Sudeep tokalaSudeep tokala
    Aug 14, 2012 at 3:08 pm
    Aug 14, 2012 at 9:02 pm
  • Hi, I would like to have more information about this specific sentence from the documentation. "HiveServer can not handle concurrent requests from more than one client." ...
    Bertrand DechouxBertrand Dechoux
    Aug 27, 2012 at 4:01 pm
    Aug 28, 2012 at 1:42 am
  • Hi all, I was testing hbase integrated with hive, and running into an issue. Would anyone has an idea what it means? hbase(main):001:0 CREATE TABLE hbase_mstr_1(key int, value string) STORED BY ...
    Omer, FarahOmer, Farah
    Aug 14, 2012 at 3:06 pm
    Aug 14, 2012 at 5:11 pm
  • Dear all, I am trying to execute this query : SELECT distinct(buyerid) from transaction WHERE buyerid NOT IN(SELECT distinct(sellerid) from transaction) This gives me the following error: FAILED ...
    Prakrati AgrawalPrakrati Agrawal
    Aug 14, 2012 at 9:14 am
    Aug 14, 2012 at 9:56 am
  • Hi, Is there any version of Hive for append operations (Insert or Update) via HiveQL? If so please point me at any HiveQL documentation that explains how the append operations work? -- Thanks, sandeep
    Sandeep Reddy PSandeep Reddy P
    Aug 9, 2012 at 2:26 pm
    Aug 9, 2012 at 7:24 pm
  • Is there any way to get the current date -1 in Hive means yesterdays date always?
    Techy TeckTechy Teck
    Aug 6, 2012 at 6:11 pm
    Aug 7, 2012 at 11:37 pm
  • SELECT count(*) from data_realtime where dt='20120730' and uid is null I get the count as *1509* So that means If I will be doing SELECT * from data_realtime where dt='20120730' and uid is null I ...
    Techy TeckTechy Teck
    Aug 7, 2012 at 5:14 pm
    Aug 7, 2012 at 6:32 pm
  • Hey Hive gurus - Does anyone know how the CLI handles metastore connection timeouts? It seems if I leave a CLI session idle more than hive.metastore.client.socket.timeout seconds then run "show ...
    Travis CrawfordTravis Crawford
    Aug 1, 2012 at 4:02 pm
    Aug 1, 2012 at 7:03 pm
  • Hi, all I tried to use Chinese in hive column comment and table comment,and the metadata in Mysql is regular,the charset of 'COMMENT' column in 'columns_v2' table and 'PARAM_VALUE' column in ...
    NamasAmitabhaNamasAmitabha
    Aug 21, 2012 at 5:31 am
    Jan 18, 2013 at 5:41 am
  • Hi, We have a huge table which may have duplicate records.A record is considered duplicate based on 4 fields ( fld1 thru fld4) . We need to identify the duplicate records and possibly mark the ...
    Himanish KusharyHimanish Kushary
    Aug 17, 2012 at 2:50 pm
    Aug 21, 2012 at 5:30 pm
  • Hi, We have two tables in the following structure : Table1 : ------------------------------------------------------------------------ Table-2 We want to find out the packid from Table1 where the is ...
    Himanish KusharyHimanish Kushary
    Aug 16, 2012 at 6:07 pm
    Aug 17, 2012 at 1:52 pm
  • I ran the following command trying to setup my hive directory, but got the following error. root@cdh-client:/# hadoop fs -mkdir /user/hive/warehouse mkdir ...
    Sean BigdatafunSean Bigdatafun
    Aug 16, 2012 at 5:51 am
    Aug 16, 2012 at 2:04 pm
  • Hi, I have setup a Hadoop cluster on Amazon EC2 with my data stored on S3. I would like to use Hive to process the data on S3. I created an external table in hive using the following: CREATE EXTERNAL ...
    Suman AddankiSuman Addanki
    Aug 24, 2012 at 8:44 pm
    Aug 30, 2012 at 6:56 pm
  • Hi I am using PostgreSQl-9.0.7 as metastore and + Hive-0.9.0. I integrated postgres with hive. Few queries are working fine. I am using postgresql-9.0-802.jdbc3.jar for connecting to JDBC. But "drop ...
    RohithsharmaRohithsharma
    Aug 28, 2012 at 2:22 pm
    Aug 29, 2012 at 6:24 am
  • Hello, We have hive external table mapped to hbase, now moving from pseudo distributed to fully distributed hadoop cluster. found that hive queries are still pointing to older namenode address ie ...
    Alok KumarAlok Kumar
    Aug 24, 2012 at 8:01 am
    Aug 25, 2012 at 12:30 pm
  • Hi, We have a complex query that involves several left outer joins resulting in 8 M/R jobs in Hive.During execution of one of the stages ( after three M/R has run) the M/R job fails due to few Reduce ...
    Himanish KusharyHimanish Kushary
    Aug 24, 2012 at 2:36 pm
    Aug 24, 2012 at 6:21 pm
  • Hi, We are facing this issue where we run a hive job over huge data about ~6 TB input. We run this from hive client and hive metastore server is on another machine. If we have smaller input, this job ...
    Anurag TangriAnurag Tangri
    Aug 11, 2012 at 3:37 am
    Aug 11, 2012 at 3:21 pm
  • The Apache Hive PMC has passed a vote to make Navis Ryu a new committer on the project. JIRA is currently down, so I can't send out a link with his contribution list at the moment, but if you have an ...
    John SichiJohn Sichi
    Aug 10, 2012 at 9:59 am
    Aug 10, 2012 at 6:11 pm
  • Hi (vers), This might be a very basic question for most of you but I am stuck at it for quite some time now. I have a table with three columns : Describe usage; ts string id string metric double I am ...
    Richin JainRichin Jain
    Aug 9, 2012 at 8:33 pm
    Aug 9, 2012 at 9:19 pm
  • Hello, I created a managed table in HIVE when i intended for it to be external, is it possible for me to change the table back to external? OR do I have to copy the data to a new directory, drop the ...
    Babe RuthBabe Ruth
    Aug 7, 2012 at 6:08 am
    Aug 7, 2012 at 9:43 pm
  • I am writing a simple query on our hive table and I am getting some exception- select count(*) from table1 where dt='20120731'; java.io.IOException: IO error in map input file ...
    Techy TeckTechy Teck
    Aug 6, 2012 at 9:54 pm
    Aug 7, 2012 at 5:42 am
  • Hi, I would like to load an XML data file into HIVE. I created a table with just one column: create table xmltable (xmldata String ) STORED AS TEXTFILE; and then loaded the xml file into that table ...
    Sadananda HegdeSadananda Hegde
    Aug 30, 2012 at 7:57 pm
    Sep 3, 2012 at 10:55 am
  • Hi All, I am joining 2 tables in hive, with or condition. for example: select blah from table a Join table b *on (a.col1 = b.col2 or a.col2 = 0)* * * but this is giving me error that OR not supported ...
    Sonia gehlotSonia gehlot
    Aug 29, 2012 at 9:44 pm
    Aug 29, 2012 at 10:03 pm
  • Hi I have a lot of compressed gzip files on hdfs. An exception has occurred at TaskTracker, during processing of MR. If any file is invalid, may I know that? 2012-08-28 09:17:56,320 INFO ExecMapper ...
    Kiwon LeeKiwon Lee
    Aug 28, 2012 at 2:23 pm
    Aug 29, 2012 at 10:33 am
  • Hi, I have run "analyse table" command several times to get statistics, but I always get num_rows=0 like below. (also, raw_data_size is 0) ----- hive analyze table lineitem compute statistics; Total ...
    Hiroyuki YamadaHiroyuki Yamada
    Aug 29, 2012 at 6:27 am
    Aug 29, 2012 at 9:35 am
  • Hi, I have uploaded few csv files from windows into hive and configured few external tables using them. When I am trying to run a join on two tables one of the int columns get changed to 0. The ...
    Himanish KusharyHimanish Kushary
    Aug 15, 2012 at 3:43 pm
    Aug 16, 2012 at 1:33 pm
  • Does the hive command make use of an exit status for success vs. failure? I am asking this question as I am executing my few HiveQL queries from my Shell Script and If one HiveQL queries gets failed ...
    Raihan JamalRaihan Jamal
    Aug 16, 2012 at 12:04 am
    Aug 16, 2012 at 1:07 am
  • Would like to extract a uniform random sample from a hive table? How should I write the query? Thanks!
    Zuohua zhangZuohua zhang
    Aug 14, 2012 at 10:19 pm
    Aug 15, 2012 at 4:04 pm
  • Hi Users, I have an HDFS set up with 1 master node and 2 slave nodes.Is it possible loading data only into master node,with out disturbing the configuration of other 2 slave nodes. Thanks in ...
    Shaik ahamedShaik ahamed
    Aug 14, 2012 at 8:11 am
    Aug 14, 2012 at 9:54 am
  • Team, I'm a new Hive user and I've just run my first large query (a few hours). Unfortunately, I ran it from the CLI, and the output was longer than my SSH client allowed for (scroll buffer) so I ...
    Tom BrownTom Brown
    Aug 9, 2012 at 9:32 pm
    Aug 9, 2012 at 11:48 pm
  • Hi all, I have 3 tables in Mysql and i want to club the data of 3 tables in 1 table of hive.(create a data warehouse).I created table with all the columns of 3 tables but i am unable to push data in ...
    Iwannaplay gamesIwannaplay games
    Aug 1, 2012 at 6:58 am
    Aug 1, 2012 at 8:55 am
  • I have a Hive column with JSON string like: ["9835","29825","73432","51365","14114","6527","779"] I want to explode() it and use with the LATERAL VIEW. For that it needs to be a Hive array. Is there ...
    Aleksei UdatšnõiAleksei Udatšnõi
    Aug 29, 2012 at 1:50 pm
    Aug 29, 2012 at 7:32 pm
  • Hi, I am executing the command : insert overwrite directory '/feed/daily/2011-07-16' select count(1) from distinctpacks; but am getting the error Failed with exception Unable to rename: ........... ...
    Himanish KusharyHimanish Kushary
    Aug 17, 2012 at 7:36 pm
    Aug 27, 2012 at 5:16 pm
  • I see that hive has away to take a table and produce multiple rows. Is there a built in way to do the reverse? Say I have a table with a unique key and an array. I do this: originalTable Now I have a ...
    Mike FlemingMike Fleming
    Aug 23, 2012 at 4:45 pm
    Aug 23, 2012 at 5:31 pm
  • Hi, I build a compact index IX for table A as follows, create index IX on table A(a, b) as 'COMPACT' with deferred rebuild in table A_IX. When I run the following query, select c, d from A where ...
    LinLin
    Aug 22, 2012 at 3:39 am
    Aug 22, 2012 at 5:47 pm
  • Hi, I am facing a weird issue.Probably I am missing something.Could somebody please guide me. I have three tables in hive. Table A - clientid,shopid,shopposition,shopdate,shopitemid,shopitemdescr ...
    Himanish KusharyHimanish Kushary
    Aug 18, 2012 at 2:51 am
    Aug 20, 2012 at 3:23 pm
  • Hi, I have complex log files (compressed ".gz", 200G) on HDFS. + log file format : 127.0.0.1 [2012Avg08] "a=abc&b=adf&c=aadfad" I think DDL)), CREATE TABLE log_tb (ip STRING, dt STRING, kv ...
    Kiwon LeeKiwon Lee
    Aug 17, 2012 at 3:29 pm
    Aug 18, 2012 at 7:16 am
  • Hello, Is there a way to aggregate multiple columns in Hive? I can do it in two separate queries but is there something similar to sum(col1,col2)? Thanks, Richin
    Richin JainRichin Jain
    Aug 16, 2012 at 2:29 pm
    Aug 16, 2012 at 4:14 pm
  • Hi I am trying to consolidate one of my staged tables with a primary table (incremental loading). Simply need to merge 2 tables using UNION ALL. Tried the following: select * from main_table UNION ...
    Balaraman, AnandBalaraman, Anand
    Aug 16, 2012 at 6:08 am
    Aug 16, 2012 at 9:58 am
  • Below is the data in *favorite_result (datatype: array<string ) *column. Its an array of String in hive- ...
    Techy TeckTechy Teck
    Aug 11, 2012 at 3:05 am
    Aug 11, 2012 at 8:54 am
  • Hi, I have a Cassandra Column Family and I need to write some of the data to a file in the local file system. And the data in the file should be ordered by the payload_logTime. Below is the code ...
    Manisha GayathriManisha Gayathri
    Aug 10, 2012 at 11:03 am
    Aug 10, 2012 at 11:35 am
  • Hi Users, I m trying to load data into hive table using shell script. unable to load data into hive table. *sample.sh* export HADOOP_HOME=/usr/local/hadoop bin/hive load data local inpath ...
    Prabhu kPrabhu k
    Aug 9, 2012 at 1:58 pm
    Aug 9, 2012 at 2:18 pm
Group Navigation
period‹ prev | Aug 2012 | next ›
Group Overview
groupuser @
categorieshive, hadoop
discussions107
posts380
users109
websitehive.apache.org

109 users for August 2012

Techy Teck: 37 posts Bejoy KS: 30 posts Bertrand Dechoux: 16 posts Himanish Kushary: 15 posts Raihan Jamal: 14 posts Edward Capriolo: 13 posts Richin Jain: 11 posts Jan Dolinár: 10 posts Yue Guan: 8 posts Kulkarni Swarnim: 7 posts Rohithsharma: 7 posts Sandeep Reddy P: 7 posts Travis Crawford: 7 posts Vinod Singh: 7 posts Philip Tromans: 6 posts Prabhu k: 5 posts Shaik ahamed: 5 posts Sudeep tokala: 5 posts Anson Abraham: 4 posts Balaraman, Anand: 4 posts
show more
Archives