Grokbase Groups Hive user March 2010

Search Discussions

55 discussions - 178 posts

  • Hello all, Is it possible in Hive 0.5 to run multiple inserts into the same Hive table/partition? Or is this not supported due to the fact that Hadoop doesn't support appends properly? For example, ...
    Ryan LeCompteRyan LeCompte
    Mar 17, 2010 at 7:31 pm
    Mar 17, 2010 at 9:08 pm
  • Hi all, I have a query below FROM ( SELECT h.* FROM ( -- Pull from the access_log SELECT ip, -- Reformat the time from the access log time, dt, --method, resource, protocol, status, length, referer, ...
    Prakash sejwaniPrakash sejwani
    Mar 9, 2010 at 8:14 am
    Mar 9, 2010 at 8:57 am
  • Hi, I encountered Parse Error creating table in CLI: [root@tyu-linux hive-0.5.0-bin]# bin/hive Hive history file=/tmp/root/hive_job_log_root_201003240832_1752130264.txt hive SHOW TABLES; OK Time ...
    Ted YuTed Yu
    Mar 25, 2010 at 4:30 pm
    Mar 26, 2010 at 4:37 am
  • Hi all, I have a table of 2 columns of strings, with example row as: Col1 Col2 123 23,34,45,67... up to around 1 million I'd like to expand the comma separated values to a new taller KVP table: Col1 ...
    Tim RobertsonTim Robertson
    Mar 16, 2010 at 10:03 am
    Mar 16, 2010 at 8:24 pm
  • I am trying out Hive, using Cloudera's EC2 distribution (Hadoop 0.18.3, Hive 0.4.1, I believe) I'm trying to run the following query which causes every map task to fail with an NPE before making any ...
    Tom NicholsTom Nichols
    Mar 4, 2010 at 8:35 pm
    Mar 15, 2010 at 3:43 pm
  • Hey folks, In case you're not following the action over at HIVE-705, we're getting close to having HBase integration committed into Hive. I've written up docs here: ...
    John SichiJohn Sichi
    Mar 5, 2010 at 2:58 am
    Mar 5, 2010 at 7:17 pm
  • Hello, Does Hive currently support arrays, maps, structs while using custom reduce/map scripts? '' in the example below produces an array of structs delimited by \2s and \3s. CREATE TABLE ...
    Dilip JosephDilip Joseph
    Mar 22, 2010 at 8:50 pm
    Mar 23, 2010 at 4:30 pm
  • Is there a way to remove columns from a Hive table via ALTER TABLE statement?
    Ryan LeCompteRyan LeCompte
    Mar 16, 2010 at 9:09 pm
    Mar 16, 2010 at 9:26 pm
  • Gents, Any ideas why this happens? Im using hive 0.50 with hadoop 20.2. This is a super simple UDF..... Im just taking the length of the values and then dividing by pi. It keeps popping up with this ...
    Tom kersnickTom kersnick
    Mar 11, 2010 at 12:56 am
    Mar 11, 2010 at 5:48 pm
  • Right now when we submit queries, it uses the "hadoop" scheduler. I have a custom fair share scheduler configured as well, but I see that jobs generated from our Hive queries never get picked up by ...
    Ryan LeCompteRyan LeCompte
    Mar 23, 2010 at 2:58 pm
    Mar 24, 2010 at 2:11 am
  • We're just starting with the HBaseIntegration, and are really excited about it, great work on this. Thanks We are running into a problem when joining two hbase tables. It seems to usually work when ...
    Daniel PrucklerDaniel Pruckler
    Mar 18, 2010 at 4:52 pm
    Mar 24, 2010 at 12:08 am
  • Hi, I am a newbie to hiveql. I love what I see but I am having issues with simple hive queries. Below is the transcript. Can someone tell me why reducers going backwards (goes to 67% and then drops ...
    Yekesa KosuruYekesa Kosuru
    Mar 18, 2010 at 3:46 am
    Mar 19, 2010 at 1:33 am
  • Hi, I am stuck with what is probably a beginner's mistake, but I simply don't know what's wrong. I have two tables aux1 and aux2, with each two columns objname (STRING) and no_null (INT). I want to ...
    Jan StöckerJan Stöcker
    Mar 9, 2010 at 10:51 am
    Mar 13, 2010 at 12:10 am
  • Hi All, i have a query below SELECT regexp_extract(resource,'/\&tag=([^\&]+)/') FROM a_log; it gives black result the sample resource string is like this ...
    Prakash sejwaniPrakash sejwani
    Mar 8, 2010 at 4:32 pm
    Mar 10, 2010 at 7:37 pm
  • Hi, I am trying to work on hooking MSTR with Hive on AWS cloud on Linux. Has any one implemented this and if you did can you share some of your lessons learned and if there is a doc with steps that ...
    Lenin GaliLenin Gali
    Mar 5, 2010 at 6:28 pm
    Mar 6, 2010 at 8:26 am
  • Hi All, I follow this link First, to create a new class that extends UDF, with one or more methods named evaluate Once hive is started up with your jars ...
    Prakash sejwaniPrakash sejwani
    Mar 3, 2010 at 10:50 am
    Mar 3, 2010 at 3:12 pm
  • Has anyone else been running into this issue? If not, what are we doing wrong to get hit by it? -Bryan
    Bryan TalbotBryan Talbot
    Mar 26, 2010 at 6:37 pm
    Apr 1, 2010 at 8:09 am
  • Hi Hadoop, Hive, and Sqoop users, For the past year, the Apache Hadoop MapReduce project has played host to Sqoop, a command-line tool that performs parallel imports and exports between relational ...
    Aaron KimballAaron Kimball
    Mar 29, 2010 at 7:03 pm
    Mar 29, 2010 at 8:28 pm
  • Hi guys, I have a table: CREATE TABLE clb_occ(classification_id STRING, taxon_concept_id STRING, taxon_name_id STRING, kingdom_concept_id STRING, phylum_concept_id STRING, class_concept_id STRING, ...
    Tim RobertsonTim Robertson
    Mar 29, 2010 at 2:44 pm
    Mar 29, 2010 at 3:03 pm
  • First of all, thank you to all of the facebook guys for hosting the hive user group last week. Second of all, does anyone have some SerDe code that uses arrays and structs on deserialization? Also, ...
    Adam O'DonnellAdam O'Donnell
    Mar 22, 2010 at 4:19 am
    Mar 22, 2010 at 5:24 am
  • Is there a way to avoid full table scan for an arbitrary where-clause usage ? partitioning/bucketing makes sense only when you know which columns will be searched upon. I was wondering if there is ...
    Prasenjit mukherjeePrasenjit mukherjee
    Mar 16, 2010 at 6:17 am
    Mar 16, 2010 at 2:24 pm
  • Hi all, I am running through the first basics on a fresh SVN build of Hive on top of 0.20.1 and seeing: Wrong FS: hdfs:// ...
    Tim RobertsonTim Robertson
    Mar 10, 2010 at 1:06 pm
    Mar 10, 2010 at 5:27 pm
  • I went to this link: q:1 When I try to compile it keeps failing on these: import org.apache.hadoop.hive.ql.exec.UDF; import; ...
    Tom kersnickTom kersnick
    Mar 4, 2010 at 6:34 pm
    Mar 9, 2010 at 6:10 pm
  • We have a query like... SELECT parse_url(url, 'QUERY:q') as query FROM table I'm sure this used to work in hive 0.4.1 and the docs suggest that 'QUERY:key' should extract the relevant key from a ...
    Andy KentAndy Kent
    Mar 9, 2010 at 1:07 pm
    Mar 9, 2010 at 3:49 pm
  • hi all, I have one hive query when i run from hive console like this hive FROM (SELECT h.*,p.title AS product_sku, p.description AS product_name, AS company_name, AS ...
    Prakash sejwaniPrakash sejwani
    Mar 5, 2010 at 2:13 pm
    Mar 5, 2010 at 5:04 pm
  • Hi all, I have a tables in hive of product_hits and company_hits i want to export the data to my web application which is build on ruby on rails framework to show this data in my app. table ...
    Prakash sejwaniPrakash sejwani
    Mar 3, 2010 at 11:05 am
    Mar 3, 2010 at 10:35 pm
  • when i run this query from hive console FROM ( SELECT h.*, p.title AS product_sku, p.description AS product_name, AS company_name, AS product_company_id, AS product_company_name ...
    Prakash sejwaniPrakash sejwani
    Mar 2, 2010 at 3:37 pm
    Mar 3, 2010 at 8:19 am
  • Hello all, I know that you can load data into Hive via: LOAD DATA LOCAL INPATH '/my/path/to/data.csv' OVERWRITE INTO TABLE my_table PARTITION(dt='XYZ'); ... where dt=XYZ is the partition where the ...
    Ryan LeCompteRyan LeCompte
    Mar 2, 2010 at 8:57 pm
    Mar 2, 2010 at 9:07 pm
  • I am using hive and hadoop 0.20.0 When i create the table in hive i get the following below is the log $HIVE_HOME/bin/hive -hiveconf hive.root.logger=INFO,console Hive history ...
    Prakash sejwaniPrakash sejwani
    Mar 1, 2010 at 10:13 am
    Mar 2, 2010 at 2:40 pm
  • Hi, could someone help me with a question to better understand how Hive interacts with Hadoop? I understood that for each Map/Reduce-Job Hive wants to get done, it creates one instance of "Task", ...
    Jan StöckerJan Stöcker
    Mar 30, 2010 at 9:16 am
    Mar 30, 2010 at 4:22 pm
  • Adding hive-user.
    Ted YuTed Yu
    Mar 26, 2010 at 4:40 am
    Mar 30, 2010 at 12:34 am
  • I would like to be able to read an Avro file as a Table in Hive. I have looked at the documentation, but cannot see anything about how to extend Hive to other file types. I don't want to control how ...
    Scott CareyScott Carey
    Mar 24, 2010 at 11:32 pm
    Mar 24, 2010 at 11:45 pm
  • Hi folks, As promised, today I have made available my findings and experiment results from my research project, examining the high level languages: Pig, Hive and JAQL. The project extends from ...
    Rob StewartRob Stewart
    Mar 23, 2010 at 2:12 pm
    Mar 24, 2010 at 1:48 am
  • Hi Guys, I am on Hive 0.5.0 to create an external tablea base on a SequenceFile and Map File These files are in hadoop dfs 18. The keys and values are based on custom class. I am not able to ...
    Sagar naikSagar naik
    Mar 22, 2010 at 7:32 pm
    Mar 22, 2010 at 7:40 pm
  • Hi, I have a question, in a remark that Alan Gates made a few months ago on the Pig mailing lists regarding the computability and expressibility of Pig, Hive, and the MapReduce model. In particular, ...
    Rob StewartRob Stewart
    Mar 21, 2010 at 4:01 pm
    Mar 21, 2010 at 5:38 pm
  • Hello, What are the delimiters for data to be loaded into a table with nested arrays, structs, maps etc? For example: CREATE TABLE nested ( s1 STRUCT<name:STRING, age: INT , a1 ARRAY<STRUCT<x:INT, ...
    Dilip JosephDilip Joseph
    Mar 20, 2010 at 1:08 am
    Mar 20, 2010 at 1:17 am
  • Are there any advantages/disadvantages to EXTERNAL tables? Is the only functional difference for a table declared as "EXTERNAL" that the user can specify where its files are located in HDFS?
    Mar 17, 2010 at 8:04 pm
    Mar 17, 2010 at 10:37 pm
  • [cross posting to hive-user] Oded - how did you create the table in Hive? Did you specify any row format SerDe for the table? If not, then that may be the cause of this problem since the default ...
    Arvind PrabhakarArvind Prabhakar
    Mar 17, 2010 at 8:40 pm
    Mar 17, 2010 at 10:09 pm
  • Does the latest version of Hive allow us to add a new partition column to an existing table with data? Thanks, Ryan
    Ryan LeCompteRyan LeCompte
    Mar 16, 2010 at 4:27 pm
    Mar 16, 2010 at 5:12 pm
  • Hi, I've had a look through the Wiki but couldn't see anything- is there a good (performant) way to check whether a partition exists for a table? For example, let's say I have a table that stores Ad ...
    Paul InglesPaul Ingles
    Mar 16, 2010 at 9:15 am
    Mar 16, 2010 at 12:06 pm
  • I create a table in hbase create 'hbase_table', 'colfam' Then run the following code to insert a row into the table: public class Test { public static void main(String[] args) throws Exception { ...
    Daniel PrucklerDaniel Pruckler
    Mar 15, 2010 at 8:47 pm
    Mar 15, 2010 at 10:33 pm
  • Hi: ALL I encounter a problem, any suggestion will be appreciated! MY hive version is 0.30.0 I create a table in CLI. CREATE TABLE table2 (boo int,bar string) ROW FORMAT SERDE ...
    Mar 10, 2010 at 9:02 am
    Mar 10, 2010 at 9:35 am
  • It looks like we can add columns to existing tables via: ALTER TABLE table_name ADD|REPLACE COLUMNS (col_name data_type [COMMENT col_comment], ...) However, I see the following comment in the Hive ...
    Ryan LeCompteRyan LeCompte
    Mar 9, 2010 at 8:25 pm
    Mar 9, 2010 at 9:25 pm
  • Hey guys, Here's a scenario: Cluster allows a max of 90 mappers and 90 reducers. 1) Submit a large job, which immediately utilizes all mappers and all reducers. 2) 10 minutes later, submit a second ...
    Ryan LeCompteRyan LeCompte
    Mar 8, 2010 at 7:39 pm
    Mar 8, 2010 at 8:57 pm
  • Hi all, I have a query below SELECT ip,dt,month,year FROM ac_log WHERE ac_log.month == 1 AND ac_log.year == 2010; when i run this query i get empty result out of it. Basically i want to extract the ...
    Prakash sejwaniPrakash sejwani
    Mar 8, 2010 at 9:33 am
    Mar 8, 2010 at 9:55 am
  • Hi, Does anyone have an estimate about how many downloads per month Hive has? Thanks. Yi
    Yi MaoYi Mao
    Mar 30, 2010 at 10:21 pm
    Mar 30, 2010 at 10:21 pm
  • Forwarding on behalf of Isabel Drost. The conference Berlin Buzzwords is looking for someone to present on Hive. Contact her on if you are interested. Hadoopberlin mailing list ...
    Johan OskarssonJohan Oskarsson
    Mar 27, 2010 at 11:50 am
    Mar 27, 2010 at 11:50 am
  • Hello , On our cluster (using redhat enterprise 5), we have hadoop 0.18.3 installed. When I do "show tables" on hive prompt, I get the following error java.lang.NoSuchFieldError: type at ...
    Katukuri, JayKatukuri, Jay
    Mar 23, 2010 at 12:49 am
    Mar 23, 2010 at 12:49 am
  • I don't know the details on how the resource sharing works (looks like the wiki is common to all hadoop projects?) but I've logged an infrastructure issue to see if we can get some attention for ...
    John SichiJohn Sichi
    Mar 16, 2010 at 9:42 pm
    Mar 16, 2010 at 9:42 pm
  • A couple weeks ago, we presented an overview of Hive at ICDE 2010. I have posted them at Thanks, raghu
    Raghu MurthyRaghu Murthy
    Mar 15, 2010 at 10:41 pm
    Mar 15, 2010 at 10:41 pm
Group Navigation
period‹ prev | Mar 2010 | next ›
Group Overview
groupuser @
categorieshive, hadoop

50 users for March 2010

Zheng Shao: 21 posts John Sichi: 15 posts Prakash sejwani: 15 posts Ryan LeCompte: 14 posts Edward Capriolo: 9 posts Tim Robertson: 9 posts Ning Zhang: 6 posts Mafish Liu: 5 posts Sonal Goyal: 5 posts Tom kersnick: 5 posts Dilip Joseph: 4 posts Ted Yu: 4 posts 김영우: 3 posts Aaron Kimball: 3 posts Arvind Prabhakar: 3 posts Carl Steinbach: 3 posts Daniel Pruckler: 3 posts Jan Stöcker: 3 posts Ray Duong: 3 posts Andy Kent: 2 posts
show more