Grokbase Groups Hive user August 2011

Search Discussions

72 discussions - 277 posts

  • Hi all, I've been struggling with getting Hive authorization to work for a few hours, and I really hope someone can help me. I installed Hive 0.7.1 on top of Hadoop 0.20.203. I'm using mysql for the ...
    Alex HolmesAlex Holmes
    Aug 16, 2011 at 9:55 pm
    Aug 26, 2011 at 12:04 pm
  • I run the following simple sql select count(*) from sales; And the job information shows it only uses one map task. The underlying hadoop has 3 data/data nodes. So I expect hive should kick off 3 map ...
    Aug 23, 2011 at 1:51 pm
    Aug 25, 2011 at 2:52 pm
  • Hi, Can somebody point me to production level setup of Hive in EC2. The intent is to know the setup best practices being employed. Thanks.
    Aug 30, 2011 at 6:03 am
    Aug 31, 2011 at 8:35 pm
  • hi, I'm try to use postgres as stats database. And made following settings in hive-site.xml <property <name hive.stats.dbclass</name <value jdbc:postgresql</value <description The default database ...
    Aug 15, 2011 at 7:10 am
    Jan 7, 2013 at 10:07 am
  • Greetings, could somebody confirm/correct my understanding of a fully distributed Hive setup, please? My setup is as follows * *Java application using Hive JDBC driver *connects to * *hive --service ...
    Christian KurzChristian Kurz
    Aug 24, 2011 at 2:53 pm
    Aug 26, 2011 at 9:52 am
  • HI team, i m facing this problem. show tables is running fine but when i run below query. hive select * from aircel_obd; FAILED: Hive Internal Error: java.lang.NullPointerException(null) ...
    Vikas SrivastavaVikas Srivastava
    Aug 23, 2011 at 1:56 pm
    Aug 26, 2011 at 8:02 am
  • Hey Folks, I am wondering what is the easiest way to migrate data off one hadoop/hive cluster to another. I distcp all data to new cluster, and then copied the metadata directory to new cluster. hive ...
    Bhupesh BansalBhupesh Bansal
    Aug 19, 2011 at 9:27 pm
    Aug 24, 2011 at 6:22 pm
  • suppose the table is partitioned by period_key, and the csv file also has a column named as period_key. The csv file contains multiple days of data, how can we load it in the the table? I think of an ...
    Aug 12, 2011 at 6:30 am
    Aug 14, 2011 at 11:22 pm
  • Hi, I build custom UDFS for hive and they seem to work fine when i explicitly register the jars using the "add jar <jarname " command or put in in the environment variable "HIVE_AUX_JARS_PATH". But ...
    Amit SharmaAmit Sharma
    Aug 22, 2011 at 9:42 pm
    Aug 26, 2011 at 7:14 pm
  • Hello, I have external tables in Hive stored in a single flat text file. When I execute queries against it, all of my jobs are run as a single map task, even on very large tables. What steps do I ...
    Jon BenderJon Bender
    Aug 15, 2011 at 5:24 pm
    Aug 17, 2011 at 1:28 am
  • hi, I create a udf to decode urlencoded things, but found the speed for mapred is 3 times(73sec - 213 sec) as before. How to optimize it? package com.test.hive.udf; import ...
    Aug 15, 2011 at 8:50 am
    Aug 16, 2011 at 6:34 am
  • if the retailer fact table is sale_fact with 10B rows, and join with 3 small tables: stores (10K), products(10K), period (1K). What's the best join solution? In oracle, it can first build hash for ...
    Aug 12, 2011 at 2:02 am
    Aug 15, 2011 at 1:07 am
  • when I submit a ql to hive, it is a very long time until it really submit the job to the hadoop cluster, what may cause this problem ?* *thank you for your help.* hive select count(1) from log_test ...
    Aug 9, 2011 at 8:20 am
    Aug 11, 2011 at 8:07 am
  • Hi, I have UDF jar that I need to install so that the Hive web clients can execute that function. Can someone point me to the doc that describes it? -Ayon See My Photos on Flickr Also check out my ...
    Ayon SinhaAyon Sinha
    Aug 3, 2011 at 3:40 am
    Aug 3, 2011 at 4:36 pm
  • Fang Fang FF ChenFang Fang FF Chen
    Aug 2, 2011 at 5:13 am
    Aug 2, 2011 at 2:01 pm
  • Dear Hive users, Hadoop World 2011 ( will be held November 8th and 9th in NYC. This year we're also planning to organize a Hive Meetup. These events are a good place for users ...
    Carl SteinbachCarl Steinbach
    Aug 29, 2011 at 6:36 pm
    Oct 20, 2011 at 10:58 pm
  • I found a set of slides from Facebook online about Hive that claims you can have a schema per partition in the table, this is exciting to us, because we have a table like so: id int name string level ...
    Time LessTime Less
    Aug 22, 2011 at 9:35 pm
    Oct 7, 2011 at 3:05 am
  • encountering following issur pls help, on cygwin windows hive show tables; FAILED: Hive Internal Error: java.lang.IllegalArgumentException( Relative path in absolute URI: ...
    Siddharth TiwariSiddharth Tiwari
    Aug 17, 2011 at 10:39 pm
    Aug 18, 2011 at 8:17 pm
  • If i run my own UDAF with group by, can i be sure that a single UDAF instance initialized once will process all members in a group? Or should i code so as to take into account the situation where ...
    Koert KuipersKoert Kuipers
    Aug 30, 2011 at 1:35 pm
    Sep 5, 2011 at 4:54 pm
  • Hi,everyone, Is there an option to ignore malformatted records while loading data into hive table? Or an option to ignore bad rows while querying data? For instance: 1. Specify a row format ...
    Aug 19, 2011 at 2:44 am
    Aug 25, 2011 at 5:48 am
  • HI team, I m facing a problem like i have made a table which is (** fields terminated by '||' and lines terminated by '\n'*) but when i fetching data from this table . i didnt get the desire output . ...
    Vikas SrivastavaVikas Srivastava
    Aug 19, 2011 at 10:36 am
    Aug 19, 2011 at 1:58 pm
  • Hello, We have just setup Hive on a new Hadoop cluster. When I run a select * on a table, it works fine but when I run any query which needs a reducer, like count(1) or a where condition, the query ...
    Hadoop n00bHadoop n00b
    Aug 11, 2011 at 4:32 pm
    Aug 13, 2011 at 8:41 am
  • Hi, I have an already running system where I define a simple data flow (using a simple custom data flow language) and configure jobs to run against stored data. I use quartz to schedule and run these ...
    Tharindu MathewTharindu Mathew
    Aug 29, 2011 at 7:47 pm
    Aug 31, 2011 at 5:31 am
  • Hi, I have a partitioned external table in Hive, and in the partition directories there are other subdirectories that are not related to the table itself. Hive seems to want to scan those ...
    Aug 18, 2011 at 11:03 pm
    Aug 29, 2011 at 9:50 pm
  • hey folks. can any1 tell me that how many tables are allowed in hive. Is dere any limit or cofiguration through which we can set the max no of tables in hive. -- With Regards Vikas Srivastava DWH & ...
    Vikas SrivastavaVikas Srivastava
    Aug 24, 2011 at 8:25 am
    Aug 25, 2011 at 12:23 am
  • After I load some 15 files each of about 150M in size into a partition of a table and run a select count(*) on the table, I keep getting an error. In the JobTracker Web Interface, this turns out to ...
    W S ChungW S Chung
    Aug 17, 2011 at 3:26 pm
    Aug 22, 2011 at 3:04 pm
  • Hi folks, I am trying to run Hive from eclipse. I've set it up correctly and it is building the jars and stuff. However I face execeptions when I try to run hive queries like "show tables" etc. There ...
    John smithJohn smith
    Aug 11, 2011 at 8:41 pm
    Aug 12, 2011 at 4:45 am
  • Hi I've been successful using hive for a past few projects. Now for a particular use case I'm bit confused what to choose, Hive or Pig. My project involves a step by step sequential work flow. In ...
    Aug 8, 2011 at 11:40 am
    Aug 8, 2011 at 12:35 pm
  • With set hive.cli.print.header=true; I get NPE's for "desc" as well as "use" Exception in thread "main" java.lang.NullPointerException at ...
    Ayon SinhaAyon Sinha
    Aug 2, 2011 at 12:29 am
    Aug 2, 2011 at 10:01 pm
  • Hi Guys I stored the production log files in folders which are named as the date. the structured look like APP/2011-08-31/app.log. So now I wannt to load all files under /app in one table. Is there ...
    Junxian YanJunxian Yan
    Aug 31, 2011 at 7:02 am
    Aug 31, 2011 at 11:33 pm
  • Hi Is there a wiki page which contains a list of keywords in Hive? Can we use 'time' or 'date' as column names? Thanks Vaibhav
    Aggarwal, VaibhavAggarwal, Vaibhav
    Aug 31, 2011 at 8:18 pm
    Aug 31, 2011 at 9:26 pm
  • Hi all, Is the thrift server thread safe? Will a single instance be able to serve multiple client side JDBC connection. Any best practice to follow? Thanks -Tommy
    Tommy LiTommy Li
    Aug 29, 2011 at 7:13 pm
    Aug 30, 2011 at 2:41 am
  • I assume you need to set HIVE_AUX_JARS_PATH to the jars that contain custom Input/OutputFormats/Serdes.. I did export HIVE_AUX_JARS_PATH to point to the correct dir containing the jars and then ran ...
    Sam WilliamSam William
    Aug 29, 2011 at 10:56 pm
    Aug 29, 2011 at 11:33 pm
  • The parser can not handle certain queries inside catlogs. [11:09:51] <ecapriolo hive create table one (a int,b int) fields terminated by '\t'; [11:09:51] <ecapriolo FAILED: Parse Error: line 1:31 ...
    Edward CaprioloEdward Capriolo
    Aug 25, 2011 at 3:16 pm
    Aug 25, 2011 at 6:24 pm
  • Hi everyone, Does anyone know the differences between local and remove Hive metastores? Are there features that are only provided by the remote datastore (like authorization)? Is the use of a local ...
    Alex HolmesAlex Holmes
    Aug 22, 2011 at 4:03 pm
    Aug 25, 2011 at 12:49 am
  • Haggai RoitmanHaggai Roitman
    Aug 12, 2011 at 7:24 am
    Aug 23, 2011 at 11:52 am
  • Hi, I have a custom Input format that reads multiple lines as one row based on number of columns in a table. I want to dynamically pass the table properties (like number of columns in table, their ...
    Shantian PurkadShantian Purkad
    Aug 21, 2011 at 12:02 am
    Aug 22, 2011 at 4:31 pm
  • Hi, I have just set up a PostgreSQL 9.0.2 server for hive 0.7.1 metastore, and I am using the postgresql-9.0-801.jdbc4.jar jdbc driver, when I test the following HQL, CREATE TABLE records (year ...
    Xiaobo GuXiaobo Gu
    Aug 20, 2011 at 6:20 am
    Aug 21, 2011 at 1:55 am
  • Hi Experts I was working on hive with larger volume data with hive 0.7 . Recently my hive installation was upgraded to 0.7.1 . After the upgrade I'm having a lot of issues with queries that were ...
    Bejoy KsBejoy Ks
    Aug 18, 2011 at 12:52 pm
    Aug 18, 2011 at 6:27 pm
  • I run a single query like select retailer_key,count(*) from records group by retailer_key; it uses a single map as shown below, since the file is already on HDFS, so I think hadoop/hive doesn't need ...
    Aug 10, 2011 at 12:08 pm
    Aug 10, 2011 at 7:02 pm
  • Hive document said hive is high latency, to query a table with about 100M might take 1 minute. And hbase is a high performance database, so does that mean after integrate hive and hbase, hive will ...
    Aug 8, 2011 at 1:48 pm
    Aug 8, 2011 at 8:53 pm
  • Hi, I am using the CDH3u1 stack and My hive fails to load with the following error: </pre </p <p <b root cause</b <pre java.lang.RuntimeException: *Could not load shims in class null* ...
    Aug 8, 2011 at 9:21 am
    Aug 8, 2011 at 9:59 am
  • Hi, I am using hive version 0.7 and I am having an odd issue with comments The following works <snip use default; -- this is good -- select blah from blahness ... </snip However, <snip use default; ...
    Rohan mongaRohan monga
    Aug 5, 2011 at 7:40 am
    Aug 6, 2011 at 4:53 pm
  • Hi, can indexes work on gzipped files? The index gets build without errors using ALTER INDEX syslog_index ON syslog PARTITION(dt='2011-08-03') REBUILD; but when querying, no results are returned (and ...
    Martin KonicekMartin Konicek
    Aug 3, 2011 at 5:11 pm
    Aug 4, 2011 at 3:23 am
  • Hi, I am using hive-hbase-handler-0.7.0-cdh3u0.jar (under hive-0.7.0-cdh3u0/lib) thrift-fb303-0.5.0.jar (under hive-0.7.0-cdh3u0/lib) thrift-0.2.0.jar (under hbase-0.90.1-cdh3u0/lib) in my project. ...
    Neerja BhatnagarNeerja Bhatnagar
    Aug 1, 2011 at 8:35 pm
    Aug 3, 2011 at 5:37 pm
  • Hey folks, i m getting this error while running simple query... like desc table. i m using hive 0.7 and hadoop 0.20.2 *this is hive.log:- *2011-08-26 17:41:56,403 ERROR DataNucleus.Plugin ...
    Vikas SrivastavaVikas Srivastava
    Aug 26, 2011 at 12:52 pm
    Aug 30, 2011 at 11:40 am
  • I have a files of 7G, and the load using the command of load data local inpath '/home/oracle/store_sales.csv' into table store_sales; That file is not compressed, so I want to compress the table to ...
    Aug 27, 2011 at 9:46 am
    Aug 27, 2011 at 9:38 pm
  • Hi, all When I try to run the standard test cases in Hive 0.7.1 against SUN 1.6 JDK, I found that TestCliDriver failed. The version of the JDK I used is: java version "1.6.0_27-ea" Java(TM) SE ...
    李 冰李 冰
    Aug 22, 2011 at 2:44 pm
    Aug 23, 2011 at 2:10 am
  • hi all : what's wrong with error below? I use hiveserver to submit hive sql if i restart hiveserver it will be ok. my hive version is 0.6.0 2011-08-22 09:03:03,459 ERROR ql.Driver ...
    Hello WorldHello World
    Aug 22, 2011 at 1:21 am
    Aug 22, 2011 at 4:58 am
  • I’m running into an issue with Hive’s TRANSFORM where the output always gets split among 32 files. Somebody else also ran into a similar issue and we posted on the CDH group last week ...
    Loren SiebertLoren Siebert
    Aug 15, 2011 at 4:11 pm
    Aug 16, 2011 at 1:11 pm
Group Navigation
period‹ prev | Aug 2011 | next ›
Group Overview
groupuser @
categorieshive, hadoop

74 users for August 2011

Daniel,Wu: 19 posts Vikas Srivastava: 15 posts Aggarwal, Vaibhav: 13 posts Ayon Sinha: 13 posts Edward Capriolo: 12 posts Carl Steinbach: 11 posts Wd: 11 posts Ashutosh Chauhan: 9 posts Bejoy Ks: 9 posts Chinna Rao Lalam 72745: 9 posts Alex Holmes: 8 posts Yongqiang he: 7 posts Fang Fang FF Chen: 6 posts Sam William: 6 posts Steven Wong: 6 posts Loren Siebert: 5 posts Siddharth Tiwari: 5 posts Air: 4 posts Amit Sharma: 4 posts Christian Kurz: 4 posts
show more