Grokbase Groups Hive user March 2016

Search Discussions

92 discussions - 368 posts

  • The Apache Hive PMC has voted to make Wei Zheng a committer on the Apache Hive Project. Please join me in congratulating Wei. Thanks Vikram.
    Vikram Dixit KVikram Dixit K
    Mar 10, 2016 at 1:27 am
    Mar 10, 2016 at 6:32 pm
  • Hi All, I am trying to run a simple query of select with limit option, it fails. Below are the details. Versions:- Hadoop :- 2.7.1 Hive :- 1.2.0 Sqoop :- 1.4.5 Query:- The table table_orc is ...
    Biswajit NayakBiswajit Nayak
    Mar 1, 2016 at 4:58 am
    Mar 25, 2016 at 5:55 pm
  • Hello guys ! I'm trying to understand the mechanism for a simple query select * from my_table when using HiveServer2. I'm using the hortonworks ODBC Driver for HiveServer2. I just do a select * from ...
    Tale FireflyTale Firefly
    Mar 21, 2016 at 2:26 pm
    Mar 30, 2016 at 8:06 am
  • Hi Everyone, I have a csv.file which has some sensitive data in a particular column in it. Now I have to create a table in hive and load the data into it. But when loading the data I have to make ...
    Ajay ChanderAjay Chander
    Mar 17, 2016 at 1:58 pm
    Mar 18, 2016 at 8:52 am
  • Hi all, We are currently running Hive in production and staging with the metastore connecting to a MySql database in the backend. The traffic in production accessing the metastore is more than ...
    Udit MehtaUdit Mehta
    Mar 30, 2016 at 9:28 pm
    Mar 31, 2016 at 5:41 am
  • Hi all, I have known that ORC provides three level of indexes within each file, file level, stripe level, and row level. The file and stripe level statistics are in the file footer so that they are ...
    Mar 16, 2016 at 10:20 am
    Mar 18, 2016 at 3:51 am
  • I have not heard of Impala anymore. I saw an article in LinkedIn titled "Apache Hive Or Cloudera Impala? What is Best for me?" "We can access all objects from Hive data warehouse with HiveQL which ...
    Mich TalebzadehMich Talebzadeh
    Mar 1, 2016 at 11:33 am
    Mar 2, 2016 at 6:34 pm
  • Hi All, I have one question about putting hive in read-only mode. What are the ways of putting hive in read-only mode? Can I take a lock at database level to serve purpose? What will happen to ...
    PG UserPG User
    Mar 8, 2016 at 8:09 pm
    Mar 10, 2016 at 12:33 am
  • Hi All, I am facing this issue on HDP setup on which COMPACTION is required only once for transactional tables to fetch records with Spark SQL. On the other hand, Apache setup doesn't required ...
    @Sanjiv Singh@Sanjiv Singh
    Mar 12, 2016 at 8:24 am
    Mar 14, 2016 at 6:07 pm
  • I noticed that Hive allows you to execute SELECT without FROM clause (tested in Hive 0.14, Hive 1.2.1): SELECT 1+1; In which version was it added (is there a Jira)? I see that it is not mentioned in ...
    Dmitry TolpekoDmitry Tolpeko
    Mar 9, 2016 at 9:50 am
    Mar 11, 2016 at 6:35 am
  • How to make the following work? 1. combine columns A and B to make one array as a new column AB. Both column A and B are string types. select string_columnA, string_columnB, *array(string_columnA, ...
    Rex XRex X
    Mar 13, 2016 at 12:33 am
    Mar 13, 2016 at 10:24 pm
  • Hi All, I am trying to do a SQOOP export from hive( integer type partition) to mysql through HCAT and it fails with the following error. Versions:- Hadoop :- 2.7.1 Hive :- 1.2.0 Sqoop :- 1.4.5 Table ...
    Biswajit NayakBiswajit Nayak
    Mar 1, 2016 at 3:19 am
    Mar 4, 2016 at 12:10 pm
  • Hi All, Following on from from our parquet vs orc discussion, today I observed hive's alter table ... concatenate command remove rows from an ORC formatted table. 1. Has anyone else observed this ...
    Marcin TustinMarcin Tustin
    Mar 7, 2016 at 11:26 pm
    Mar 15, 2016 at 2:45 am
  • Hi, Has any one is holding work around for this bug, Looks like this problem still persists in hadoop 2.6. Templeton Job get failed as soon as job is submitted. Please let us know as early as ...
    Mahender bigdataMahender bigdata
    Mar 24, 2016 at 6:28 pm
    Mar 30, 2016 at 12:18 am
  • This might be a bit far fetched but is there any plan for background ANALYZE STATISTICS to be performed on ORC tables for example when it does compaction etc. Also I notice that "desc formatted ...
    Mich TalebzadehMich Talebzadeh
    Mar 27, 2016 at 11:25 pm
    Mar 28, 2016 at 9:07 pm
  • Hi, Hive users: Currently our Hadoop vendor comes with Hive 0.12. I know it is a kind of old version, but upgrade still has some long path to go. Right now, we are facing an issue in the Hive 0.12 ...
    Yong ZhangYong Zhang
    Mar 11, 2016 at 2:43 pm
    Mar 11, 2016 at 7:47 pm
  • Hi, The best ODBC drivers that I found to work with Hive 2 is Progress Data Direct driver for Hive (ODBC 3 compliant).. I tried Cloudera one very shaky (although I tried that on Hive 1.2.1). Tried ...
    Mich TalebzadehMich Talebzadeh
    Mar 10, 2016 at 3:46 pm
    Mar 11, 2016 at 12:07 am
  • Hi Everyone, I am looking for a way, to ignore the first occurrence of the delimiter while loading the data from csv file to hive external table. Csv file: Xyz, baseball, outdoor Hive table has two ...
    Ajay ChanderAjay Chander
    Mar 9, 2016 at 5:43 pm
    Mar 9, 2016 at 6:14 pm
  • select count(*) from table; How does hive evaluate count(*) on a table? Does it return count by actually querying table, or directly return count by consulting some statistics locally. For Hive's ...
    Amey BarveAmey Barve
    Mar 22, 2016 at 7:14 am
    Mar 31, 2016 at 8:36 am
  • Hi, I am running Hive 2 and now Spark 1.6.1 but I still do not see any sign that Hive can utilise a Spark engine higher than 1.3.1 My understanding was that there were miss-match on Hadoop assembly ...
    Mich TalebzadehMich Talebzadeh
    Mar 26, 2016 at 9:47 pm
    Mar 27, 2016 at 1:04 am
  • Hi Team, I need some inputs from you. I have a requirement for my project where I have to join 21 hive external tables. Out of which 6 tables are HUGE having 500 million records of data. Other 15 ...
    Sanka, HimabinduSanka, Himabindu
    Mar 24, 2016 at 1:50 am
    Mar 24, 2016 at 9:01 am
  • hi all: I have 2 cluster,one is hive cluster(2.0.0),another is hbase cluster(1.1.1), this two clusters have dependent hdfs: hive cluster: <property <name fs.defaultFS</name <value ...
    Songj songjSongj songj
    Mar 17, 2016 at 7:21 am
    Mar 17, 2016 at 9:59 am
  • Just curious if you could share your experience on the performance of spark in your company? How much data do you process? And what's the latency you are getting with spark engine? Vidya
    Mar 13, 2016 at 11:27 pm
    Mar 14, 2016 at 4:06 pm
  • Based on the Hive doc below: Rename Table *ALTER TABLE table_name RENAME TO new_table_name;* This statement lets you change the name of a table to a different name. *As of version 0.6, a rename on a ...
    Rex XRex X
    Mar 13, 2016 at 12:01 am
    Mar 13, 2016 at 8:27 am
  • The local /tmp is non-executive configured by admin. When we do a "select ...limit 10" query on Hive, it copied some file to /tmp, and tried to execute it. But since the /tmp is non-executive, I ...
    Rex XRex X
    Mar 19, 2016 at 7:46 pm
    Mar 25, 2016 at 4:21 am
  • I am trying out Hive on Spark with hive 2.0.0 and spark 1.4.1, and executing org.apache.hadoop.hive.ql.Driver with java application. Following are my situations: 1.Building spark 1.4.1 assembly jar ...
    Mar 10, 2016 at 11:12 am
    Mar 22, 2016 at 7:01 am
  • Hi, What are the best mechanisms of hiding data destined for Hive tables. Let us assume that we are loading tons of CSV files into Hive. The way I do it is: --1 Move .CSV data into HDFS staging area ...
    Mich TalebzadehMich Talebzadeh
    Mar 17, 2016 at 4:21 pm
    Mar 18, 2016 at 12:27 am
  • Hello, I'm trying to optimize some queries in Hive that were recently switched to Tez.. had a general question regarding reducer parallelism .. A lot of our queries do the following style of ...
    Mar 16, 2016 at 12:37 am
    Mar 16, 2016 at 9:39 pm
  • You can think of map joins.If cluster is configured by default it must be happening already check query profile
    Sreebalineni .Sreebalineni .
    Mar 15, 2016 at 4:32 pm
    Mar 16, 2016 at 1:06 am
  • Hello All, I hope that this question isn’t too rudimentary – but I’m relatively new to HIVE. In Hive 0.11, I’ve written a UDF that returns a list of Integers. I’d like to use this in a WHERE clause ...
    Lavelle, ShawnLavelle, Shawn
    Mar 8, 2016 at 7:33 pm
    Mar 9, 2016 at 7:31 pm
  • The current scenario resembles a three tier architecture but without the security of second tier. In a typical three-tier you have users connecting to the application server (read Hive server2) are ...
    Mich TalebzadehMich Talebzadeh
    Mar 9, 2016 at 12:00 am
    Mar 9, 2016 at 4:21 pm
  • Hi, I'm bit confused to know which character should be taken as delimiter for hive table generically. Can any one suggest me best Unicode character which doesn't come has part of data. Here are the ...
    Mahender bigdataMahender bigdata
    Mar 3, 2016 at 10:38 pm
    Mar 8, 2016 at 12:02 pm
  • Hi, I noticed this one in Hive2. insert into sales3 select * from smallsales; FAILED: SemanticException [Error 10297]: Attempt to do update or delete on table sales3 that does not use an ...
    Mich TalebzadehMich Talebzadeh
    Mar 8, 2016 at 12:46 am
    Mar 8, 2016 at 9:26 am
  • Hi. I have been hearing a fair bit about Parquet versus ORC tables. In a nutshell I can say that Parquet is a predecessor to ORC (both provide columnar type storage) but I notice that it is still ...
    Mich TalebzadehMich Talebzadeh
    Mar 6, 2016 at 3:26 pm
    Mar 6, 2016 at 4:28 pm
  • + hive mail list, more likely hive issue. ---------- Forwarded message ---------- From: GAO Chi <<span class="m_body_email_addr" title="ba37b264cc21fd96caaa20d35a28d906"</span ...
    Jeff ZhangJeff Zhang
    Mar 1, 2016 at 4:29 am
    Mar 1, 2016 at 7:34 pm
  • Hey folks, I am executing INSERT INTO SELECT hive query through oozie workflow. Below are the details. Extra zeros are getting generated in target table(parquet_table). Can anyone help me to identify ...
    Lunagariya, DhavalLunagariya, Dhaval
    Mar 30, 2016 at 2:25 pm
    Mar 31, 2016 at 8:05 am
  • Hi,experts: When I use Hive 2.0 and Hadoop-2.3.0-cdh5.0 to run HQL like "SELECT COUNT(1) FROM myTable", and encounted this exception below:(by the way,the configuration hive.plan.serialization.format ...
    Mar 30, 2016 at 9:08 am
    Mar 31, 2016 at 1:19 am
  • Hi, Has any one implemented Unpivoting of Hive external table data. We would like Convert Columns into Multiple Rows. We have external table, which holds almost 2 GB of Data. is there best and ...
    Mahender bigdataMahender bigdata
    Mar 28, 2016 at 11:47 pm
    Mar 30, 2016 at 9:23 pm
  • Hi, I use JDBC and the beeline client to interact with a Hive 1.2.1 store. I have some string data that contains single quotes (as well as other special characters) that requires being escaped in ...
    Douglas RappDouglas Rapp
    Mar 30, 2016 at 6:15 pm
    Mar 30, 2016 at 9:08 pm
  • Hi Users, Just wanted to check if the support for defining primary keys(constraints) while creating a hive external tables is available yet? Thank you!
    Ajay ChanderAjay Chander
    Mar 30, 2016 at 6:34 pm
    Mar 30, 2016 at 6:37 pm
  • Hi, Do we know the cause of this error when selecting from an Hive ORC table spark-sql *select * from t2;*16/03/21 16:38:33 ERROR SparkSQLDriver: Failed in [select * from t2] ...
    Mich TalebzadehMich Talebzadeh
    Mar 21, 2016 at 4:39 pm
    Mar 21, 2016 at 6:09 pm
  • hi,i have two cluster,one is hbase(with a hdfs://A ) ,another is hive(with a hdfs://B). i want to use hive shell to read/write hbase. when i enter hive shell and input as follows: hive set ...
    Songj songjSongj songj
    Mar 14, 2016 at 1:28 pm
    Mar 15, 2016 at 1:07 pm
  • Hive 2:00 Spark engine 1.3.1 Eclipse Scala IDE build of Eclipse SDK A simple routine that reads CSV files from a staging directory by creating an external table and insert into an ORC transactional ...
    Mich TalebzadehMich Talebzadeh
    Mar 14, 2016 at 11:31 pm
    Mar 15, 2016 at 8:40 am
  • Hello, I'm using Hortonworks Data Platform 2.3.4 which includes Apache Hive 1.2.1 and Apache Storm 0.10. I've build Storm topology using Hive Bolt, which eventually using Hive StreamingAPI to stream ...
    Igor KuzmenkoIgor Kuzmenko
    Mar 10, 2016 at 12:03 pm
    Mar 14, 2016 at 10:39 am
  • Hello, Ran into this today.. We'r seeing Tez jobs failing to submit when cluster is under high load. In particular, the split calculation seems to fall over when it sees # slots <0. This seems to be ...
    Mar 11, 2016 at 1:33 am
    Mar 11, 2016 at 9:53 am
  • Congratulations, Wei ! 发件人: Madhu Thalakola 发送时间: ‎2016/‎3/‎10 21:47 收件人: <span class="m_body_email_addr" title="d98685a90d9543c52703799da3a2508b"</span 抄送: <span ...
    Mar 10, 2016 at 2:32 pm
    Mar 10, 2016 at 4:14 pm
  • the conver join parameters, without the join hints hive should be able to convert the joins into 1 mapjoin in 1 mr job But in practice i found that it always ends up in 2 mr jobs (2 map joins). What ...
    Mar 8, 2016 at 5:31 pm
    Mar 8, 2016 at 6:25 pm
  • I have to take the first 25 IDs ranked by count(*). But the following is not allowed in Hive select id from T order by count(*) desc limit 25; Which yields a "NOt yet supported place for UDAF ...
    Awhan PatnaikAwhan Patnaik
    Mar 7, 2016 at 5:05 pm
    Mar 7, 2016 at 5:49 pm
  • Hi gurus, I have an ORC table bucketed on invoicenumber with "transactional"="true" I am trying to update invoicenumber column used for bucketing this table but it comes back with Error: Error while ...
    Ashok KumarAshok Kumar
    Mar 6, 2016 at 6:03 pm
    Mar 6, 2016 at 7:12 pm
  • Hi I am comparing performance of pig and hive for weblog data. I was reading this pig and hive benchmarks. In which one statement written on page 10 that "The CPU time required by a job running on 10 ...
    Dhruv kapatelDhruv kapatel
    Mar 6, 2016 at 5:47 am
    Mar 6, 2016 at 1:08 pm
Group Navigation
period‹ prev | Mar 2016 | next ›
Group Overview
groupuser @
categorieshive, hadoop

101 users for March 2016

Mich Talebzadeh: 71 posts Gopal Vijayaraghavan: 21 posts Biswajit Nayak: 14 posts Jörn Franke: 14 posts Mahender Sarangam: 13 posts Rex X: 12 posts Ajay Chander: 11 posts Prasanth Jayachandran: 10 posts Tale Firefly: 9 posts Marcin Tustin: 8 posts Alan Gates: 7 posts Dmitry Tolpeko: 7 posts Gautam: 7 posts Songj songj: 7 posts Divya Gehlot: 6 posts Chandeep Singh: 5 posts Dhruv kapatel: 5 posts Andrew Sears: 4 posts Edward Capriolo: 4 posts Lefty Leverenz: 4 posts
show more