user@hive.apache.org discussions

0	Why does ORC use Deflater instead of native ZlibCompressor?

Hello, I recently looked at ORC encoding and noticed that hive.ql.io.orc.ZlibCodec uses java's java.util.zip.Deflater and not Hadoop's native ZlibCompressor. Can someone please tell me what is the ...

Aleksei Statkevich
Jun 18, 2016 at 5:31 am
Jun 18, 2016 at 5:31 am

8	Hive indexes without improvement of performance

Hello! I use Hive 1.1.0-cdh5.5.0 and try to use indexes support. My index creation: *CREATE INDEX doc_id_idx on TABLE my_schema_name.doc_t (id) AS 'COMPACT' WITH DEFERRED REBUILD;* *ALTER INDEX ...

Vadim Dedkov
Jun 16, 2016 at 8:50 pm
Jun 16, 2016 at 10:15 pm

2	last stats time on table columns

Greeting gurus, When I use ANALYZE TABLE <table_name COMPUTE STATISTICS for COLUMNS, Where can I get the last stats time. DESC FORMATTED <table_name does not show it thanking you

Ashok Kumar
Jun 16, 2016 at 7:10 pm
Jun 17, 2016 at 10:39 am

3	Is there any GROUP_CONCAT Function in Hive

Hi, We have Hive table with 3 GB of data like 1000000 rows. We are looking for any functionality in hive, which can perform GROUP_CONCAT Function. We tried implement Group_Concat function with use ...

Mahender Sarangam
Jun 15, 2016 at 10:47 pm
Jun 16, 2016 at 1:02 am

0	Extra string ”s“ in hive-site.xml caused Number Format Exception

Hi: One of our developer team has encounted “NumberFormatException” while hive parsing these two properties(“hive.metastore.client.connect.retry.delay” & “hive.metastore.client.socket.timeout"). But ...

SanDomingo
Jun 15, 2016 at 8:37 am
Jun 15, 2016 at 8:37 am

1	same hdfs location with different schema exception

Hi all: I have a question when using hive. It's described as follows: Firstly, I create two table: CREATE TABLE `roncen_tmp`( `a` bigint, `b` bigint, `c` string); CREATE EXTERNAL TABLE `ext_roncen`( ...

赵升/赵荣生
Jun 14, 2016 at 2:26 am
Jun 14, 2016 at 7:03 am

1	Issue in Insert Overwrite directory operation

Hi All, I see a weird issue when trying to do a "INSERT OVERWRITE DIRECTORY" operation. The query seems to work when I limit the data set but fails with the following exception if the data set is ...

Udit Mehta
Jun 13, 2016 at 11:55 pm
Jun 14, 2016 at 7:10 am

5	ORC does not support type conversion from INT to STRING.

Hi, We are facing issue while reading data from ORC table. We have created ORC table and dumped data into it. We have deleted cluster due to some reason. When we recreated cluster (using Metastore) ...

Mahender Sarangam
Jun 13, 2016 at 8:18 pm
Jun 14, 2016 at 6:47 pm

12	Optimized Hive query

Hi, I would like to know if there is a way to convert nested hive sub-queries into optimized queries. For example : INSERT INTO TABLE a.b SELECT * FROM ( SELECT c FROM d) into INSERT INTO TABLE a.b ...

Aviral Agarwal
Jun 13, 2016 at 4:55 pm
Jun 15, 2016 at 10:04 am

0	this really matters

Hi, I've got some news for you, please read it, this really matters a lot! Please read here <http://fibisteny.danzhaute.com/aegykwg Yours truly, TroopTrack Notifier

TroopTrack Notifier
Jun 13, 2016 at 4:13 pm
Jun 13, 2016 at 4:13 pm

20	column statistics for non-primitive types

Hi there, when testing column statistics I stumbled upon the following error message: DROP TABLE IF EXISTS foo; CREATE TABLE foo (foo BIGINT, bar ARRAY<BIGINT , foobar STRUCT<key:STRING,value:STRING ...

Michael Häusler
Jun 13, 2016 at 3:00 pm
Jun 15, 2016 at 12:44 pm

0	Using Parquet 1.7.0 for Hive 1.0.0

Hello Team , I am using Spark 1.6.1 to output parquet files which is using Parquet 1.7.0 . While reading these Parquet files from Hive I am getting Failed with exception ...

Mayank Shishir Shete
Jun 13, 2016 at 8:47 am
Jun 13, 2016 at 8:47 am

5	LDAPS (Secure LDAP) Hive configuration

Hello, We are working on a Hive 2.0.0 cluster, to configure LDAPS authentication, but I get some errors preventing a successful authentication. Does anyone have some insight on how to solve this? ...

Jose Rozanec
Jun 10, 2016 at 7:42 pm
Jun 16, 2016 at 1:31 pm

2	Hive Table Creation failure on Postgres

Hello Everyone, We are using postgres for hive persistent store. We are making use of the schematool to create hive schema and our hive configs have table and column validation enabled. While trying ...

Siddhi Mehta
Jun 9, 2016 at 6:44 pm
Jun 10, 2016 at 6:33 pm

7	Get 100 items in Comma Separated strings from Hive Column.

Hi, We have hive table which has a single column with more than 1000 comma separated string items. Is there a way to retrieve only 100 string items from that Column. Also we need to capture number of ...

Mahender Sarangam
Jun 9, 2016 at 4:13 pm
Jun 11, 2016 at 3:10 pm

0	SMB join VS SMB Map Join?

Hi All, I have a basic questions on the Hive joins. What is the core difference between SMB join and SMB Map Join? Any pictorial representation will be a real help. Regards Rohit Kumar Prusty ...

Rohit Kumar Prusty
Jun 9, 2016 at 12:48 pm
Jun 9, 2016 at 12:48 pm

3	Using Hive table for twitter data

Hi, I am just exploring this. Has anyone done recent load of twitter data into Hive table. I used few of them. This one I tried ADD JAR /home/hduser/jars/hive-serdes-1.0-SNAPSHOT.jar; --SET ...

Mich Talebzadeh
Jun 9, 2016 at 9:03 am
Jun 9, 2016 at 9:42 am

3	NPE while querying timestamp data type in ORC tables

Hi all, I have a ORC Hive table with multiple columns. One of the column data type (say column1) is of type timestamp. When I make a query 'select * from table_name where column1 is null;', I get ...

Sharath Babu Basavaraja
Jun 8, 2016 at 11:13 pm
Jun 10, 2016 at 5:35 pm

2	Where are jars stored for permanent functions

Hi All, I just added local jars to my hive session, created permanent functions, and find that they are available across sessions and machines. This is of course excellent, but I'm wondering where ...

Marcin Tustin
Jun 8, 2016 at 8:10 pm
Jun 10, 2016 at 4:58 am

2	JsonSerDe file format question

I am merging multiple JSON file in a bigger one before saving it to HDFS. So merged file looks like this {"id":160889136,"url":" http://twitter.com/PatrocinarBRA/statuses/740301352052654080", ...

Igor Kravzov
Jun 8, 2016 at 6:55 pm
Jun 8, 2016 at 8:22 pm

11	Creating a Hive table through Spark and potential locking issue (a bug)

Hi, I noticed an issue with Spark creating and populating a Hive table. The process as I see is as follows: 1. Spark creates the Hive table. In this case an ORC table in a Hive Database 2. Spark uses ...

Mich Talebzadeh
Jun 8, 2016 at 6:33 pm
Jun 9, 2016 at 12:25 am

2	Need Your Inputs For Below Scenario

Hey folks, Need your help. Input Table1: Column1 Column2 Column3 Column4 Column5 Column6 Column7 A B1 B2 B3(NULL) B4 B5 B6 Input Table2: Column1 Column2 B1 D1 B2 D2 B3 D3 B4 D4 B5 D5 B6 D6 Output ...

Lunagariya, Dhaval
Jun 8, 2016 at 12:22 pm
Jun 9, 2016 at 8:11 am

1	insert query in hive

Hi Friends, I have to insert the data into hive table from Java program. Insert query will work in Hive directly? like below sql command insert into tablename values(value1,value2) Thanks Raj

Raj hive
Jun 8, 2016 at 12:03 pm
Jun 8, 2016 at 12:15 pm

0	Hive table show less records than hbase

Hi All, *Using HBase0.98.6, CDH5.3.5 and Hive-0.13.1* I am accessing a hbase table from Hive, all column are mapped as string type. if i do coun(*) from hive on table, i get less record than total ...

Amrit Jangid
Jun 6, 2016 at 4:18 pm
Jun 6, 2016 at 4:18 pm

6	Delete hive partition while executing query.

Hello, I'm trying to find a safe way to delete partition with all data it includes. I'm using Hive 1.2.1, Hive JDBC driver 1.2.1 and perform simple test on transactional table: asyncExecute("Select ...

Igor Kuzmenko
Jun 6, 2016 at 1:02 pm
Jun 9, 2016 at 10:44 am

8	alter partitions on hive external table

Hi friends, I have created partitions on hive external tables. partitions on datetime/userid/customerId. now i have to change the order of the partitions for the existing data for all the dates ...

Raj hive
Jun 6, 2016 at 3:02 am
Jun 8, 2016 at 11:56 am

6	Convert date in string format to timestamp in table definition

Hi, I have 2 dates in Json file defined like this "addDate": "2016-05-17T02:10:44.527", "postDate": "2016-05-16T02:08:55", Right now I define external table based on this file like this: CREATE ...

Igor Kravzov
Jun 4, 2016 at 5:12 pm
Jun 5, 2016 at 9:12 am

2	Internode Encryption with HiveServer2

Hi I am deploying Hive in a regulated environment - all data needs to be encrypted when transferred and at rest. If I run a 'select' statement, using HiveServer2, then a map reduce job(s) get started ...

Nick Corbett
Jun 3, 2016 at 9:00 am
Jun 3, 2016 at 9:18 am

1	Error while running Hive on Microsoft Azure HDInsight Hadoop Linux Cluster

When i try to run the hive command "hive -i flightdelays.hql" for the example "https:// ...

Deepak Goel
Jun 2, 2016 at 11:13 am
Jun 2, 2016 at 11:40 am

7	LINES TERMINATED BY only supports newline '\n' right now

For some of the columns '\n' character is there as part of value, i want to create a hive table for this data i tried by creating the hive table with US as the line separator but it showing the below ...

Radha krishna
Jun 2, 2016 at 9:41 am
Jun 9, 2016 at 10:32 am

4	Spark support for update/delete operations on Hive ORC transactional tables

Hi, Spark does not support transactions because as I understand there is a piece in the execution side that needs to send heartbeats to Hive metastore saying a transaction is still alive". That has ...

Mich Talebzadeh
Jun 2, 2016 at 8:54 am
Jun 6, 2016 at 8:00 pm

1	hive wiki edit permission

Hi, I would like to update the documentation - and add the new altertate way to use ide-s with hive (HIVE-13490) my wiki login is: kirk regards, Zoltan

Zoltan Haindrich
Jun 1, 2016 at 10:41 pm
Jun 2, 2016 at 5:34 am

5	External partitoned table based on yyyy/mm/dd HDFS structure

Is it possible to create? What would be the table definition in this case?

Igor Kravzov
Jun 1, 2016 at 3:02 pm
Jun 3, 2016 at 4:49 pm

1	why does HIVE can run normally without starting yarn?

Hi all, I use hadoop 2.7.2, and I just start HDFS, then I can submit mapreduce jobs and run HIVE 1.2.1. Do the jobs just execute locally If I don't start YARN? Joseph

Joseph
Jun 1, 2016 at 2:09 am
Jun 1, 2016 at 11:18 am

3	[ANNOUNCE] Apache Hive 2.0.1 Released

The Apache Hive team is proud to announce the the release of Apache Hive version 2.0.1. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in ...

Sergey Shelukhin
May 31, 2016 at 8:39 pm
May 31, 2016 at 9:20 pm

1	How to disable SMB join?

Hi, Does anybody know if there a config setting to disable SMB join? One of our Hive queries failed with ArrayIndexOutOfBoundsException when Tez is the execution engine. The error seems to be ...

Banias H
May 31, 2016 at 5:08 pm
May 31, 2016 at 5:20 pm

15	Why does the user need write permission on the location of external hive table?

Hi Hive Team, As per my understanding, in Hive, you can create two kinds of tables: Managed and External. In case of managed table, you own the data and hence when you drop the table the data is ...

Sandeep Giri
May 31, 2016 at 7:50 am
Jun 7, 2016 at 12:27 am

0	Is it possible to use external table on top of Elasticsearch index for arbitrary FTS

I know that external table can be defined like this CREATE EXTERNAL TABLE artists ( id BIGINT, name STRING, links STRUCT<url:STRING, picture:STRING ) STORED BY ...

Igor Kravzov
May 30, 2016 at 5:53 pm
May 30, 2016 at 5:53 pm

3	SHOW DATABASES/TABLES with SQL standard authorization

I'm setting up a Hive instance with the SQL standard authorization and it seems to be working great for all normal operations, but for SHOW DATABASES/TABLES it's behaving differently from what I ...

Lukas Lalinsky
May 30, 2016 at 5:20 pm
May 30, 2016 at 6:12 pm

1	Permission denied with select *

Hi, If i run "select * from table" permission denied error we are encountering, where as select * from table limit 10; or select count(*) from table; working fine, what could be the reason any guess ...

Kishore kumar
May 30, 2016 at 1:52 pm
May 30, 2016 at 1:56 pm

1	Re: My first TEZ job fails

Hi Gopal, can you add anything to this please? thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw ...

Mich Talebzadeh
May 30, 2016 at 11:54 am
May 30, 2016 at 12:03 pm

4	Does hive need exact schema in Hive Export/Import?

Hi All, I am using HDP 2.3 - Hadoop version - 2.7.1 - Hive version - 1.2.1 I created a table dev101 in hive using create table dev101 (col1 int, col2 char(10)); I inserted two records using insert ...

Devender Yadav
May 30, 2016 at 11:38 am
May 30, 2016 at 3:52 pm

6	Anyone successfully deployed Hive on TEZ engine?

Please bear in mind that I am talking about your own build not anything comes as part of Vendor's package. If so kindly specify both Hive and TEZ versions. Thanks Dr Mich Talebzadeh LinkedIn * ...

Mich Talebzadeh
May 29, 2016 at 8:26 pm
May 30, 2016 at 11:55 am

3

Test

Please someone reply. Not sure if subscribed properly

Igor Kravzov
May 29, 2016 at 5:01 pm
May 29, 2016 at 6:36 pm

0	To use a table defined on Elasticsearchindex for arbitrary full text search

down votefavorite <http://stackoverflow.com/questions/37393733/hive-to-use-elasticsearch-defined-table-for-arbitrary-full-text-search# I know that it is possible to create Hive table with predefined ...

Igor Kravzov
May 28, 2016 at 3:41 pm
May 28, 2016 at 3:41 pm

0	Need some clarification on this diagram of mine depicting Hive on Spark engine in yarn-client mode

Hi all, I would appreciate for any comments on this DFD diagram that i created to describe Hive running on Spark engine in yarn-client mode. Thanks Dr Mich Talebzadeh LinkedIn * ...

Mich Talebzadeh
May 27, 2016 at 5:13 pm
May 27, 2016 at 5:13 pm

1	HCatUtil dependency missing when using StreamingAPI

I am attempting to use the streaming api as referenced here: https://cwiki.apache.org/confluence/display/Hive/Streaming+Data+Ingest When executing the connection creation with ...

Eva Donaldson
May 27, 2016 at 4:56 pm
May 27, 2016 at 5:39 pm

2	Fwd: How to run large Hive queries in PySpark 1.2.1

Hi PySpark users, We need to be able to run large Hive queries in PySpark 1.2.1. Users are running PySpark on an Edge Node, and submit jobs to a Cluster that allocates YARN resources to the clients ...

Nikolay Voronchikhin
May 26, 2016 at 8:12 am
May 26, 2016 at 9:36 am

2	Hive and using Pooled Connections

Hi, I am sure someone knows the answer to this question. Does Hive 2.0 use connection pool to connect to its metastore? I see a lot of open and closed connections to the metastore that may not be ...

Mich Talebzadeh
May 25, 2016 at 8:25 pm
May 26, 2016 at 9:16 am

0	File name conflict when have multiple INSERT INTO queries running in parallel

Hi, All We have an application which connect to HiveServer2 via JDBC. In the application, it executes "INSERT INTO" query to the same table. If there are a lot of users running the application at the ...

Bing Li
May 25, 2016 at 5:32 pm
May 25, 2016 at 5:32 pm

group	user @
categories	hive, hadoop
discussions	6,316
posts	23,337
users	2,488
website	hive.apache.org

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hive > user

Search Discussions

6,316 discussions - 23,337 posts

Top users

Content

People

Support

Translate