cdh-user@cloudera.org discussions for November 2013

14	HiveServer2 : Failed to release ZooKeeper lock

when create a lot of connections to hiveserver2 service, it will cause the Exception related to Zookeeper lock, is there any way to avoid it ?: org.apache.zookeeper.KeeperException$NoNodeException ...

Panfei
Nov 13, 2013 at 6:46 am
Apr 11, 2014 at 5:59 pm

10	Invalid "mapreduce.jobtracker.address" when running query via hiveserver2 for hive 0.12

Hi, I'm trying to prepare hive-server2 to be used with hive-0.12. When I try to execute query that initiates map-reduce like *select count(*) from my_table *I get an error *Invalid ...

Marcin Smialek
Nov 21, 2013 at 4:45 pm
Nov 28, 2013 at 2:51 pm

9	Sqoop: Oracle Import -- ORA-01882: timezone region not found Issue.(Very Urgent)

Hi All, I am trying to load data from oracle into hadoop using sqoop. It is running fine on my other dev machines. When I ran my sqoop command on one of the ec2 machines it is not running properly ...

Satish reddy
Nov 20, 2013 at 1:59 pm
Apr 20, 2014 at 5:17 am

8	Flume Not Dumping Data Based On HDFS RollSize

Hi, Out requirement is to dump data on HDFS based on size of the file. Below property file we have configured to dump the data when file size reaches to 10 MB. But instead flume is creating lots of ...

Sandip mehta
Nov 11, 2013 at 12:56 pm
Apr 8, 2014 at 10:35 am

8	Cloudera Impala with Pentaho Schema Workbench?

Can I create metadata(cube) using impala or hive data source in Pentaho Schema Workbench. When I tried to get tables list from hive or impala, it is not loading in Pentaho Schema Workbench. Any idea? ...

Pari Margu
Nov 27, 2013 at 6:46 am
Nov 29, 2013 at 7:58 pm

7	Storm-Yarn

I heard over the weekend at a big data camp here in LA that Hortonworks is going to incorporate Storm on Yarn into their distro. Anyone know if Cloudera is going to offer the same thing? I would love ...

Benjamin Kim
Nov 20, 2013 at 9:55 pm
Dec 2, 2013 at 4:32 pm

7	Where to find the detail about a running job

Hi, all, I was wondering where could I find the detail information about a MR job in CDH4 ? In Apache Hadoop, there is a webpage at http://namenode:50030, where I could find the detail information of ...

Lin YANG
Nov 14, 2013 at 6:00 am
Nov 17, 2013 at 7:03 am

7	why doesn't hive DROP TABLE always remove the corresponding hdfs directory for internal tables?

Hi Folks. I'm new to Cloudera and the (amazing!) Hadoop ecosystem, and I'm trying to understand how Hive's DROP ...

Matthewcornell
Nov 14, 2013 at 5:12 pm
Nov 14, 2013 at 7:17 pm

7	CDH5 HBase-client can not get connection?

1: Cluster Env: CM5 CDH5 2: HBase web-ui is ok. Hue HBase web-ui is ok HBase shell is ok. HBase config file path is cm\cdh default: /etc/hbase/conf/*.xml 3: Run hbase-example ...

Realwangx
Nov 8, 2013 at 3:53 am
Nov 13, 2013 at 1:40 am

6	Unable to access hdfs after enabling kerberos

Hi, I am trying to set kerberos and facing the issue in step 15 Create super user for hdfs. I created the hdfs principal. After kinit hdfs , i am unable to access my hadoop filesystem. Below is the ...

Vishnu karthik
Nov 26, 2013 at 3:56 pm
Nov 29, 2013 at 11:02 am

6	Using Cloudera Manager to automate the restarting of events

Hi, Is it possible to use Cloudera Manager to somehow restart some of the processes at a certain interval each day (like a cron). I would really appreciate if someone can please help me out here ...

Amar08007
Nov 25, 2013 at 5:46 am
Nov 25, 2013 at 12:04 pm

6	FOLDER SELECTION ISSUES IN HUE 2.5 CDH 4.4: the button doesn't function in Hue Filebrowser

Hi, when I used Hue Service to move files from a folder to another folder I met an issue in term of "folder selection" from button choice. This button doesn't remember the path in the HDFS. Regards ...

Sebastiano Ippolito
Nov 8, 2013 at 3:30 pm
Nov 12, 2013 at 4:12 pm

6	CPU-intensive hadoop examples

Hi dear all, I am doing some experiments. For the experiment, i need data-intensive and CPU-intensive applications. I know that WordCount, AggregateWordCount etc all data-intensive application but i ...

Mukhtaj Khan
Nov 12, 2013 at 1:48 pm
Nov 12, 2013 at 4:02 pm

5	SQOOP - Compressing Imported Data

Hi All, I am trying to sqoop data into hive using snappy compression. My sqoop command is as the following: *sqoop import --connect ...

Chiewyea
Nov 7, 2013 at 9:52 am
Dec 2, 2013 at 4:02 pm

5	Issue with Capacity Scheduler

Hi Flocks, Since, last two days I am about to configure Capacity Scheduler. Here, how I have struggling L…. I am using Hadoop 2.0.0 and YARN 2.0.0(CDH4.4.0). Initially I have created 4 Queue’s as per ...

Munna hadoop
Nov 28, 2013 at 6:05 am
Nov 30, 2013 at 5:52 am

5	NN HA : will edit log writes to journal nodes impacts the NN's perforrmace ?

I have gone through the QJM design doc but i still want to make sure this particular point. In NN HA setup with QJM, i understood the journal manager class in namenode takes care of writing edit logs ...

Kumar y
Nov 15, 2013 at 2:25 am
Nov 27, 2013 at 11:28 pm

4	How to limit the datanode's storage capacity?

Hi, I am wondering that how to limit the datanode's storage capacity? can anyone tell me..... thx!! -- --- You received this message because you are subscribed to the Google Groups "CDH Users" ...

Jimmy Huang
Nov 27, 2013 at 4:55 am
Dec 2, 2013 at 8:18 am

4	CDH4.5 OOzie Class not found

Hello everyone I gave just upgraded to CDH 4.5 and previously wirking oozie tasks are failing. My oozie workflows are essentilally hive queries and they fail on: I guess I am mising this class ...

Nicolas Maillard
Nov 28, 2013 at 12:34 pm
Nov 28, 2013 at 2:04 pm

4	Error launching task in newly added Datanodes

Hi All, I have added two new noded in my existing cluster, after adding this nodes I am always getting failed status message in job tracker. Please help me to fix this issue. Thanks and Regards Sahab ...

Sahabdeen k
Nov 11, 2013 at 1:22 pm
Nov 27, 2013 at 11:41 am

4	Restarting Flume Agents via Cloudera Manager

Hi, I need to restart my flume agents everyday and I do this manually from Cloudera Manager. Is it possible to setup a cron like thing where I don't have to manually restart them. Thanks Amar -- --- ...

Amar08007
Nov 19, 2013 at 5:35 am
Nov 21, 2013 at 6:01 am

4	hive connection/service error

Hi, I am sure some one already faced this kind of issue, can some one help me in this error. [hadr@dcsgridapp01 bin]$ Starting Hive Thrift Server org.apache.thrift.transport.TTransportException ...

Venkat minupala
Nov 14, 2013 at 4:09 am
Nov 14, 2013 at 12:15 pm

4	no output in part-00000 when running WordCount v1.0

Hi Folks. I'm new to both Cloudera and Hadoop, and I'd really appreciate your help understanding why the output I get from the WordCount 1.0 example (part-00000) is empty. The steps and files I'm ...

Matthewcornell
Nov 12, 2013 at 4:02 pm
Nov 12, 2013 at 6:11 pm

4	Deadlock in NameNode

Dear CHD-Users, I am facing problems with a 6 DN + NN cluster using debian stable and CHD 4.4 on top of HyperV (Windows Server 2012). The problem is, that datanodes encounter deadlocks (1 per hour) ...

Elser Rise
Nov 8, 2013 at 4:04 pm
Nov 11, 2013 at 2:41 pm

3	CDH4.4.0 ExportSnapshot failed.

Hi Guys, When i try to Export Hbase Snapshot to another cluster. ExportSnapahot failed. I getting *java.lang.NoSuchMethodError ...

Dhanasekaran Anbalagan
Nov 13, 2013 at 8:14 pm
Nov 30, 2013 at 7:47 am

3	Adding a host

Hi, I am trying to add another host Ubuntu 12.04 into my cluster of 18 system. I have CDH 4.5. It fails at (after finishing almost 90%) Installing flume-ng-solr package... *BEGIN dpkg -l ...

Anil Rana
Nov 26, 2013 at 9:22 pm
Nov 29, 2013 at 6:26 am

3	Re: Configuring Sentry without Kerberos and ldap setup

Hi Dhanasekaran Its possible to configure Sentry without Kerberos/LDAP. However, without strong authentication, Sentry is not really secure. -Shreepadma -- --- You received this message because you ...

Shreepadma Venugopalan
Nov 25, 2013 at 8:58 pm
Nov 27, 2013 at 7:01 pm

3	Capacity Scheduler not working

Hi, I have configured Capacity Scheduler on YARN, I am try to run Jobs after configure Scheduler, but the jobs has been killed it self. please find the attached config file for your reference, please ...

Munna hadoop
Nov 25, 2013 at 8:03 am
Nov 27, 2013 at 9:23 am

3	In oozie, sqoop from teradata to hdfs/hive -- No manager for connect string: jdbc:teradata://xxx

Sorry if it is a duplicated topic, I have read through the whole list, but still failed. Sqoop works fine in command line: sqoop import xxx Now I am using HUE - Oozie - Sqoop job. Got error like ...

Jack Liu
Nov 26, 2013 at 3:19 pm
Nov 27, 2013 at 7:24 am

3	Flume NG is not throwing error , Also Its not transferring content.

Hi team, I am trying to configure flume to transfer the log from web server to HDFS. I configured everything based on Flume User Guide. Flume Agent & Collector Running as expected way But The content ...

Bommuraj
Nov 21, 2013 at 8:50 pm
Nov 23, 2013 at 1:49 am

3	Getting Error Server IPC version 7 cannot communicate with client version 3 when accessing CDH 4.x

I am getting error "Server IPC version 7 cannot communicate with client version 3 " while accessing CDH 4.x from java class on my PC. Error is thrown at statement FileSystem fs = ...

Sameer
Nov 21, 2013 at 5:58 am
Nov 22, 2013 at 8:16 pm

3	distcp from non-HA cluster to HA cluster

When i run distcp from a non-ha cluster to a HA-cluster and if use the HA namespace as a destination path how will this work if i run on this on a srouce hadoop machine where there are no destination ...

Kumar y
Nov 15, 2013 at 7:26 am
Nov 21, 2013 at 2:49 pm

3	How to config on client side to access a secure CDH using hadoop/hdfs command

Hi, I setup a secured CDH, everything runs well. I am able to do "hdfs dfs -ls /" after "kinit" on any node in the HD cluster. And I am also able to "ls" or "mkdir" in JAVA code from a client ...

Leo Han
Nov 21, 2013 at 3:08 am
Nov 21, 2013 at 4:12 am

3	why is hive.metastore.warehouse.dir different in Cloudera Manager and hive shell?

Hi Folks. I'm climbing the CDH learning curve, and I noticed that the value of hive.metastore.warehouse.dir is different in Cloudera Manager and hive shell. In the Manager configuration page for our ...

Matthewcornell
Nov 14, 2013 at 5:21 pm
Nov 18, 2013 at 2:11 pm

3	How to have common properties for coordinators/workflows

Hello everyone, I'd like to put some parts of the properties file used for my coordinators in a common location, and have these properties be applied to all workflows (but be overridable, of ...

David Morel
Nov 7, 2013 at 11:18 am
Nov 11, 2013 at 10:38 pm

3	password-file option in Sqoop action in Oozie causes FileSystemClosed errors (workaround included)

Hi all, this took me quite some time to troubleshoot. Using the --password-file option in the sqoop invocation produced a failure after everything else in the action proceeded normally (imports are ...

David Morel
Nov 4, 2013 at 5:52 pm
Nov 8, 2013 at 1:59 am

2	Small file use case in HIVE and HADOOP

Hi People, I want your suggestion for my use case. I'm getting the log data on daily basis. I need to integrate daily log files to my previous stored big log file. First problem: Append doesn't ...

Ravi Sharma
Nov 26, 2013 at 11:13 am
Feb 9, 2014 at 2:15 am

2	Pig question, "merging" bags

Hi, Is there a Pig user Google group? If there is I couldn't find it :) If I have a two bags of the same length like: {(A,1), {(B,1), (A,2)} (B,2)} Or, if you prefer {(A,1),(A,2)} {(B,1),(B,2)} Is ...

Fredrik Ragnar
Nov 27, 2013 at 1:04 pm
Dec 9, 2013 at 4:08 pm

2	Dashboard for Logs

Hi, I am using Cloudera Search with Morphline sink to index my records in near real time. One other usecase I have is to get some statistics regarding the number of logs of a certain type. For ...

Amar08007
Nov 29, 2013 at 6:48 am
Nov 29, 2013 at 7:39 am

2	Unable to query in hive in kerberos enabled cluster - as a user

Hi, I have a kerberos set up. When I kinit as hdfs user, I am able to query in Hive. But when i kinit as a user Ex: "kinit puneetha", I am not able to query. I see the below error. Any help is ...

Puneetha B M
Nov 27, 2013 at 6:13 pm
Nov 28, 2013 at 4:24 pm

2	CDH4 - HA cluster, both Namenodes are in standby mode

Hi All, I am facing difficulty in setting up HA in CHD4. Here is my hadoop cluster setup: ========================= namenode1: hadoop1.balaji.net (primary) namenode2: hadoop2.balaji.net (backup) ...

Balaji rajan
Nov 22, 2013 at 2:12 pm
Nov 28, 2013 at 10:06 am

2	Script for uninstalling Cloudera Manager and CHD

I have faced critical issue in one of my 10 node cluster, for that I need to remove all the cloudera,CDH,hadoop related packages. I have written one script for the same and it shared here. I think ...

Sahabdeen k
Nov 22, 2013 at 9:46 am
Nov 25, 2013 at 3:37 pm

2	Oozie Coordinator Editor CDH 4.4 - CALENDAR WEB GUI problem

Hi, I am using Cloudera Standard CDH 4.4 and I have found a problem in web gui on Oozie Coordinator Editor, especially in the calendar input. When I schedule any type of workflow, in the "Frequency" ...

Sebastiano Ippolito
Nov 4, 2013 at 10:38 am
Nov 25, 2013 at 11:03 am

2	Can't access HDFS via Java code on HA for HDFS due to UnknownHostException: nameservice1

Hi, I am trying to do the following on *HDFS anf JobTracker High Availability environment: * 1. *Access HDFS via java code* My driver code: public int run(String[] args) throws Exception { ... final ...

Jasmin Megidish
Nov 21, 2013 at 12:57 pm
Nov 24, 2013 at 7:23 am

2	CDH license and Cloudera Search license

Hi, I am new to Cloudera's stack and am trying to understand which pieces have what licenses. I need to build a product and resell it without licensing restrictions and I am unclear if I can use any ...

Svetlin Kalaydjiev
Nov 20, 2013 at 3:47 pm
Nov 20, 2013 at 10:41 pm

2	Installing Cloudera Netezza Connector in Sqoop2

I'm using CDH 4.4 with Sqoop 2. (Installed via packages as opposed to parcels) I've followed the instructions ...

Kevin Hsu
Nov 16, 2013 at 12:43 am
Nov 18, 2013 at 6:01 pm

2	CDH4.4.0 HiveServer2 java.lang.OutOfMemoryError: PermGen space

When using JDBC to subbmit jobs to hive, hiveserver2.log report the following exception even I rase the JVM HeapSize from 512M to 8192M, is it a known issue ?: java.lang.OutOfMemoryError: PermGen ...

Panfei
Nov 18, 2013 at 2:09 am
Nov 18, 2013 at 5:20 am

2	Issue after installed LZO codec in hadoop

Hi All, I had installed LZO codec in my hadoop environment and added the following in core-site.xml. I had 5 data nodes and i manually make changes on core-site.xml under /etc/hadoop/conf for name ...

Chiewyea
Nov 14, 2013 at 3:56 pm
Nov 18, 2013 at 2:52 am

2	Tasktracker logs filled up with java.net.UnknownHostException: Invalid host name:

Hi, we have recently upgrade to CDH4.4 and as part of this upgrade we changed the jobtracker name and populated the same on all our worker nodes. After a day couple of tasktrackers ( atleast from ...

Kumar y
Nov 15, 2013 at 1:43 am
Nov 15, 2013 at 3:05 pm

2	Adding HBase class path to Java MapReduce Jobs

Hello, I am trying to follow procedure described here: http://blog.cloudera.com/blog/2011/01/how-to-include-third-party-libraries-in-your-map-reduce-job/ I am trying the option of passing HBase jar ...

Alex
Nov 13, 2013 at 9:16 pm
Nov 15, 2013 at 2:50 pm

2	problem related to oozie whitelist in CDH4

Hi, All I have setup a cluster with cloudera manager. I got a problem related to oozie whitelist when testing a example(http-download) of TECHNIQUE3 in Hadoop In Practice.(oozie version 3.2) related ...

Alex YG Park
Nov 8, 2013 at 10:03 am
Nov 14, 2013 at 7:43 pm

group	cdh-user @
categories	hadoop
discussions	165
posts	471
users	171
website	cloudera.com
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > cdh-user > November 2013

Search Discussions

165 discussions - 471 posts

171 users for November 2013

Content

People

Support

Translate