cdh-user@cloudera.org discussions for June 2013

16	VirtualBox Cloudera Quickstart VM blocking in the "Initializing HDFS ..." phase during boot

Hi, I've downloaded the VirtualBox Cloudera Quickstart VM (June 2013) and installed it on my Virtualbox 4.1.26 running on my iMac OS X 10.8.4. I've given the VM 8GB RAM and 8 processors. So, it's not ...

Didier Heck
Jun 30, 2013 at 9:59 pm
Jul 31, 2013 at 11:50 pm

16	CDH 4.3.0 tarball and MR1

It seems the MR1 tarball is gone with 4.3.0 and now there is just one hadoop tarball that includes MR1 and YARN together. YARN is the default and I can't figure out how to get MR1 working short of ...

Bryan
Jun 5, 2013 at 12:32 am
Jul 2, 2013 at 6:17 pm

14	is hive 0.11 supported by CDH4.2.1 OR 4.3.0?

HI, does hive 0.11 supported by CDH4.2.1? THANKS! BEATLS --

Hua beatls
Jun 5, 2013 at 2:06 pm
Oct 8, 2013 at 10:24 am

13	Flume inconsistencies

Hi everyone I am currently using flume to bring mysql dumps from other machines to my hdfs cluster. I have a spooling directory agent that monitors a specific directory and sends the dumps as avro ...

Nicolas Maillard
Jun 13, 2013 at 11:42 am
Jun 17, 2013 at 7:04 pm

12	JBOD VS multiple directory on dfs.datanode.data.dir in CM

Hi gurus, Which is better - having multiple drive configured as single logical volume in JBOD OR specifying multiple drive mount point on dfs.datanode.data.dir like "/data1/dfs/dn, /data2/dfs/dn"? ...

Gmur37
Jun 19, 2013 at 4:12 pm
Jun 25, 2013 at 1:07 am

11	Exception in thread "main" java.lang.OutOfMemoryError: GC overhead limit exceeded

I am getting this while I am doing simple ls on hdfs. Please let me know if I have to increase any limit or memory. hadoop fs -ls /data/logs/queen/imps Exception in thread "main" ...

Mani
Jun 8, 2013 at 4:18 am
Jun 12, 2013 at 8:40 am

10	hive action from oozie failing

Log snippet from task tracker. how can i fix this, hive cli works fine,not sure y is hive taking derby, when we are using mysql as hive metastore. 2376 [main] INFO org.apache.hadoop.hive.ql.Driver - ...

Vishal rajan
Jun 21, 2013 at 2:25 pm
Jun 25, 2013 at 9:44 am

9	[ANNOUNCE] Cloudera Connector Powered by Teradata version 1.0.0

On behalf of Cloudera, I am pleased to announce the availability of a new high-speed Apache Sqoop connector called "Cloudera Connector Powered by Teradata". Built jointly by the Cloudera and Teradata ...

Jarek Jarcec Cecho
Jun 28, 2013 at 3:44 pm
Apr 3, 2014 at 1:31 am

9	Avro 1.7.x with CDH4

What is the correct solution for making avro-1.7.x work with Hadoop 2 (CDH4)? When running my mapreduce job on a CDH4.3 cluster I get the following error: FATAL org.apache.hadoop.mapred.Child: Error ...

Christian Guegi
Jun 28, 2013 at 6:38 am
Jul 1, 2013 at 6:23 am

9	Sqoop : import data from Oracle DB

Hello everybody, I try to use Sqoop to import data from an Oracle DB. I have placed the Oracle JDBC Driver (ojdbc6.jar) into SQOOP_HOME/lib. My JDK is 1.6 version. Here is my query : sqoop import ...

Jey
Jun 10, 2013 at 1:34 pm
Jun 11, 2013 at 3:27 pm

8	Hive-0.11 error "Unable to retrieve URL for Hadoop Task logs. Unable to find job tracker info port

Hi, I installed CDH 4.3.0 using Cloudera Manager and manually installed Hive-0.11 from the tarball. There is already a Hive-0.10 installed along with CM but I need to use Hive-0.11 so I manually ...

Rico1505
Jun 25, 2013 at 4:00 pm
Sep 18, 2013 at 3:32 pm

8	Multiple hbase-site files on 4.5.3 CHD installation. Unable to configure snapshots

All we have a basic 4.5.3 CHD installation and want to use snapshots. But there are multiple hbase-site files? I have edited all of them but still receive this error ERROR: java.io.IOException ...

Benc
Jun 1, 2013 at 2:10 pm
Jul 11, 2013 at 1:55 pm

8	HOW TO INCREA THE COMPACT SPEED

hi, ANY suggestion to increate the speed of compaction, both minor and major. we use CDH4.2.0. Thanks! beatls -- --- You received this message because you are subscribed to the Google Groups "CDH ...

Hua beatls
Jun 15, 2013 at 3:03 pm
Jun 15, 2013 at 6:01 pm

8	Hiveserver2 ODBC not working after upgrade to 4.3.0-1.cdh4.3.0.p0.22

We had an 4.2.1-1.cdh4.2.1.p0.5 installation and using ODBC drivers for integration with our DWH. After upgrade to 4.3.0-1.cdh4.3.0.p0.22 ODBC source can not connect to hive, although some service is ...

Baisus13
Jun 5, 2013 at 8:06 pm
Jun 13, 2013 at 10:27 am

7	Impala-Pentaho

Hi Guys, Can any one specify me what jdbc and port address do i need to use for connect Impala via Pentaho? Cheers, Ravi Sharma -- --- You received this message because you are subscribed to the ...

Ravi Sharma
Jun 24, 2013 at 12:21 pm
Dec 17, 2013 at 8:31 am

7	Both HA NameNodes in standby state (quorum journalling)

See somtthing like that: Unable to trigger a roll of the active NN java.net.ConnectException: Call From prod-node015.kyc.megafon.ru/10.66.49.155 to prod-node033.lol.ru:8022 failed on connection ...

Serega Sheypak
Jun 26, 2013 at 4:15 pm
Jun 26, 2013 at 7:08 pm

7	big store 17.5g

HI, below is part of regionserver's log, we get a big store equal 17.5g, our memstore flush size is 256m, my quesiton is why we get such a big store? below is excerpt from regionserver's log ...

Hua beatls
Jun 13, 2013 at 3:47 am
Jun 18, 2013 at 1:53 am

6	E1100: Command precondition does not hold before execution, [, coord action is null], Error Code: E1

Hi , I am facing the below error while executing my workflow. Below are the workflow.xml and and job.properties file along with the error log. Can someone tel me where I am going wrong ...

Parth vachhani
Jun 27, 2013 at 5:44 am
Aug 23, 2013 at 12:06 am

6	why hbase replication requires zookeeper quorum not managed by HBase

cloudera and apache document says that Requirements Before configuring replication, make sure your environment meets the following requirements: - You must manage Zookeeper yourself. It must not be ...

Talkhadoop
Jun 19, 2013 at 2:23 am
Jul 8, 2013 at 5:25 pm

6	DFS-3752 (bootstrapStandby may fail to read transactions when QJM is configured) still present

I am using Hadoop 2.0.0-cdh4.3.0. And I still got the same error when running "hdfs namenode -bootstrapStandby". Is this really fixed? Here is what I found in ...

Wayne
Jun 25, 2013 at 3:48 pm
Jul 1, 2013 at 6:14 pm

6	HBase regionserver not available. ( CDH 4.2.1)

Hi All, I am loading the data into a hbase CDH 8 node cluster and I often see that hbase gets into this state once in a while where the region servers are not available. Here are the master.log ...

Shrikar archak
Jun 24, 2013 at 6:13 pm
Jun 24, 2013 at 10:30 pm

6	modifying the value of mapred-site.xml value through java program

Hi dear all, I am trying to change the properties value of mapred-site.xml through java program. For examples, I want to change the value of mapred.reduce. tasks from 2 to 4 through java program. How ...

Mukhtaj Khan
Jun 22, 2013 at 5:07 am
Jun 24, 2013 at 5:00 pm

6	Oozie problem

I added the Oozie service using Cloudera Manager, and tried submitting below job: oozie.wf.application.path=hdfs://localhost:8020/user/dwbilab01/myworkflows jobTracker=localhost:8021 ...

Suresh V S
Jun 18, 2013 at 6:32 am
Jun 19, 2013 at 4:20 pm

6	oozie workflow

Hello everyone I am building my first semi complicated Oozie workflows in hue. Using CDH 4.3. I would like to run a hive query and then sqoop out the results to a mysql. I have already sqooped out ...

Nicolas Maillard
Jun 17, 2013 at 1:47 pm
Jun 18, 2013 at 7:17 pm

6	even distribution of files in hive folders

I have 100gb table, which I then partition by time dimension into folders (monthly). I get about 20 folders and 3 to 8 files in each folder. Some folders have their files equally distributed (lets ...

Baisus13
Jun 10, 2013 at 7:18 am
Jun 11, 2013 at 8:01 am

6	Cannot obtain block length for LocatedBlock CDH 4.2.1 Hive 0.10

Guys, I have a job failing with the following: Diagnostic Messages for this Task: java.io.IOException: java.io.IOException: Cannot obtain block length for ...

Gary Malouf
Jun 5, 2013 at 8:49 pm
Jun 7, 2013 at 8:47 am

6	Null values in Hive column of type timestamp

I was wondering how to handle Null values in timestamp columns. I have a sqoop job which populates a table in hive. One of the timestamp columns has null value and when I run a simple query like ...

CDHUser
Jun 4, 2013 at 4:35 am
Jun 4, 2013 at 2:28 pm

5	CDH 4.3.0 Hive no longer adds data file extensions

I would like to know if something changed inherently or if a setting was changed in Hive where the data files for Hive tables no longer have a file extension. This is happening ever since we upgraded ...

Benjamin Kim
Jun 14, 2013 at 9:23 pm
Sep 18, 2013 at 5:30 pm

5	Hive JDBC throwing error : TApplicationException: Invalid method name: 'execute'

Hi I am trying to connect Hive using JDBC , its throwing the below error. I am using CDH4.3 with Hive-server. Help here would be greatly appreciated. Thanks. Exception in thread "main" ...

Ravi
Jun 28, 2013 at 6:10 pm
Sep 12, 2013 at 9:12 pm

5	(Realtime) inhouse security analytics service

Hi CDH Users, I'm new to Hadoop - and currently trying out Hortonworks Sandbox, while trying to get some BigData under my fingers and reading some books and tutorials... :) I have been given the ...

Michael Maymann
Jun 7, 2013 at 9:26 pm
Jun 24, 2013 at 4:05 pm

5	"Invalid method name: 'execute'" error with Hive Client in Java

Hi all, I am using CDH 4.2.1-1.cdh4.2.1.p0.5 in a cluster set-up with Cloudera Manager and I am trying to get the Hive example working using the Hive API in Java. The hive version I am using is 0.10 ...

Robert Suman
Jun 10, 2013 at 2:19 pm
Jun 11, 2013 at 2:42 pm

5	Cloudera Search Installation - bigtop-utils conflicts

Hi, I want to install Cloudera Search on my Redhat Enterprise Server 6.2. Please ref below [root@vm-e2cc-540c doc]# yum install solr-server Setting up Install Process Resolving Dependencies -- ...

Dean Zhang from China
Jun 6, 2013 at 6:25 am
Jun 11, 2013 at 6:24 am

5	application server use webshpere,ibm java

Hi: application server use webshpere,the default using the ibm jdk,when the application connect hadoop cluster(sun jdk),find the error: 00000035 RPCMessageRec E ...

Jingangyh
Jun 5, 2013 at 3:25 am
Jun 9, 2013 at 10:31 pm

5	Problem in VM running .jar file

Hi everyone, I use CDH4 in VMware.I made the jar file by the following commands : export CLASSPATH=/usr/lib/hadoop/client-0.20/\*:/usr/lib/hadoop/\* cd /home/cloudera/praktikum/ javac -d ...

Maziyar khorrami
Jun 8, 2013 at 8:55 am
Jun 9, 2013 at 2:56 pm

5	YARN OR MR1?

hi, YARN o MR1,which way should i go? confused. could you please give me some advice? beatls --

Hua beatls
Jun 4, 2013 at 7:58 am
Jun 5, 2013 at 2:19 pm

4	datanode error log checkDiskError and DataXceiver error processing WRITE_BLOCK operation

Hi, we use CDH 4.3.0, datanode log shows 'checkDiskError' message? pleas see below excerpt from datanod log file: **************************************************** 2013-06-10 22:33:23,505 WARN ...

Hua beatls
Jun 10, 2013 at 3:35 pm
Oct 15, 2013 at 4:46 pm

4	CDH4: cannot run hdfs commands across kerberos realms (e.g. hdfs dfs -ls hdfs://remote-host/)

I have set up two CDH4 pseudo clusters in two different kerberos realms (SRC.COM and DST.COM) on AWS and I would like to be able to run the distcp command to copy data from one cluster to another. I ...

Scott Forman
Jun 19, 2013 at 10:52 pm
Sep 30, 2013 at 8:04 am

4	jobtrackerha source rpms?

It looks like there is not a source rpm available for mrv1 for cdh4.3.0. The hadoop source rpm looks like it only builds YARN. I found a source rpm for mapreduce v1 that has the jobtrackerha stuff in ...

Cody Stevens
Jun 21, 2013 at 9:52 pm
Jul 25, 2013 at 3:05 pm

4	How to start flume agent from Java Program

Hi all, Is there any way to start a flume agent from a java program. Currently I am doing this by executing the 'flume-ng agent' command in the shell using * Runtime.getRuntime().exec* in Java. How ...

Sarath P R
Jun 1, 2013 at 4:41 am
Jul 5, 2013 at 7:20 am

4	CM 4.6, CDH 4.3 Hue is very-very-slow

Hi, we see perfomance degradation for the HUE web interface. 1. Hive editor appears slowly 2. Oozie workflows/coordinators tab waits up to 15 seconds to display running/failed/completed instances 3 ...

Serega Sheypak
Jun 20, 2013 at 7:32 am
Jul 2, 2013 at 6:54 am

4	Simba Hive ODBC Driver

I just installed the Simba Hive ODBC Driver and I am having the issue below I am using Hive 1 as I don't see Hive2 enabled in the hive-site. xml file. I have added the correct hostname and I am using ...

Gerardo Delgado
Jun 22, 2013 at 12:48 am
Jun 28, 2013 at 7:47 am

4	CDH4.3 HA automatic failover failed (QJM)

following the document ( http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-High-Availability-Guide/cdh4hag_topic_2_3.html),I set up the HA environment with QJM When ...

Chung-Hsiang Huang
Jun 28, 2013 at 2:49 am
Jun 28, 2013 at 7:26 am

4	CDH4.3 automatic failover failed - active NN died first and standby NN didn't change state

I have paired ZooKeeper (QuorumPeerMain) and JournalNode in 3 different machines (m303p, m304p, m305p). Theses processes are up running fine. After setting up NN HA, I have tested fail over on name ...

Wayne
Jun 27, 2013 at 3:35 pm
Jun 28, 2013 at 12:20 am

4	Any Package for Quorum Journal Manager (QJM)

Do I have to install extra packages for Name Node? Here are what I have on Name Node. Journal Nodes are other boxes. $ rpm -qa | grep cdh4 hadoop-2.0.0+1357-1.cdh4.3.0. p0.21.el6.x86_64 ...

Wayne
Jun 21, 2013 at 8:31 pm
Jun 27, 2013 at 11:01 pm

4	hive issue

log snippet is attached.I am trying to launch a hive job from oozie .My hive command line works fine and launching an oozie mr job also works fine .our cluster is secured with kerberos. Need to fix ...

Vishal rajan
Jun 24, 2013 at 2:28 pm
Jun 25, 2013 at 9:24 pm

4	Solr.xml not found

i install solr after that when i start the service it start normaly but when i see the log i found solr.xml not found in ZooKeeper i searched for solr.xml in /var/lib/slor but not found solr.xml -- ...

Muhamed Ghareeb
Jun 24, 2013 at 2:32 pm
Jun 25, 2013 at 1:04 pm

4	jdbc and beeline doesn't work with hive-0.10.0-cdh4.3.0

using hadoop-0.20-mapreduce JDBC: select max(dt) from table; FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask And in /var/log/hive/hive-server2.log got this ...

Hawthornpie
Jun 14, 2013 at 12:08 pm
Jun 25, 2013 at 7:58 am

4	Namenode hardisk setup

Hi All, Mine is a small hadoop/Hbase set up. I have 4 machines with 3 data nodes in 3 machines and one machine serving as the name node and the 4th data node. I have a question about the name node ...

Mike
Jun 14, 2013 at 8:48 pm
Jun 18, 2013 at 1:51 pm

4	Flume and listener port

In the quickstart-demo VM, I configured the Flume service to use an Avro source that I would send events to from a custom client. Examples on the web use port 41414 when configuring Flume, but doing ...

Andy Yang
Jun 11, 2013 at 8:58 pm
Jun 13, 2013 at 9:07 pm

3	java.net.ConnectException: connect(2) error: No such file or directory when trying to connect to '/var/run/hadoop-hdfs/dn.50010'

hi: the regionserver,tasktracker logs: java.net.ConnectException: connect(2) error: No such file or directory when trying to connect to '/var/run/hadoop-hdfs/dn.50010' 2013-06-11 thank you!! --

Jingangyh
Jun 11, 2013 at 1:35 pm
Jul 16, 2013 at 4:54 pm

group	cdh-user @
categories	hadoop
discussions	252
posts	812
users	215
website	cloudera.com
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > cdh-user > June 2013

Search Discussions

252 discussions - 812 posts

215 users for June 2013

Content

People

Support

Translate