FAQ

Search Discussions

186 discussions - 710 posts

  • All - I really need help/pointers to setup Fair Scheduler in CDH4. Any help would be greatly appreciated. Thanks Willy --
    Willy ChangWilly Chang
    Aug 9, 2012 at 9:51 pm
    Nov 1, 2012 at 5:02 am
  • Running CDH3U3 on a 3 node cluster with default replication of 2. New disks have been added to two machines (each node having 12-22 TB capacity). Since our existing dfs disks have filled up ...
    HenrikoHenriko
    Aug 8, 2012 at 9:12 am
    Aug 31, 2012 at 8:21 am
  • I am trying to run an MRUnit to test my mapper and am getting a java.lang.NoSuchMethodError: org.apache.hadoop.mapreduce.TaskAttemptID.<init (Ljava/lang/String;IZII)V I got the same error when trying ...
    Tim PietyTim Piety
    Aug 2, 2012 at 12:53 pm
    Apr 9, 2013 at 3:26 am
  • Hi All, I have a cdh4 hadoop/hbase cluster runnning on CentOS6.0. The cluster has 4 admin nodes and 8 data nodes. I would only like run one mapper/reducer at a time on each nodemanager. For doing ...
    AnilguptaAnilgupta
    Aug 1, 2012 at 6:00 pm
    Aug 30, 2012 at 7:05 pm
  • Hi CDH Users, We are running Hadoop 0.20.2-cdh3u0 in a CentOS environment (Linux inw-5.rfiserve.net 2.6.18-194.el5). In last one month on three instances our Namenode got into a state where it halts ...
    Shrijeet PaliwalShrijeet Paliwal
    Aug 14, 2012 at 10:08 pm
    Sep 6, 2012 at 8:28 pm
  • Hello, My thrift gateway/server keeps existing under medium load with: 2012-08-06 04:21:51,947 INFO org.apache.zookeeper.ClientCnxn: Client session timed out, have not heard from server in 31971ms ...
    StuStu
    Aug 8, 2012 at 1:08 am
    Oct 19, 2012 at 11:54 pm
  • I'm trying to run the word count example: javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d wordcount_classes WordCount.java But I cannot location my hadoop home directory. I ...
    JhuangJhuang
    Aug 28, 2012 at 3:42 pm
    Sep 21, 2012 at 4:27 pm
  • Our Hadoop Cluster has a large number of mis-replicated Blocks. Is there any good way to solve the Mis-replicated blocks reported by hadoop fsck? I ran Hadoop fsck / -files -blocks -locations -racks ...
    QubeMarkerQubeMarker
    Aug 3, 2012 at 10:58 am
    Aug 16, 2012 at 10:21 am
  • Running CDH3u5, Ubuntu 10.04 LTS. Having the reserved bytes set to 10 GB, restarted DN. <property <name dfs.datanode.du.reserved</name <value 10737418240</value </property The hdfs data volumes keep ...
    HenrikoHenriko
    Aug 22, 2012 at 7:27 am
    Nov 30, 2012 at 5:48 pm
  • Which classes of hadoop needed to Modify so as to Store Intermediate Map phase output in *Cache* and That can be used by Reduce Phase. i.e. *Map Phase* (Writes to)---- *Cache *--- (Reads from) ...
    Kapil bhosaleKapil bhosale
    Aug 22, 2012 at 11:59 am
    Aug 25, 2012 at 7:08 am
  • I'm getting connection refused error when i run oozie work flow.Anyone knows solution help me. 2012-08-23 16:11:51,919 INFO ActionStartXCommand:539 - USER[root] GROUP[-] TOKEN[] APP[pig-wf] ...
    Priya sundararajanPriya sundararajan
    Aug 23, 2012 at 10:49 am
    Jan 31, 2014 at 12:14 pm
  • Hi, I want to export data from HDFS to Mysql with sqoop. but there is java.io.IOException: Cannot run program "mysqlimport": java.io.IOException: error=2, No such file or directory at ...
    MunMun
    Aug 23, 2012 at 1:14 pm
    Aug 29, 2012 at 11:40 am
  • What are the recommended user env vars when using CDH4? It seems that HADOOP_HOME is usually discovered by each command script, but mahout does not know about this new practice so it runs in local ...
    Paul BaclacePaul Baclace
    Aug 30, 2012 at 10:54 pm
    Sep 1, 2012 at 5:05 am
  • I have this Teradata query that I need to convert to HIVE. The “between” clause below doesn’t work in HIVE. I tried to change it to a “WHERE” clause and changed the “BETWEEN” to “ = and <=”, but the ...
    Charles CooperCharles Cooper
    Aug 29, 2012 at 6:48 pm
    Aug 30, 2012 at 2:27 pm
  • I'm fixing bugs in a MR program that I didn't write my self so please forgive me if I missed something obvious. This is in CDH4.0 using the MRv1 and the org.apache.hadoop.mapreduce.* API. In a ...
    Chris TarnasChris Tarnas
    Aug 20, 2012 at 5:19 am
    Jan 13, 2013 at 5:20 am
  • Hello, I am trying to use the CDH4 GA release tarballs and was wondering if there was a recommended way to start the jobtrackers and tasktrackers processes. The scripts that used to start them in ...
    Kulkarni SwarnimKulkarni Swarnim
    Aug 24, 2012 at 6:19 pm
    Dec 31, 2012 at 9:50 pm
  • Hi , I use pig 0.9.2 cdh4 to run a sample script "id.pig": /* id.pig */ A = load 'passwd' using PigStorage(':'); -- load the passwd file B = foreach A generate $0 as id; -- extract the user IDs store ...
    NGuyen thi Kim TuyenNGuyen thi Kim Tuyen
    Aug 22, 2012 at 1:07 pm
    Aug 24, 2012 at 2:27 am
  • Hi, Ref: https://ccp.cloudera.com/display/CDH4DOC/Creating+a+Local+Yum+Repository Is there a way that I can download the tar-ball or the rpms and then put them in a folder from which I use them as a ...
    SumitSumit
    Aug 17, 2012 at 12:03 am
    Aug 17, 2012 at 12:25 pm
  • I have an issue with a datanode that keeps shutting down at least once a day. I cannot figure out the reason, looking at hadoop logs, kern.log etc. I am running CDH3u3, Ubuntu 10.04 LTS, Kernel ...
    HenrikoHenriko
    Aug 14, 2012 at 8:08 am
    Aug 16, 2012 at 8:59 pm
  • Hello, I recently configured HA in CDH4 cluster. While trying to run oozie jobs I get below error message 2012-08-08 12:40:09,714 WARN ActionStartXCommand:542 - USER[hdfs] GROUP[-] TOKEN[] ...
    Hussain kHussain k
    Aug 8, 2012 at 5:54 pm
    Aug 13, 2012 at 9:07 pm
  • Hi, I am trying to use the oozie email action and have set the necessary parameters in the oozie-site.xml.The email action in the workflow is showing as succeeded but did not receive the email and no ...
    Himanish KusharyHimanish Kushary
    Aug 28, 2012 at 10:27 pm
    Apr 25, 2013 at 9:08 am
  • Hi there, I've set up two clusters with CDH4.0.1, followed all steps described in Wiki here ( https://ccp.cloudera.com/display/CDH4DOC/HBase+Replication#HBaseReplication-DeployingHBaseReplication) ...
    Stas MaksimovStas Maksimov
    Aug 27, 2012 at 5:53 pm
    Feb 22, 2013 at 7:34 pm
  • I was trying to modify the row format delimiter of a table using the below statement. It keeps throwing "FAILED: Parse Error: line 1:12 cannot recognize input near 'client_staging' '.' 'test' in ...
    Rakesh Neelavar RaoRakesh Neelavar Rao
    Aug 30, 2012 at 3:29 pm
    Aug 31, 2012 at 4:06 pm
  • Hello, mutateRow in PHP (against local Thrift Server) runs fast (4ms) when the value is small. But the response time of mutateRow jumps from 4ms to 40ms permanently when the value size grows to a ...
    Weijun LiWeijun Li
    Aug 8, 2012 at 10:05 pm
    Aug 17, 2012 at 11:34 pm
  • *I keep getting error:* ============================================================================================================== java.lang.reflect.UndeclaredThrowableException at ...
    Subroto SanyalSubroto Sanyal
    Aug 2, 2012 at 3:34 pm
    May 3, 2013 at 2:25 pm
  • A HDFS filesystem is corrupt: Status: CORRUPT Total size: 21362082386280 B (Total open files size: 1073741824 B) Total dirs: 1000182 Total files: 2874083 (Files currently being written: 7) Total ...
    HenrikoHenriko
    Aug 9, 2012 at 9:56 am
    Nov 1, 2012 at 1:46 pm
  • Hi I have two pig scripts named Script1.pig and script2.pig When i run Script1.pig it runs fine.. but when I try to run Script2.pig it shows error as "*Cannot initialize JVM Metrics with ...
    Kapil bhosaleKapil bhosale
    Aug 1, 2012 at 4:53 am
    Aug 8, 2012 at 8:59 am
  • Hi, i wonder how to configure the log level for taks. Let's say i have if (LOG.isDebugEnabled()) { LOG.debug(key); } somewhere in the reducer. How to set the log level to DEBUG for just a single MR ...
    DrScottDrScott
    Aug 7, 2012 at 2:06 pm
    Jul 31, 2013 at 5:07 am
  • Hello, I'm wondering if there are any known issues with using CDH3 ( = u3) or CDH4 with JRE/JDK 7? Thanks, Igal. --
    Igal ShilmanIgal Shilman
    Aug 22, 2012 at 3:14 pm
    Sep 27, 2012 at 7:31 pm
  • Hello, I am a bit confused about the role of the client configuration in Cloudera 4. We just updated to CDH4 with Cloudera Manager 4 and there is a "Deploy Client Configuration" option in the ...
    David KochDavid Koch
    Aug 30, 2012 at 2:56 pm
    Sep 2, 2012 at 10:03 pm
  • Version: Hadoop 0.20.2-cdh3u4 Name node dies a few times. I saw no error in the log, but found the following in .out: $ cat hadoop-hdfs-namenode-XXX.out Exception in thread "main" ...
    WayneWayne
    Aug 30, 2012 at 9:03 pm
    Aug 31, 2012 at 7:03 pm
  • I installed *CDH4 (Hadoop 2.0.0-cdh4.0.1)* with 1 namenode and 4 Datanodes. when I tried to run my oozie (*Oozie client build version: 3.1.3-cdh4.0.1*) job which has shell action to execute my sample ...
    BalushanBalushan
    Aug 30, 2012 at 1:45 pm
    Aug 30, 2012 at 6:25 pm
  • Hi, I am running cdh4u0 MRv2 two node cluster. My jobs are failing with the following exception: 2012-08-20 09:01:37,501 ERROR [ContainerLauncher #0] ...
    Subroto SanyalSubroto Sanyal
    Aug 20, 2012 at 2:03 pm
    Aug 28, 2012 at 10:21 am
  • Hi , I 'm using FlumeNG to get log from nginx and want to organize these logs day by day . agent.sinks.hdfs-sink.hdfs.path = hdfs://namenode/flumeNG/nginx183/%Y/%m/%d Here are errors : 012-08-24 ...
    NGuyen thi Kim TuyenNGuyen thi Kim Tuyen
    Aug 24, 2012 at 3:29 am
    Aug 24, 2012 at 4:31 pm
  • We use embedded HDFS (via the MiniDFSCluster class, formerly found in hadoop-test module) for some tests. In CDH4 ( mapred v1, 4.0.1) it seems to have disappeared? Any ideas on how to get it back? I ...
    Dan RichelsonDan Richelson
    Aug 14, 2012 at 8:53 pm
    Feb 17, 2014 at 10:45 am
  • Why do the cdh3 docs say to use org.apache.hadoop.hive.serde2.avro.AvroSerDe and the cdh4 docs say to use com.linkedin.haivvreo.AvroSerDe? I'm having trouble understanding the packaging - it looked ...
    Levi BowmanLevi Bowman
    Aug 28, 2012 at 11:22 pm
    Oct 16, 2013 at 1:31 am
  • i enabled the purge service in oozie and i see this error in the logs 2012-08-09 16:59:57,625 FATAL Services:533 - USER[-] GROUP[-] null java.lang.NullPointerException at ...
    Jabir ahmedJabir ahmed
    Aug 9, 2012 at 5:04 pm
    Oct 2, 2013 at 11:45 am
  • Hi We have been using CDH3ux so far and we thought of upgrading to CDH4. I had been playing with the CDH4 installation for a few days. As we had installed CDH3 using tar balls, we did the same for ...
    VidhyaVidhya
    Aug 28, 2012 at 2:12 am
    Jan 3, 2013 at 1:35 pm
  • Hi, I'm using CDH4 from Debian packages on Ubuntu 12.04, setup in pseudo-distributed mode, to run a simple MapReduce job to import data from HDFS files into HBase. I'm having trouble getting it to ...
    Chris GuirlChris Guirl
    Aug 13, 2012 at 8:42 pm
    Oct 15, 2012 at 5:44 am
  • Hi all, Forgive me as I am a beginner at using the Cloudera Hadoop software. Let me explain my test environment that I've gotten successfully to work so far and what my goal is. I've used the ...
    Stephen ChaungStephen Chaung
    Aug 28, 2012 at 10:57 pm
    Sep 5, 2012 at 10:52 pm
  • Could someone confirm for me that this isn't implemented? I went through most of the classes that implement any sort of Context interface and they all say that work will be done in subclasses ...
    ANguyenANguyen
    Aug 11, 2012 at 7:29 am
    Aug 30, 2012 at 5:58 pm
  • Hello, Is it possible to transfer files to HDFS with different username? I'm managing to copy files to HDFS with my username without my intervention (picked up from my windows account). Is it ...
    Emir IbrahimbegovicEmir Ibrahimbegovic
    Aug 28, 2012 at 12:14 pm
    Aug 29, 2012 at 11:26 am
  • Hi, I attempted to use the file:/// syntax to specify a directory on my local disk (as opposed to HDFS) as the input source to the Hadoop example wordcount. It failed with a file not found exception ...
    JeffJeff
    Aug 24, 2012 at 5:35 am
    Aug 27, 2012 at 11:16 am
  • Hi List, I'm running a hadoop-streaming job with python mapper and reducer on an eight-node cluster, and I find that when the map portion is reporting 100% complete, there are still several tasks ...
    Andrew MusselmanAndrew Musselman
    Aug 23, 2012 at 5:07 pm
    Aug 26, 2012 at 6:02 am
  • Hey guys, Our Oozie instance at Etsy recently became unusable when centos cleared out /var/tmp yielding this for every workflow run: org.apache.oozie.action.ActionExecutorException: JA008: File ...
    MattMatt
    Aug 13, 2012 at 6:21 pm
    Aug 22, 2012 at 4:21 pm
  • Upgrading from CDH3u3 to CDH3u5 has broken our hadoop hdfs fuse mount. With hadoop-0.20-fuse 0.20.2+923.417-1~lucid-cdh3 (CDH3u5) the mount hangs forever when being accessed, e.g. with a simple ...
    HenrikoHenriko
    Aug 15, 2012 at 8:36 am
    Aug 16, 2012 at 9:56 pm
  • Hi I'm hitting OOZIE-603 [1] on cdh3 because i updated my jdk version to the latest. Any idea how i could apply this patch in the running deployment? I searched for xsd files across all the oozie ...
    Sumit KumarSumit Kumar
    Aug 9, 2012 at 5:57 am
    Aug 12, 2012 at 11:27 am
  • I am trying to run a oozie example (map-reduce). I am getting this error. please help me E0701: XML schema error, Content is not allowed in prolog. --
    KIRAN bhakreKIRAN bhakre
    Aug 10, 2012 at 10:57 am
    Aug 10, 2012 at 2:42 pm
  • i have a very simply application inside jetty/jersey with SPNEGO authentication where a user can retrieve a file from hdfs using http. so not that dissimilar from something like hoop. when a user ...
    KoertKoert
    Aug 8, 2012 at 1:27 pm
    Aug 9, 2012 at 4:40 pm
  • Hi all, I'm attempting to Dist-cp data from one cluster to another using hftp to hdfs. I ran into some issues and have narrowed it down to the test case listed below. Essentially, I am getting a ...
    YoungYoung
    Aug 7, 2012 at 6:48 am
    Aug 7, 2012 at 8:43 pm
Group Navigation
period‹ prev | Aug 2012 | next ›
Group Overview
groupcdh-user @
categorieshadoop
discussions186
posts710
users169
websitecloudera.com
irc#hadoop

169 users for August 2012

Harsh J: 64 posts Henrik Olsen: 33 posts Joey Echeverria: 25 posts Kapil bhosale: 18 posts Tuyen03a128: 18 posts Patrick Angeles: 17 posts Todd Lipcon: 17 posts Anil gupta: 14 posts Karthik Kambatla: 14 posts Aaron T. Myers: 13 posts Ansonism: 13 posts Rakesh Rao: 12 posts Subroto Sanyal: 12 posts Alejandro Abdelnur: 10 posts Jarek Jarcec Cecho: 10 posts Cheolsoo Park: 9 posts Gen Liu: 9 posts Stu: 9 posts Andy Isaacson: 8 posts Jhuang: 8 posts
show more