FAQ
Hi I was using CDH4 earlier and used to run Informatica Hparser Data
transformations as MapReduce jobs using hparser-1.1-hadoop-0.21.jar file.

But After upgrading to CDH4.1 I am not able to run those. It is not running
instead is giving me errors like:

java.lang.NoClassDefFoundError: com/itemfield/contentmaster/CMException
at
com.informatica.b2b.dt.hadoop.DTFileInputFormat.createRecordReader(DTFileInputFormat.java:18)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:617)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:263)
Caused by: java.lang.ClassNotFoundException:
com.itemfield.contentmaster.CMException
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 4 more
13/03/21 11:36:23 INFO mapred.JobClient: map 0% reduce 0%
13/03/21 11:36:23 INFO mapred.JobClient: Job complete: job_local_0001
13/03/21 11:36:25 INFO mapred.JobClient: Counters: 0
13/03/21 11:36:25 INFO hadoop.DTRecordReader: The 'Data Transformation job-
/var/lib/hparser/ServiceDb/NJT_4_Hadoop' job has failed.

Can some one let me know, how to work around this?

Search Discussions

  • Harsh J at Mar 21, 2013 at 11:26 am
    Hi,
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:263)
    Is there a reason you're running a LocalJobRunner and not a job on a
    regular JobTracker?

    If you used CM to install the cluster, make sure to do the client
    configuration deployment:
    https://ccp.cloudera.com/display/ENT41DOC/Deploying+Client+Configuration+Files
    On Thu, Mar 21, 2013 at 12:33 PM, Mohammed Azzan Patni wrote:
    Hi I was using CDH4 earlier and used to run Informatica Hparser Data
    transformations as MapReduce jobs using hparser-1.1-hadoop-0.21.jar file.

    But After upgrading to CDH4.1 I am not able to run those. It is not running
    instead is giving me errors like:

    java.lang.NoClassDefFoundError: com/itemfield/contentmaster/CMException
    at
    com.informatica.b2b.dt.hadoop.DTFileInputFormat.createRecordReader(DTFileInputFormat.java:18)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:617)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
    at
    org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:263)
    Caused by: java.lang.ClassNotFoundException:
    com.itemfield.contentmaster.CMException
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    ... 4 more
    13/03/21 11:36:23 INFO mapred.JobClient: map 0% reduce 0%
    13/03/21 11:36:23 INFO mapred.JobClient: Job complete: job_local_0001
    13/03/21 11:36:25 INFO mapred.JobClient: Counters: 0
    13/03/21 11:36:25 INFO hadoop.DTRecordReader: The 'Data Transformation job-
    /var/lib/hparser/ServiceDb/NJT_4_Hadoop' job has failed.

    Can some one let me know, how to work around this?


    --
    Harsh J
  • Mohammed Azzan Patni at Mar 22, 2013 at 7:31 am
    Thanks Harsh,

    It worked. That was so simple. Had forgot to deploy the client Conf.

    Regards
    Azzan
    On Thursday, March 21, 2013 4:55:45 PM UTC+5:30, Harsh J wrote:

    Hi,
    at
    org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:263)

    Is there a reason you're running a LocalJobRunner and not a job on a
    regular JobTracker?

    If you used CM to install the cluster, make sure to do the client
    configuration deployment:

    https://ccp.cloudera.com/display/ENT41DOC/Deploying+Client+Configuration+Files
    On Thu, Mar 21, 2013 at 12:33 PM, Mohammed Azzan Patni wrote:
    Hi I was using CDH4 earlier and used to run Informatica Hparser Data
    transformations as MapReduce jobs using hparser-1.1-hadoop-0.21.jar file.
    But After upgrading to CDH4.1 I am not able to run those. It is not running
    instead is giving me errors like:

    java.lang.NoClassDefFoundError: com/itemfield/contentmaster/CMException
    at
    com.informatica.b2b.dt.hadoop.DTFileInputFormat.createRecordReader(DTFileInputFormat.java:18)
    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:617)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
    at
    org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:263)
    Caused by: java.lang.ClassNotFoundException:
    com.itemfield.contentmaster.CMException
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    ... 4 more
    13/03/21 11:36:23 INFO mapred.JobClient: map 0% reduce 0%
    13/03/21 11:36:23 INFO mapred.JobClient: Job complete: job_local_0001
    13/03/21 11:36:25 INFO mapred.JobClient: Counters: 0
    13/03/21 11:36:25 INFO hadoop.DTRecordReader: The 'Data Transformation job-
    /var/lib/hparser/ServiceDb/NJT_4_Hadoop' job has failed.

    Can some one let me know, how to work around this?


    --
    Harsh J

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedMar 21, '13 at 7:03a
activeMar 22, '13 at 7:31a
posts3
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Mohammed Azzan Patni: 2 posts Harsh J: 1 post

People

Translate

site design / logo © 2022 Grokbase