FAQ
Hi,

I process this command: ./hadoop jar /home/userme/hd.jar
org.postdirekt.hadoop.WordCount gutenberg gutenberberg-output



and get this why? Because I have org.postdirekt.hadoop.Map in the jar
File.



10/12/28 15:28:30 INFO mapreduce.Job: Task Id :
attempt_201012281524_0002_m_000000_0, Status : FAILED

java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.postdirekt.hadoop.Map

at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

at
org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
tImpl.java:167)

at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

at java.security.AccessController.doPrivileged(Native
Method)

at javax.security.auth.Subject.doAs(Subject.java:396)

at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
n.java:742)

at org.apache.hadoop.mapred.Child.main(Child.java:211)

Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

at java.security.AccessController.doPrivileged(Native
Method)

at
java.net.URLClassLoader.findClass(URLClassLoader.java:190)

at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

at sun.m

10/12/28 15:28:41 INFO mapreduce.Job: Task Id :
attempt_201012281524_0002_m_000000_1, Status : FAILED

java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.postdirekt.hadoop.Map

at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

at
org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
tImpl.java:167)

at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

at java.security.AccessController.doPrivileged(Native
Method)

at javax.security.auth.Subject.doAs(Subject.java:396)

at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
n.java:742)

at org.apache.hadoop.mapred.Child.main(Child.java:211)

Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

at java.security.AccessController.doPrivileged(Native
Method)

at
java.net.URLClassLoader.findClass(URLClassLoader.java:190)

at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

at sun.m

10/12/28 15:28:53 INFO mapreduce.Job: Task Id :
attempt_201012281524_0002_m_000000_2, Status : FAILED

java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.postdirekt.hadoop.Map

at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

at
org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
tImpl.java:167)

at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

at java.security.AccessController.doPrivileged(Native
Method)

at javax.security.auth.Subject.doAs(Subject.java:396)

at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
n.java:742)

at org.apache.hadoop.mapred.Child.main(Child.java:211)

Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

at java.security.AccessController.doPrivileged(Native
Method)

at
java.net.URLClassLoader.findClass(URLClassLoader.java:190)

at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

at sun.m

10/12/28 15:29:09 INFO mapreduce.Job: Job complete:
job_201012281524_0002

10/12/28 15:29:09 INFO mapreduce.Job: Counters: 7

Job Counters

Data-local map tasks=4

Total time spent by all maps waiting after
reserving slots (ms)=0

Total time spent by all reduces waiting after
reserving slots (ms)=0

Failed map tasks=1

SLOTS_MILLIS_MAPS=45636

SLOTS_MILLIS_REDUCES=0

Launched map tasks=4

Search Discussions

  • James Seigel at Dec 28, 2010 at 3:03 pm
    jar -tvf the jar file and double check that it is a class that is
    listed. Can't be in an included jar file.

    Sent from my mobile. Please excuse the typos.

    On 2010-12-28, at 7:58 AM, "Cavus,M.,Fa. Post Direkt"
    wrote:
    Hi,

    I process this command: ./hadoop jar /home/userme/hd.jar
    org.postdirekt.hadoop.WordCount gutenberg gutenberberg-output



    and get this why? Because I have org.postdirekt.hadoop.Map in the jar
    File.



    10/12/28 15:28:30 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_0, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:28:41 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_1, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:28:53 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_2, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:29:09 INFO mapreduce.Job: Job complete:
    job_201012281524_0002

    10/12/28 15:29:09 INFO mapreduce.Job: Counters: 7

    Job Counters

    Data-local map tasks=4

    Total time spent by all maps waiting after
    reserving slots (ms)=0

    Total time spent by all reduces waiting after
    reserving slots (ms)=0

    Failed map tasks=1

    SLOTS_MILLIS_MAPS=45636

    SLOTS_MILLIS_REDUCES=0

    Launched map tasks=4

  • Cavus,M.,Fa. Post Direkt at Dec 28, 2010 at 3:13 pm
    What must I do James?

    -----Original Message-----
    From: James Seigel
    Sent: Tuesday, December 28, 2010 4:03 PM
    To: common-user@hadoop.apache.org
    Subject: Re: ClassNotFoundException

    jar -tvf the jar file and double check that it is a class that is
    listed. Can't be in an included jar file.

    Sent from my mobile. Please excuse the typos.

    On 2010-12-28, at 7:58 AM, "Cavus,M.,Fa. Post Direkt"
    wrote:
    Hi,

    I process this command: ./hadoop jar /home/userme/hd.jar
    org.postdirekt.hadoop.WordCount gutenberg gutenberberg-output



    and get this why? Because I have org.postdirekt.hadoop.Map in the jar
    File.



    10/12/28 15:28:30 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_0, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:28:41 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_1, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:28:53 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_2, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:29:09 INFO mapreduce.Job: Job complete:
    job_201012281524_0002

    10/12/28 15:29:09 INFO mapreduce.Job: Counters: 7

    Job Counters

    Data-local map tasks=4

    Total time spent by all maps waiting after
    reserving slots (ms)=0

    Total time spent by all reduces waiting after
    reserving slots (ms)=0

    Failed map tasks=1

    SLOTS_MILLIS_MAPS=45636

    SLOTS_MILLIS_REDUCES=0

    Launched map tasks=4

  • Praveen Bathala at Dec 28, 2010 at 3:17 pm
    Just run this and make sure you really have the class file in jar

    "jar -tvf | grep org.postdirekt.hadoop.Map"

    if you don't get any output, the you don't have the class file in your jar

    + Praveen
    On Dec 28, 2010, at 9:12 AM, Cavus,M.,Fa. Post Direkt wrote:

    What must I do James?

    -----Original Message-----
    From: James Seigel
    Sent: Tuesday, December 28, 2010 4:03 PM
    To: common-user@hadoop.apache.org
    Subject: Re: ClassNotFoundException

    jar -tvf the jar file and double check that it is a class that is
    listed. Can't be in an included jar file.

    Sent from my mobile. Please excuse the typos.

    On 2010-12-28, at 7:58 AM, "Cavus,M.,Fa. Post Direkt"
    wrote:
    Hi,

    I process this command: ./hadoop jar /home/userme/hd.jar
    org.postdirekt.hadoop.WordCount gutenberg gutenberberg-output



    and get this why? Because I have org.postdirekt.hadoop.Map in the jar
    File.



    10/12/28 15:28:30 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_0, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:28:41 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_1, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:28:53 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_2, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)

    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException: org.postdirekt.hadoop.Map

    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:29:09 INFO mapreduce.Job: Job complete:
    job_201012281524_0002

    10/12/28 15:29:09 INFO mapreduce.Job: Counters: 7

    Job Counters

    Data-local map tasks=4

    Total time spent by all maps waiting after
    reserving slots (ms)=0

    Total time spent by all reduces waiting after
    reserving slots (ms)=0

    Failed map tasks=1

    SLOTS_MILLIS_MAPS=45636

    SLOTS_MILLIS_REDUCES=0

    Launched map tasks=4

  • Cavus,M.,Fa. Post Direkt at Dec 28, 2010 at 3:22 pm
    Hi Praveen, I get this

    2398 Mon Dec 27 16:19:16 CET org/postdirekt/hadoop/Map.class


    -----Original Message-----
    From: Praveen Bathala
    Sent: Tuesday, December 28, 2010 4:17 PM
    To: common-user@hadoop.apache.org
    Subject: Re: ClassNotFoundException

    Just run this and make sure you really have the class file in jar

    "jar -tvf | grep org.postdirekt.hadoop.Map"

    if you don't get any output, the you don't have the class file in your
    jar

    + Praveen
    On Dec 28, 2010, at 9:12 AM, Cavus,M.,Fa. Post Direkt wrote:

    What must I do James?

    -----Original Message-----
    From: James Seigel
    Sent: Tuesday, December 28, 2010 4:03 PM
    To: common-user@hadoop.apache.org
    Subject: Re: ClassNotFoundException

    jar -tvf the jar file and double check that it is a class that is
    listed. Can't be in an included jar file.

    Sent from my mobile. Please excuse the typos.

    On 2010-12-28, at 7:58 AM, "Cavus,M.,Fa. Post Direkt"
    wrote:
    Hi,

    I process this command: ./hadoop jar /home/userme/hd.jar
    org.postdirekt.hadoop.WordCount gutenberg gutenberberg-output



    and get this why? Because I have org.postdirekt.hadoop.Map in the jar
    File.



    10/12/28 15:28:30 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_0, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)
    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:28:41 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_1, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)
    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:28:53 INFO mapreduce.Job: Task Id :
    attempt_201012281524_0002_m_000000_2, Status : FAILED

    java.lang.RuntimeException: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map

    at
    org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)
    at
    org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContex
    tImpl.java:167)

    at
    org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)

    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at
    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
    n.java:742)

    at org.apache.hadoop.mapred.Child.main(Child.java:211)

    Caused by: java.lang.ClassNotFoundException:
    org.postdirekt.hadoop.Map
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

    at java.security.AccessController.doPrivileged(Native
    Method)

    at
    java.net.URLClassLoader.findClass(URLClassLoader.java:190)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.m

    10/12/28 15:29:09 INFO mapreduce.Job: Job complete:
    job_201012281524_0002

    10/12/28 15:29:09 INFO mapreduce.Job: Counters: 7

    Job Counters

    Data-local map tasks=4

    Total time spent by all maps waiting after
    reserving slots (ms)=0

    Total time spent by all reduces waiting after
    reserving slots (ms)=0

    Failed map tasks=1

    SLOTS_MILLIS_MAPS=45636

    SLOTS_MILLIS_REDUCES=0

    Launched map tasks=4

  • Black, Michael (IS) at Dec 28, 2010 at 3:39 pm
    I'm using hadoop-0.20.2 and I see this for my map/reduce class

    com/ngc/asoc/recommend/Predict$Counter.class
    com/ngc/asoc/recommend/Predict$R.class
    com/ngc/asoc/recommend/Predict$M.class
    com/ngc/asoc/recommend/Predict.class

    I'm a java idiot so I don't know why they appear but perhaps you have similar?

    Michael D. Black
    Senior Scientist
    Advanced Analytics Directorate
    Northrop Grumman Information Systems


    ________________________________

    From: Cavus,M.,Fa. Post Direkt
    Sent: Tue 12/28/2010 9:21 AM
    To: common-user@hadoop.apache.org
    Subject: EXTERNAL:RE: ClassNotFoundException



    Hi Praveen, I get this

    2398 Mon Dec 27 16:19:16 CET org/postdirekt/hadoop/Map.class
  • Harsh J at Dec 28, 2010 at 4:16 pm
    In your job driving class (WordCount as per that command), have you
    specified the jar by calling the Job.setJarByClass() [or on Stable
    API, JobConf.setJarByClass()]?

    I'm not sure if hadoop.util.RunJar automatically sends the jar across
    for distribution to TaskTrackers.

    On Tue, Dec 28, 2010 at 8:27 PM, Cavus,M.,Fa. Post Direkt
    wrote:
    Hi,

    I process this command: ./hadoop jar /home/userme/hd.jar
    org.postdirekt.hadoop.WordCount gutenberg gutenberberg-output
    --
    Harsh J
    www.harshj.com
  • Cavus,M.,Fa. Post Direkt at Dec 29, 2010 at 8:36 am
    Could you give me the command Harsh?

    -----Original Message-----
    From: Harsh J
    Sent: Tuesday, December 28, 2010 5:15 PM
    To: common-user@hadoop.apache.org
    Subject: Re: ClassNotFoundException

    In your job driving class (WordCount as per that command), have you
    specified the jar by calling the Job.setJarByClass() [or on Stable
    API, JobConf.setJarByClass()]?

    I'm not sure if hadoop.util.RunJar automatically sends the jar across
    for distribution to TaskTrackers.

    On Tue, Dec 28, 2010 at 8:27 PM, Cavus,M.,Fa. Post Direkt
    wrote:
    Hi,

    I process this command: ./hadoop jar /home/userme/hd.jar
    org.postdirekt.hadoop.WordCount gutenberg gutenberberg-output
    --
    Harsh J
    www.harshj.com

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedDec 28, '10 at 2:58p
activeDec 29, '10 at 8:36a
posts8
users5
websitehadoop.apache.org...
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase