Grokbase › Groups › Hadoop › common-user › August 2009
FAQ
Hi,

I am using the DistCp class inside of my application to copy final output
files out into S3 (this is per Amazon's recommendation). However, when I run
the program I get the following exception:

java.lang.NoClassDefFoundError: org/apache/hadoop/tools/DistCp
at apppuncher.Aggregator.main(Aggregator.java:130)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)

Is there something special I need to do so DistCp (and other Hadoop tools
classes) would be recognized in the JVM?

Thanks,
Mark
--
View this message in context: http://www.nabble.com/DistCp---NoClassDefFoundError-tp25193896p25193896.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.

Search Discussions

  • Kevin Peterson at Aug 31, 2009 at 9:20 pm ⇧

    On Fri, Aug 28, 2009 at 10:34 AM, mpiller wrote:
    I am using the DistCp class inside of my application to copy final output
    files out into S3 (this is per Amazon's recommendation). However, when I
    run
    the program I get the following exception:

    java.lang.NoClassDefFoundError: org/apache/hadoop/tools/DistCp
    I generally run DistCp from the command line. I'd look into the bin/hadoop
    script to see what it actually runs when you do distcp. It may be that the
    jar isn't in the classpath normally.
  • Boris Shkolnik at Sep 1, 2009 at 6:25 pm ⇧
    After split Distcp belongs to hadoop-mapreduce.
    Make sure hadoop-mapred-tools-$VER-dev.jar is in your classpath.

    Boris.

    On 8/31/09 2:19 PM, "Kevin Peterson" wrote:
    On Fri, Aug 28, 2009 at 10:34 AM, mpiller wrote:


    I am using the DistCp class inside of my application to copy final output
    files out into S3 (this is per Amazon's recommendation). However, when I
    run
    the program I get the following exception:

    java.lang.NoClassDefFoundError: org/apache/hadoop/tools/DistCp
    I generally run DistCp from the command line. I'd look into the bin/hadoop
    script to see what it actually runs when you do distcp. It may be that the
    jar isn't in the classpath normally.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedAug 28, '09 at 5:34p
activeSep 1, '09 at 6:25p
posts3
users3
websitehadoop.apache.org...
irc#hadoop

3 users in discussion

Kevin Peterson: 1 post Boris Shkolnik: 1 post Mpiller: 1 post

Content

People

Support

Translate

site design / logo © 2023 Grokbase