[Hadoop-common-user] Add jar file via -libjars - giving errors

HI Tarandeep,
the libjars options does not add the jar on the client side. Their is an
open jira for that ( id ont remember which one)...

Oyu have to add the jar to the

HADOOP_CLASSPATH on the client side so that it gets picked up on the client
side as well.


mahadev

thanks Mahadev for the reply.
So that means I have to copy my jar file in the $HADOOP_HOME/lib folder on
all slave machines like before.

One more question- I am adding a conf file (just like HADOOP_SITE.xml) via
-conf option and I am able to query parameters in mapper/reducers. But is
there a way I can query the parameters in my job driver class -

public class jobDriver extends Configured
{
someMethod( )
{
ToolRunner.run( new MyJob( ), commandLineArgs);
// I want to query parameters present in my conf file here
}
}

public class MyJob extends Configured implements Tool
{
}

Thanks,
Taran

Adding your jar files in the $HADOOP_HOME/lib folder works, but you would
have to restart all your tasktrackers to have your jar files loaded.

If you repackage your map-reduce jar file (e.g. hadoop-0.18.0-examples.jar)
with your jar file and run your job with the newly repackaged jar file, it
would work, too.

You can just add the jar to the env variable HADOOP_CLASSPATH

If using bash

Just do this :

Export HADOOP_CLASSPATH=path to your class path on the client

And then use the libjars option.

mahadev

Hi,

From 0.19, the jars added using -libjars are available on the client
classpath also, fixed by HADOOP-3570.

Thanks
Amareshwari

Mahadev Konar wrote:

That's right. I have success with the 0.18 (from EC2) and 0.18.1 (my
local installation) as well.

Kyle