[Hadoop-common-user] How to make LZO work?

On Oct 9, 2008, at 5:58 PM, Songting Chen wrote:

Hi,
I have installed lzo-2.03 to my Linux box.
But still my code for writing a SequenceFile using LZOcodec returns
the following error:

util.NativeCodeLoader: Loaded the native-hadoop library
java.lang.UnsatisfiedLinkError: Cannot load liblzo2.so!

What needs to be done to make this work?

From: Arun C Murthy <acm@yahoo-inc.com>
Subject: Re: How to make LZO work?
To: core-user@hadoop.apache.org
Date: Thursday, October 9, 2008, 6:35 PM
http://hadoop.apache.org/core/docs/current/native_libraries.html

Arun

On Oct 9, 2008, at 6:46 PM, Songting Chen wrote:

Thanks, Arun.

Does that mean I have to rebuild the native library?

Also, the LZO installation puts liblzo2.a and liblzo2.la under /usr/
local/lib. There is no liblzo2.so there. Do I need to rename them to
liblzo2.so somehow?


--- On Thu, 10/9/08, Arun C Murthy wrote:

On 10/9/08 6:46 PM, "Songting Chen" wrote:
Does that mean I have to rebuild the native library?

Also, the LZO installation puts liblzo2.a and liblzo2.la under /usr/local/lib.
There is no liblzo2.so there. Do I need to rename them to liblzo2.so somehow?

From: Allen Wittenauer <aw@yahoo-inc.com>
Subject: Re: How to make LZO work?
To: core-user@hadoop.apache.org
Date: Friday, October 10, 2008, 7:44 AM
On 10/9/08 6:46 PM, "Songting Chen"
wrote:
to liblzo2.so somehow?


You need to compile and install lzo2 as a shared
library. IIRC, this is
not the default.


Also, the shared version (.so) will need to be part of
your link path
(LD_LIBRARY_PATH env var, /etc/ld.so.conf on Linux, runtime
option (usually
-R) to ld, ...) when you fire up the JVM so that Java can
locate it when it
needs it.

From: Songting Chen <ken_cst1998@yahoo.com>
Subject: Re: How to make LZO work?
To: core-user@hadoop.apache.org
Date: Friday, October 10, 2008, 11:14 AM
Thanks, Allen.

I checked the INSTALL doc in lzo-2.03 package.

It's said to use './configure --enable-shared'
command to build shared library. I followed that instruction
and recompile / install the package.

But after that, still only .a, .la appear in
/usr/local/lib.

-rw-r--r-- 1 root root 855742 Oct 10 10:50 liblzo2.a
-rwxr-xr-x 1 root root 740 Oct 10 10:50 liblzo2.la

How do I generate the liblzo2.so file?

--- On Fri, 10/10/08, Allen Wittenauer
wrote:
library?
them

On Oct 10, 2008, at 12:51 AM, Songting Chen wrote:

Thanks Arun.

Still sort of confused.

If I don't need to rebuild the library, after lzo is installed, it's
still not working.

My code:

writer = SequenceFile.createWriter(fileSys, jobConf,
file, LongWritable.class, BytesWritable.class,
SequenceFile.CompressionType.BLOCK, new LzoCodec());

Rebuilding the library gave some weird error too.


--- On Fri, 10/10/08, Arun C Murthy wrote: