Does the Cloudera VM have LZO data compression available? If not, since
its a 32 bit system what's the best way to build it?
Thanks
-Pete
[HBase-user] LZO Compression
| Tweet |
|
Search Discussions
-
Ferdy Galema at May 18, 2011 at 9:54 am ⇧
Not out of the box. I use the following resource for packaging lzo with
the cloudera release:
https://github.com/toddlipcon/hadoop-lzo-packagerOn 05/18/2011 08:35 AM, Pete Haidinyak wrote:
Does the Cloudera VM have LZO data compression available? If not,
since its a 32 bit system what's the best way to build it?
Thanks
-Pete -
Arun Ramakrishnan at Jun 10, 2011 at 1:59 am ⇧
I followed the instructions for building on Ubuntu Maverick.
I tried to build the packager. But, I have the following potential errors.
the Jar seemed to build fine. Looking at the last line of the log, is there
anything that is a problem ?
I am yet to get my hbase running. Hence trying to resolve all issues in
parallel.
appreciate any help.
##########
dpkg-deb: building package `cloudera-hadoop-lzo' in
`../cloudera-hadoop-lzo_20110609004620.2bd0d5b-1_amd64.deb'.
dpkg-genchanges -sa../cloudera-hadoop-lzo_20110609004620.2bd0d5b-1_amd64.changesdpkg-genchanges: including full source code in upload
dpkg-buildpackage: full upload (original source is included)
Now running lintian...
W: cloudera-hadoop-lzo source: outdated-autotools-helper-file
src/native/config/config.sub 2005-02-10
W: cloudera-hadoop-lzo source: outdated-autotools-helper-file
src/native/config/config.guess 2005-02-10
W: cloudera-hadoop-lzo source: missing-debian-source-format
W: cloudera-hadoop-lzo source: ancient-standards-version 3.8.0 (current is
3.8.4)
E: cloudera-hadoop-lzo: debian-changelog-file-missing
E: cloudera-hadoop-lzo: incorrect-libdir-in-la-file
usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.la/home/users/arun/lzo-stuff/hadoop-lzo-packager/build/deb/cloudera-hadoop-lzo-20110609004620.2bd0d5b/build/native/Linux-amd64-64/../install/lib
!= /usr/lib/hadoop/lib/native/Linux-amd64-64
Finished running lintian.
############
######################################
$ sudo dpkg -L cloudera-hadoop-lzo
/.
/usr
/usr/sbin
/usr/lib
/usr/lib/hadoop
/usr/lib/hadoop/lib
/usr/lib/hadoop/lib/cloudera-hadoop-lzo-20110609004620.2bd0d5b-1.jar
/usr/lib/hadoop/lib/native
/usr/lib/hadoop/lib/native/Linux-amd64-64
/usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.a
/usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.so.0.0.0
/usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.la
/usr/share
/usr/share/doc
/usr/share/doc/cloudera-hadoop-lzo
/usr/share/doc/cloudera-hadoop-lzo/copyright
/usr/bin
/usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.so.0
/usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.so
#####################################################On Wed, May 18, 2011 at 2:54 AM, Ferdy Galema wrote:
Not out of the box. I use the following resource for packaging lzo with the
cloudera release:
https://github.com/toddlipcon/hadoop-lzo-packagerOn 05/18/2011 08:35 AM, Pete Haidinyak wrote:
Does the Cloudera VM have LZO data compression available? If not, since
its a 32 bit system what's the best way to build it?
Thanks
-Pete
Related Discussions
Discussion Navigation
| view | thread | post |
Discussion Overview
| group | user
|
| categories | hbase, hadoop |
| posted | May 18, '11 at 6:36a |
| active | Jun 10, '11 at 1:59a |
| posts | 3 |
| users | 3 |
| website | hbase.apache.org |
