Grokbase Groups HBase user May 2011
FAQ

[HBase-user] LZO Compression

Pete Haidinyak
May 18, 2011 at 6:36 am
Does the Cloudera VM have LZO data compression available? If not, since
its a 32 bit system what's the best way to build it?

Thanks

-Pete
reply

Search Discussions

2 responses

  • Ferdy Galema at May 18, 2011 at 9:54 am
    Not out of the box. I use the following resource for packaging lzo with
    the cloudera release:
    https://github.com/toddlipcon/hadoop-lzo-packager
    On 05/18/2011 08:35 AM, Pete Haidinyak wrote:
    Does the Cloudera VM have LZO data compression available? If not,
    since its a 32 bit system what's the best way to build it?

    Thanks

    -Pete
  • Arun Ramakrishnan at Jun 10, 2011 at 1:59 am
    I followed the instructions for building on Ubuntu Maverick.

    I tried to build the packager. But, I have the following potential errors.
    the Jar seemed to build fine. Looking at the last line of the log, is there
    anything that is a problem ?

    I am yet to get my hbase running. Hence trying to resolve all issues in
    parallel.

    appreciate any help.

    ##########
    dpkg-deb: building package `cloudera-hadoop-lzo' in
    `../cloudera-hadoop-lzo_20110609004620.2bd0d5b-1_amd64.deb'.
    dpkg-genchanges -sa
    ../cloudera-hadoop-lzo_20110609004620.2bd0d5b-1_amd64.changes
    dpkg-genchanges: including full source code in upload
    dpkg-buildpackage: full upload (original source is included)
    Now running lintian...
    W: cloudera-hadoop-lzo source: outdated-autotools-helper-file
    src/native/config/config.sub 2005-02-10
    W: cloudera-hadoop-lzo source: outdated-autotools-helper-file
    src/native/config/config.guess 2005-02-10
    W: cloudera-hadoop-lzo source: missing-debian-source-format
    W: cloudera-hadoop-lzo source: ancient-standards-version 3.8.0 (current is
    3.8.4)
    E: cloudera-hadoop-lzo: debian-changelog-file-missing
    E: cloudera-hadoop-lzo: incorrect-libdir-in-la-file
    usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.la/home/users/arun/lzo-stuff/hadoop-lzo-packager/build/deb/cloudera-hadoop-lzo-20110609004620.2bd0d5b/build/native/Linux-amd64-64/../install/lib
    != /usr/lib/hadoop/lib/native/Linux-amd64-64
    Finished running lintian.

    ############


    ######################################
    $ sudo dpkg -L cloudera-hadoop-lzo
    /.
    /usr
    /usr/sbin
    /usr/lib
    /usr/lib/hadoop
    /usr/lib/hadoop/lib
    /usr/lib/hadoop/lib/cloudera-hadoop-lzo-20110609004620.2bd0d5b-1.jar
    /usr/lib/hadoop/lib/native
    /usr/lib/hadoop/lib/native/Linux-amd64-64
    /usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.a
    /usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.so.0.0.0
    /usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.la
    /usr/share
    /usr/share/doc
    /usr/share/doc/cloudera-hadoop-lzo
    /usr/share/doc/cloudera-hadoop-lzo/copyright
    /usr/bin
    /usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.so.0
    /usr/lib/hadoop/lib/native/Linux-amd64-64/libgplcompression.so
    #####################################################
    On Wed, May 18, 2011 at 2:54 AM, Ferdy Galema wrote:

    Not out of the box. I use the following resource for packaging lzo with the
    cloudera release:
    https://github.com/toddlipcon/hadoop-lzo-packager

    On 05/18/2011 08:35 AM, Pete Haidinyak wrote:

    Does the Cloudera VM have LZO data compression available? If not, since
    its a 32 bit system what's the best way to build it?

    Thanks

    -Pete

Related Discussions

Discussion Navigation
viewthread | post