FAQ
Hi All,

I'm trying to test different file formats' performance working with Impala
and stucked on getting it work by using LZO compressed text files.

I've already installed LZO on all nodes, loaded and indexed the data in
Hive. And hit this error:

*Query: select count(*) from actions_lzo*
*Query aborted, unable to fetch data*
*
*
*Backend 0:Unable to load libimpalalzo.so dlerror:
/opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so:
undefined symbol: _ZN6impala7MemPoolC1Ei*
*Unable to load libimpalalzo.so dlerror:
/opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so:
undefined symbol: _ZN6impala7MemPoolC1Ei*
*Backend 1:Unable to load libimpalalzo.so dlerror:
/opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so:
undefined symbol: _ZN6impala7MemPoolC1Ei*
*Unable to load libimpalalzo.so dlerror:
/opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so:
undefined symbol: _ZN6impala7MemPoolC1Ei*
*Backend 2:Unable to load libimpalalzo.so dlerror:
/opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so:
undefined symbol: _ZN6impala7MemPoolC1Ei*
*Unable to load libimpalalzo.so dlerror:
/opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so:
undefined symbol: _ZN6impala7MemPoolC1Ei*
*Backend 3:Unable to load libimpalalzo.so dlerror:
/opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so:
undefined symbol: _ZN6impala7MemPoolC1Ei*
*Unable to load libimpalalzo.so dlerror:
/opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so:
undefined symbol: _ZN6impala7MemPoolC1Ei*

Parcel Versions:
CM 4.6
IMP 1.0.1
Hadoop_LZO 0.4.15
CDH 4.3.0

Any thought on how it could be resolved?

thanks
R

Search Discussions

  • Nong Li at Jun 10, 2013 at 9:26 pm
    What OS are you running?

    Can you also do "nm <path to impalad> | grep MemPool" and send that output
    file?

    On Mon, Jun 10, 2013 at 1:37 PM, Robin Li wrote:

    Hi All,

    I'm trying to test different file formats' performance working with Impala
    and stucked on getting it work by using LZO compressed text files.

    I've already installed LZO on all nodes, loaded and indexed the data in
    Hive. And hit this error:

    *Query: select count(*) from actions_lzo*
    *Query aborted, unable to fetch data*
    *
    *
    *Backend 0:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei*
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*
    *Backend 1:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei*
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*
    *Backend 2:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei*
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*
    *Backend 3:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei*
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*

    Parcel Versions:
    CM 4.6
    IMP 1.0.1
    Hadoop_LZO 0.4.15
    CDH 4.3.0

    Any thought on how it could be resolved?

    thanks
    R
  • Robin Li at Jun 10, 2013 at 10:14 pm
    Hi Nong,

    CDH runs on CentOS 6.3.

    "nm" yielded no results, so I run "objdump -T" instead, pls see result
    pasted below.

    00000000007ffa40 g DF .text 000000000000030e Base
      _ZN6impala7MemPool9FindChunkEi
    0000000000735420 w DF .text 0000000000000022 Base
      _ZN5boost10scoped_ptrIN6impala7MemPoolEED2Ev
    00000000008086b0 g DF .text 0000000000000151 Base
      _ZN6impala8RawValue5WriteEPKvPvNS_13PrimitiveTypeEPNS_7MemPoolE
    00000000007c2cb0 g DF .text 0000000000000062 Base
      _ZN6impala5CodecC1EPNS_7MemPoolEb
    00000000007bfd60 g DF .text 0000000000000116 Base
      _ZN6impala14GzipCompressorC1ENS0_6FormatEPNS_7MemPoolEb
    000000000096b980 g DF .text 000000000000016d Base
      _ZN6impala11HdfsScanner18WriteAlignedTuplesEPNS_7MemPoolEPNS_8TupleRowEiPNS_13FieldLocationEiiii
    00000000007c2cb0 g DF .text 0000000000000062 Base
      _ZN6impala5CodecC2EPNS_7MemPoolEb
    00000000007fec60 g DF .text 0000000000000006 Base
      _ZN6impala7MemPool14CheckIntegrityEb
    00000000007fed90 g DF .text 0000000000000085 Base
      _ZN6impala7MemPool12GetChunkInfoEPSt6vectorISt4pairIPhiESaIS4_EE
    00000000009391c0 g DF .text 0000000000000115 Base
      _ZN6impala15HdfsTextScanner17CopyBoundaryFieldEPNS_13FieldLocationEPNS_7MemPoolE
    00000000007fefd0 g DF .text 00000000000000ab Base
      _ZN6impala7MemPoolC2EPKSt6vectorIPNS_8MemLimitESaIS3_EEi
    00000000007fefd0 g DF .text 00000000000000ab Base
      _ZN6impala7MemPoolC1EPKSt6vectorIPNS_8MemLimitESaIS3_EEi
    0000000000950c00 g DF .text 0000000000000042 Base
      _ZN6impala14ScannerContext9GetMemoryEPPNS_7MemPoolEPPNS_5TupleEPPNS_8TupleRowE
    00000000007c3d40 g DF .text 00000000000001c7 Base
      _ZN6impala5Codec18CreateDecompressorEPNS_12RuntimeStateEPNS_7MemPoolEbNS_16THdfsCompression4typeEPN5boost10scoped_ptrIS0_EE
    00000000007c75d0 g DF .text 0000000000000116 Base
      _ZN6impala16GzipDecompressorC1EPNS_7MemPoolEbb
    00000000007c63a0 g DF .text 000000000000001c Base
      _ZN6impala16BzipDecompressorC1EPNS_7MemPoolEb
    00000000007fec20 g DF .text 0000000000000039 Base
      _ZNK6impala7MemPool18GetTotalChunkSizesEv
    00000000007c63a0 g DF .text 000000000000001c Base
      _ZN6impala16BzipDecompressorC2EPNS_7MemPoolEb
    000000000096d8e0 g DF .text 000000000000010a Base
      _ZN6impala19IntegerArrayBuilderC1EiiPNS_7MemPoolE
    00000000007bf320 g DF .text 000000000000001c Base
      _ZN6impala14BzipCompressorC1EPNS_7MemPoolEb
    00000000009556b0 g DF .text 00000000000000d1 Base
      _ZN6impala13TextConverter14UnescapeStringEPNS_11StringValueEPNS_7MemPoolE
    000000000092e1e0 w DF .text 000000000000007f Base
      _ZN6impala7MemPool8AllocateEi
    00000000007bf320 g DF .text 000000000000001c Base
      _ZN6impala14BzipCompressorC2EPNS_7MemPoolEb
    00000000007fee20 g DF .text 00000000000000e5 Base
      _ZN6impala7MemPoolD1Ev
    000000000096aee0 w DF .text 0000000000000a63 Base
      _ZN6impala13TextConverter9WriteSlotEPKNS_14SlotDescriptorEPNS_5TupleEPKcibbPNS_7MemPoolE
    00000000007fee20 g DF .text 00000000000000e5 Base
      _ZN6impala7MemPoolD2Ev
    000000000136186c g DO .rodata 0000000000000004 Base
      _ZN6impala7MemPool14MAX_CHUNK_SIZEE
    000000000080f8d0 g DF .text 0000000000000212 Base
      _ZN6impala5Tuple8DeepCopyEPS0_RKNS_15TupleDescriptorEPNS_7MemPoolEb
    000000000093a300 g DF .text 0000000000000742 Base
      _ZN6impala15HdfsTextScanner11WriteFieldsEPNS_7MemPoolEPNS_8TupleRowEii
    00000000007c6360 g DF .text 000000000000001c Base
      _ZN6impala23SnappyBlockDecompressorC1EPNS_7MemPoolEb
    00000000007c6360 g DF .text 000000000000001c Base
      _ZN6impala23SnappyBlockDecompressorC2EPNS_7MemPoolEb
    0000000000808810 g DF .text 000000000000002c Base
      _ZN6impala8RawValue5WriteEPKvPNS_5TupleEPKNS_14SlotDescriptorEPNS_7MemPoolE
    00000000007bf300 g DF .text 000000000000001c Base
      _ZN6impala21SnappyBlockCompressorC1EPNS_7MemPoolEb
    0000000000936650 w DF .text 0000000000000615 Base
      _ZN6impala15HdfsAvroScanner13ReadPrimitiveERKNS0_13SchemaElementERKNS_14SlotDescriptorEPNS_7MemPoolEPPhPiPNS_5TupleE
    00000000007bf300 g DF .text 000000000000001c Base
      _ZN6impala21SnappyBlockCompressorC2EPNS_7MemPoolEb
    00000000007c5020 g DF .text 00000000000001c7 Base
      _ZN6impala5Codec16CreateCompressorEPNS_12RuntimeStateEPNS_7MemPoolEbNS_16THdfsCompression4typeEPN5boost10scoped_ptrIS0_EE
    00000000007ff2d0 g DF .text 000000000000076b Base
      _ZN6impala7MemPool11DebugStringEv
    0000000001af1268 g DO .data 0000000000000008 Base
      _ZN6impala7MemPool15LLVM_CLASS_NAMEE
    0000000000935260 g DF .text 0000000000000496 Base
      _ZN6impala15HdfsAvroScanner14DecodeAvroDataEiPlPNS_7MemPoolEPPhPiPNS_5TupleEPNS_8TupleRowE
    00000000007fef10 g DF .text 0000000000000062 Base
      _ZN6impala7MemPool9ChunkInfoC1Ei
    0000000000800ae0 w DF .text 00000000000003f5 Base
      _ZNSt6vectorIN6impala7MemPool9ChunkInfoESaIS2_EE15_M_range_insertIN9__gnu_cxx17__normal_iteratorIPS2_S4_EEEEvS9_T_SA_St20forward_iterator_tag
    00000000007c75d0 g DF .text 0000000000000116 Base
      _ZN6impala16GzipDecompressorC2EPNS_7MemPoolEbb
    0000000001361868 g DO .rodata 0000000000000004 Base
      _ZN6impala7MemPool26DEFAULT_INITIAL_CHUNK_SIZEE
    00000000007fef10 g DF .text 0000000000000062 Base
      _ZN6impala7MemPool9ChunkInfoC2Ei
    0000000000943a20 w DF .text 000000000000059e Base
      _ZN6impala18HdfsParquetScanner12ColumnReader9ReadValueEPNS_7MemPoolEPNS_5TupleE
    00000000007bf2e0 g DF .text 000000000000001c Base
      _ZN6impala16SnappyCompressorC1EPNS_7MemPoolEb
    000000000096d8e0 g DF .text 000000000000010a Base
      _ZN6impala19IntegerArrayBuilderC2EiiPNS_7MemPoolE
    000000000080faf0 g DF .text 00000000000000e1 Base
      _ZN6impala5Tuple8DeepCopyERKNS_15TupleDescriptorEPNS_7MemPoolEb
    00000000007bf2e0 g DF .text 000000000000001c Base
      _ZN6impala16SnappyCompressorC2EPNS_7MemPoolEb
    00000000007c34d0 g DF .text 0000000000000865 Base
      _ZN6impala5Codec18CreateDecompressorEPNS_12RuntimeStateEPNS_7MemPoolEbNS_16THdfsCompression4typeEPPS0_
    00000000007fec70 g DF .text 0000000000000087 Base
      _ZN6impala7MemPool15GetOffsetHelperEPh
    00000000007c6380 g DF .text 000000000000001c Base
      _ZN6impala18SnappyDecompressorC1EPNS_7MemPoolEb
    00000000007fed00 g DF .text 0000000000000081 Base
      _ZN6impala7MemPool16GetDataPtrHelperEi
    00000000007c6380 g DF .text 000000000000001c Base
      _ZN6impala18SnappyDecompressorC2EPNS_7MemPoolEb
    00000000007c4760 g DF .text 00000000000008bd Base
      _ZN6impala5Codec16CreateCompressorEPNS_12RuntimeStateEPNS_7MemPoolEbNS_16THdfsCompression4typeEPPS0_
    00000000007c51f0 g DF .text 000000000000084a Base
      _ZN6impala5Codec16CreateCompressorEPNS_12RuntimeStateEPNS_7MemPoolEbRKSsPN5boost10scoped_ptrIS0_EE
    0000000000967640 g DF .text 0000000000000132 Base
      _ZN6impala11HdfsScanner18WriteCompleteTupleEPNS_7MemPoolEPNS_13FieldLocationEPNS_5TupleEPNS_8TupleRowES6_PhS9_
    00000000007ffd50 g DF .text 00000000000007d3 Base
      _ZN6impala7MemPool10DebugPrintEv
    00000000007febc0 g DF .text 000000000000005d Base
      _ZN6impala7MemPool8ContainsEPhi
    0000000000735420 w DF .text 0000000000000022 Base
      _ZN5boost10scoped_ptrIN6impala7MemPoolEED1Ev
    00000000007ff080 g DF .text 000000000000024e Base
      _ZN6impala7MemPool11AcquireDataEPS0_b
    00000000007c3f10 g DF .text 000000000000084a Base
      _ZN6impala5Codec18CreateDecompressorEPNS_12RuntimeStateEPNS_7MemPoolEbRKSsPN5boost10scoped_ptrIS0_EE
    0000000000800730 w DF .text 000000000000026f Base
      _ZNSt6vectorIN6impala7MemPool9ChunkInfoESaIS2_EE13_M_insert_auxEN9__gnu_cxx17__normal_iteratorIPS2_S4_EERKS2_
    00000000007bfd60 g DF .text 0000000000000116 Base
      _ZN6impala14GzipCompressorC2ENS0_6FormatEPNS_7MemPoolEb

    On Mon, Jun 10, 2013 at 2:26 PM, Nong Li wrote:

    What OS are you running?

    Can you also do "nm <path to impalad> | grep MemPool" and send that output
    file?

    On Mon, Jun 10, 2013 at 1:37 PM, Robin Li wrote:

    Hi All,

    I'm trying to test different file formats' performance working with
    Impala and stucked on getting it work by using LZO compressed text files.

    I've already installed LZO on all nodes, loaded and indexed the data in
    Hive. And hit this error:

    *Query: select count(*) from actions_lzo*
    *Query aborted, unable to fetch data*
    *
    *
    *Backend 0:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei*
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*
    *Backend 1:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei*
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*
    *Backend 2:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei*
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*
    *Backend 3:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei*
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*

    Parcel Versions:
    CM 4.6
    IMP 1.0.1
    Hadoop_LZO 0.4.15
    CDH 4.3.0

    Any thought on how it could be resolved?

    thanks
    R

    --
    Robin
  • Robin Li at Jun 11, 2013 at 12:13 am
    Got a reply from Cloudera Manager Users group. Apparently there is an issue
    with the latest LZO parcel release. Phil emailed me an updated repo to
    test, all works fine after that.

    Thank you very much Nong looking into this matter.

    thanks
    Robin

    Philip Langdale <philipl@cloudera.com>
    4:11 PM (59 minutes ago)
    to me, scm-users
    Hi Robin,

    The LZO plugin needs to be updated for Impala 1.0.1 and apparently that
    hasn't been published - I'll look into it.

    --phil

    On Mon, Jun 10, 2013 at 3:14 PM, Robin Li wrote:

    Hi Nong,

    CDH runs on CentOS 6.3.

    "nm" yielded no results, so I run "objdump -T" instead, pls see result
    pasted below.

    00000000007ffa40 g DF .text 000000000000030e Base
    _ZN6impala7MemPool9FindChunkEi
    0000000000735420 w DF .text 0000000000000022 Base
    _ZN5boost10scoped_ptrIN6impala7MemPoolEED2Ev
    00000000008086b0 g DF .text 0000000000000151 Base
    _ZN6impala8RawValue5WriteEPKvPvNS_13PrimitiveTypeEPNS_7MemPoolE
    00000000007c2cb0 g DF .text 0000000000000062 Base
    _ZN6impala5CodecC1EPNS_7MemPoolEb
    00000000007bfd60 g DF .text 0000000000000116 Base
    _ZN6impala14GzipCompressorC1ENS0_6FormatEPNS_7MemPoolEb
    000000000096b980 g DF .text 000000000000016d Base
    _ZN6impala11HdfsScanner18WriteAlignedTuplesEPNS_7MemPoolEPNS_8TupleRowEiPNS_13FieldLocationEiiii
    00000000007c2cb0 g DF .text 0000000000000062 Base
    _ZN6impala5CodecC2EPNS_7MemPoolEb
    00000000007fec60 g DF .text 0000000000000006 Base
    _ZN6impala7MemPool14CheckIntegrityEb
    00000000007fed90 g DF .text 0000000000000085 Base
    _ZN6impala7MemPool12GetChunkInfoEPSt6vectorISt4pairIPhiESaIS4_EE
    00000000009391c0 g DF .text 0000000000000115 Base
    _ZN6impala15HdfsTextScanner17CopyBoundaryFieldEPNS_13FieldLocationEPNS_7MemPoolE
    00000000007fefd0 g DF .text 00000000000000ab Base
    _ZN6impala7MemPoolC2EPKSt6vectorIPNS_8MemLimitESaIS3_EEi
    00000000007fefd0 g DF .text 00000000000000ab Base
    _ZN6impala7MemPoolC1EPKSt6vectorIPNS_8MemLimitESaIS3_EEi
    0000000000950c00 g DF .text 0000000000000042 Base
    _ZN6impala14ScannerContext9GetMemoryEPPNS_7MemPoolEPPNS_5TupleEPPNS_8TupleRowE
    00000000007c3d40 g DF .text 00000000000001c7 Base
    _ZN6impala5Codec18CreateDecompressorEPNS_12RuntimeStateEPNS_7MemPoolEbNS_16THdfsCompression4typeEPN5boost10scoped_ptrIS0_EE
    00000000007c75d0 g DF .text 0000000000000116 Base
    _ZN6impala16GzipDecompressorC1EPNS_7MemPoolEbb
    00000000007c63a0 g DF .text 000000000000001c Base
    _ZN6impala16BzipDecompressorC1EPNS_7MemPoolEb
    00000000007fec20 g DF .text 0000000000000039 Base
    _ZNK6impala7MemPool18GetTotalChunkSizesEv
    00000000007c63a0 g DF .text 000000000000001c Base
    _ZN6impala16BzipDecompressorC2EPNS_7MemPoolEb
    000000000096d8e0 g DF .text 000000000000010a Base
    _ZN6impala19IntegerArrayBuilderC1EiiPNS_7MemPoolE
    00000000007bf320 g DF .text 000000000000001c Base
    _ZN6impala14BzipCompressorC1EPNS_7MemPoolEb
    00000000009556b0 g DF .text 00000000000000d1 Base
    _ZN6impala13TextConverter14UnescapeStringEPNS_11StringValueEPNS_7MemPoolE
    000000000092e1e0 w DF .text 000000000000007f Base
    _ZN6impala7MemPool8AllocateEi
    00000000007bf320 g DF .text 000000000000001c Base
    _ZN6impala14BzipCompressorC2EPNS_7MemPoolEb
    00000000007fee20 g DF .text 00000000000000e5 Base
    _ZN6impala7MemPoolD1Ev
    000000000096aee0 w DF .text 0000000000000a63 Base
    _ZN6impala13TextConverter9WriteSlotEPKNS_14SlotDescriptorEPNS_5TupleEPKcibbPNS_7MemPoolE
    00000000007fee20 g DF .text 00000000000000e5 Base
    _ZN6impala7MemPoolD2Ev
    000000000136186c g DO .rodata 0000000000000004 Base
    _ZN6impala7MemPool14MAX_CHUNK_SIZEE
    000000000080f8d0 g DF .text 0000000000000212 Base
    _ZN6impala5Tuple8DeepCopyEPS0_RKNS_15TupleDescriptorEPNS_7MemPoolEb
    000000000093a300 g DF .text 0000000000000742 Base
    _ZN6impala15HdfsTextScanner11WriteFieldsEPNS_7MemPoolEPNS_8TupleRowEii
    00000000007c6360 g DF .text 000000000000001c Base
    _ZN6impala23SnappyBlockDecompressorC1EPNS_7MemPoolEb
    00000000007c6360 g DF .text 000000000000001c Base
    _ZN6impala23SnappyBlockDecompressorC2EPNS_7MemPoolEb
    0000000000808810 g DF .text 000000000000002c Base
    _ZN6impala8RawValue5WriteEPKvPNS_5TupleEPKNS_14SlotDescriptorEPNS_7MemPoolE
    00000000007bf300 g DF .text 000000000000001c Base
    _ZN6impala21SnappyBlockCompressorC1EPNS_7MemPoolEb
    0000000000936650 w DF .text 0000000000000615 Base
    _ZN6impala15HdfsAvroScanner13ReadPrimitiveERKNS0_13SchemaElementERKNS_14SlotDescriptorEPNS_7MemPoolEPPhPiPNS_5TupleE
    00000000007bf300 g DF .text 000000000000001c Base
    _ZN6impala21SnappyBlockCompressorC2EPNS_7MemPoolEb
    00000000007c5020 g DF .text 00000000000001c7 Base
    _ZN6impala5Codec16CreateCompressorEPNS_12RuntimeStateEPNS_7MemPoolEbNS_16THdfsCompression4typeEPN5boost10scoped_ptrIS0_EE
    00000000007ff2d0 g DF .text 000000000000076b Base
    _ZN6impala7MemPool11DebugStringEv
    0000000001af1268 g DO .data 0000000000000008 Base
    _ZN6impala7MemPool15LLVM_CLASS_NAMEE
    0000000000935260 g DF .text 0000000000000496 Base
    _ZN6impala15HdfsAvroScanner14DecodeAvroDataEiPlPNS_7MemPoolEPPhPiPNS_5TupleEPNS_8TupleRowE
    00000000007fef10 g DF .text 0000000000000062 Base
    _ZN6impala7MemPool9ChunkInfoC1Ei
    0000000000800ae0 w DF .text 00000000000003f5 Base
    _ZNSt6vectorIN6impala7MemPool9ChunkInfoESaIS2_EE15_M_range_insertIN9__gnu_cxx17__normal_iteratorIPS2_S4_EEEEvS9_T_SA_St20forward_iterator_tag
    00000000007c75d0 g DF .text 0000000000000116 Base
    _ZN6impala16GzipDecompressorC2EPNS_7MemPoolEbb
    0000000001361868 g DO .rodata 0000000000000004 Base
    _ZN6impala7MemPool26DEFAULT_INITIAL_CHUNK_SIZEE
    00000000007fef10 g DF .text 0000000000000062 Base
    _ZN6impala7MemPool9ChunkInfoC2Ei
    0000000000943a20 w DF .text 000000000000059e Base
    _ZN6impala18HdfsParquetScanner12ColumnReader9ReadValueEPNS_7MemPoolEPNS_5TupleE
    00000000007bf2e0 g DF .text 000000000000001c Base
    _ZN6impala16SnappyCompressorC1EPNS_7MemPoolEb
    000000000096d8e0 g DF .text 000000000000010a Base
    _ZN6impala19IntegerArrayBuilderC2EiiPNS_7MemPoolE
    000000000080faf0 g DF .text 00000000000000e1 Base
    _ZN6impala5Tuple8DeepCopyERKNS_15TupleDescriptorEPNS_7MemPoolEb
    00000000007bf2e0 g DF .text 000000000000001c Base
    _ZN6impala16SnappyCompressorC2EPNS_7MemPoolEb
    00000000007c34d0 g DF .text 0000000000000865 Base
    _ZN6impala5Codec18CreateDecompressorEPNS_12RuntimeStateEPNS_7MemPoolEbNS_16THdfsCompression4typeEPPS0_
    00000000007fec70 g DF .text 0000000000000087 Base
    _ZN6impala7MemPool15GetOffsetHelperEPh
    00000000007c6380 g DF .text 000000000000001c Base
    _ZN6impala18SnappyDecompressorC1EPNS_7MemPoolEb
    00000000007fed00 g DF .text 0000000000000081 Base
    _ZN6impala7MemPool16GetDataPtrHelperEi
    00000000007c6380 g DF .text 000000000000001c Base
    _ZN6impala18SnappyDecompressorC2EPNS_7MemPoolEb
    00000000007c4760 g DF .text 00000000000008bd Base
    _ZN6impala5Codec16CreateCompressorEPNS_12RuntimeStateEPNS_7MemPoolEbNS_16THdfsCompression4typeEPPS0_
    00000000007c51f0 g DF .text 000000000000084a Base
    _ZN6impala5Codec16CreateCompressorEPNS_12RuntimeStateEPNS_7MemPoolEbRKSsPN5boost10scoped_ptrIS0_EE
    0000000000967640 g DF .text 0000000000000132 Base
    _ZN6impala11HdfsScanner18WriteCompleteTupleEPNS_7MemPoolEPNS_13FieldLocationEPNS_5TupleEPNS_8TupleRowES6_PhS9_
    00000000007ffd50 g DF .text 00000000000007d3 Base
    _ZN6impala7MemPool10DebugPrintEv
    00000000007febc0 g DF .text 000000000000005d Base
    _ZN6impala7MemPool8ContainsEPhi
    0000000000735420 w DF .text 0000000000000022 Base
    _ZN5boost10scoped_ptrIN6impala7MemPoolEED1Ev
    00000000007ff080 g DF .text 000000000000024e Base
    _ZN6impala7MemPool11AcquireDataEPS0_b
    00000000007c3f10 g DF .text 000000000000084a Base
    _ZN6impala5Codec18CreateDecompressorEPNS_12RuntimeStateEPNS_7MemPoolEbRKSsPN5boost10scoped_ptrIS0_EE
    0000000000800730 w DF .text 000000000000026f Base
    _ZNSt6vectorIN6impala7MemPool9ChunkInfoESaIS2_EE13_M_insert_auxEN9__gnu_cxx17__normal_iteratorIPS2_S4_EERKS2_
    00000000007bfd60 g DF .text 0000000000000116 Base
    _ZN6impala14GzipCompressorC2ENS0_6FormatEPNS_7MemPoolEb

    On Mon, Jun 10, 2013 at 2:26 PM, Nong Li wrote:

    What OS are you running?

    Can you also do "nm <path to impalad> | grep MemPool" and send that
    output file?

    On Mon, Jun 10, 2013 at 1:37 PM, Robin Li wrote:

    Hi All,

    I'm trying to test different file formats' performance working with
    Impala and stucked on getting it work by using LZO compressed text files.

    I've already installed LZO on all nodes, loaded and indexed the data in
    Hive. And hit this error:

    *Query: select count(*) from actions_lzo*
    *Query aborted, unable to fetch data*
    *
    *
    *Backend 0:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei
    *
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*
    *Backend 1:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei
    *
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*
    *Backend 2:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei
    *
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*
    *Backend 3:Unable to load libimpalalzo.so dlerror:
    /opt/cloudera/parcels/HADOOP_LZO-0.4.15-1.gplextras.p0.6/
    lib/impala/lib/libimpalalzo.so: undefined symbol: _ZN6impala7MemPoolC1Ei
    *
    *Unable to load libimpalalzo.so dlerror: /opt/cloudera/parcels/HADOOP_
    LZO-0.4.15-1.gplextras.p0.6/lib/impala/lib/libimpalalzo.so: undefined
    symbol: _ZN6impala7MemPoolC1Ei*

    Parcel Versions:
    CM 4.6
    IMP 1.0.1
    Hadoop_LZO 0.4.15
    CDH 4.3.0

    Any thought on how it could be resolved?

    thanks
    R

    --
    Robin


    --
    Robin

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupimpala-user @
categorieshadoop
postedJun 10, '13 at 8:37p
activeJun 11, '13 at 12:13a
posts4
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Robin Li: 3 posts Nong Li: 1 post

People

Translate

site design / logo © 2022 Grokbase