Grokbase › Groups › Hadoop › impala-user › January 2013
FAQ
Hi,

We are trying to install IMPALA on a single node.
Please find below the steps :
1) Installed Cloudera Manager (Free edition)
2) Installed CDH4.1.2
3) Installed Hive Seperately
4) Installed MySQL (Created user for IMPALA,Ran hive-schema-0.9.0.mysql.sql)
5) Configured XML's in HIVE as well as in Impala config folder .Please find
attached configuration files.

While starting impala service we are getting following error :

Service did not start successfully; not all of the required roles started:
The state store is not running.

Child Commands
Command Context Started at Status
Start this Impala StateStore Daemon statestore (cldx-1080-975) Role Log
File Jan 28, 2013 7:47:47 PM IST Finished , Jan 28, 2013 7:48:04 PM
IST

Supervisor returned FATAL: +
HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hbase-conf
+
FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
+ perl -pi -e
's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-STATESTORE#g'
/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
+ '[' impalad = statestore ']'
+ '[' statestore = statestore ']'
+ exec statestored
--flagfile=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
/usr/lib/impala/sbin/statestored: error while loading shared libraries:
libjvm.so: cannot open shared object file: No such file or directory
+ date
+ date
Mon Jan 28 19:48:03 IST 2013
+ export
IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf
+
IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf
+ export
HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hadoop-conf
+
HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hadoop-conf
+ export
HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hive-conf
+
HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hive-conf
+ export
HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hbase-conf
+
HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hbase-conf
+
FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
+ perl -pi -e
's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-STATESTORE#g'
/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
+ '[' impalad = statestore ']'
+ '[' statestore = statestore ']'
+ exec statestored
--flagfile=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
/usr/lib/impala/sbin/statestored: error while loading shared libraries:
libjvm.so: cannot open shared object file: No such file or directory

Start this Impala Daemon impalad (cldx-1080-975) Role Log File Jan
28, 2013 7:47:47 PM IST Finished , Jan 28, 2013 7:48:04 PM IST

Supervisor returned FATAL: + CHECK_SHORT_CIRCUIT_READS=true
+ DN_DATA_DIR=/dfs/dn
+ [[ true = \t\r\u\e ]]
+ [[ -e /dfs/dn ]]
+ echo 'Testing readability of DataNode data dirs for short circuit reads'
+ '[' -r /dfs/dn ']'
+ echo 'Valid setup: /dfs/dn is accesible for short circuit reads'
+ exec impalad
--flagfile=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
/usr/lib/impala/sbin/impalad: error while loading shared libraries:
libjsig.so: cannot open shared object file: No such file or directory
+ date
+ date
Mon Jan 28 19:48:03 IST 2013
+ export
IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf
+
IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf
+ export
HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hadoop-conf
+
HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hadoop-conf
+ export
HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hive-conf
+
HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hive-conf
+ export
HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hbase-conf
+
HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hbase-conf
+
FLAG_FILE=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
+ perl -pi -e
's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/79-impala-IMPALAD#g'
/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
+ '[' impalad = impalad ']'
+ CHECK_SHORT_CIRCUIT_READS=true
+ DN_DATA_DIR=/dfs/dn
+ [[ true = \t\r\u\e ]]
+ [[ -e /dfs/dn ]]
+ echo 'Testing readability of DataNode data dirs for short circuit reads'
+ '[' -r /dfs/dn ']'
+ echo 'Valid setup: /dfs/dn is accesible for short circuit reads'
+ exec impalad
--flagfile=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
/usr/lib/impala/sbin/impalad: error while loading shared libraries:
libjsig.so: cannot open shared object file: No such file or directory



Kindly Help us,

Best Regards,
Radhakrishnan

--

Search Discussions

  • Radhakrishnan Natrajan at Jan 30, 2013 at 6:46 am ⇧
    Hi Vikas,

    Thanks a lot!!! The issue was resolved after setting LD_LIBRARY_PATH in
    "Environment Variable Safety Valve" in CM UI.

    Best Regards,
    Radhakrishnan
    On Monday, 28 January 2013 23:47:46 UTC+5:30, vikas wrote:

    These libraries are part of JDK, so something is wrong either the way they
    get installed or with the LD_LIBRARY_PATH.

    Which Linux distro are you using? Try finding libjvm.so on your system and
    see something obvious is wrong there. If needed you can specify custom
    LD_LIBRARY_PATH in "Environment Variable Safety Valve" in CM UI. Impala
    does add couple of directories to the path (from /etc/default/impala:
    "export
    LD_LIBRARY_PATH=${LD_LIBRARY_PATH:-${IMPALA_HOME}/lib:${IMPALA_BIN}}"), so
    keep these directories in mind if you experiment with custom path.

    Vikas


    On Mon, Jan 28, 2013 at 1:06 AM, Radhakrishnan Natrajan <
    radhakrishn...@gmail.com <javascript:>> wrote:
    Hi,

    We are trying to install IMPALA on a single node.
    Please find below the steps :
    1) Installed Cloudera Manager (Free edition)
    2) Installed CDH4.1.2
    3) Installed Hive Seperately
    4) Installed MySQL (Created user for IMPALA,Ran
    hive-schema-0.9.0.mysql.sql)
    5) Configured XML's in HIVE as well as in Impala config folder .Please
    find attached configuration files.

    While starting impala service we are getting following error :

    Service did not start successfully; not all of the required roles
    started:
    The state store is not running.

    Child Commands
    Command Context Started at Status
    Start this Impala StateStore Daemon statestore (cldx-1080-975) Role
    Log File Jan 28, 2013 7:47:47 PM IST Finished , Jan 28, 2013
    7:48:04 PM IST

    Supervisor returned FATAL: +
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hbase-conf
    +
    FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    + perl -pi -e
    's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-STATESTORE#g'
    /var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    + '[' impalad = statestore ']'
    + '[' statestore = statestore ']'
    + exec statestored
    --flagfile=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    /usr/lib/impala/sbin/statestored: error while loading shared libraries:
    libjvm.so: cannot open shared object file: No such file or directory
    + date
    + date
    Mon Jan 28 19:48:03 IST 2013
    + export
    IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf
    +
    IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf
    + export
    HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hadoop-conf
    +
    HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hadoop-conf
    + export
    HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hive-conf
    +
    HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hive-conf
    + export
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hbase-conf
    +
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hbase-conf
    +
    FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    + perl -pi -e
    's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-STATESTORE#g'
    /var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    + '[' impalad = statestore ']'
    + '[' statestore = statestore ']'
    + exec statestored
    --flagfile=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    /usr/lib/impala/sbin/statestored: error while loading shared libraries:
    libjvm.so: cannot open shared object file: No such file or directory

    Start this Impala Daemon impalad (cldx-1080-975) Role Log File
    Jan 28, 2013 7:47:47 PM IST Finished , Jan 28, 2013 7:48:04 PM IST

    Supervisor returned FATAL: + CHECK_SHORT_CIRCUIT_READS=true
    + DN_DATA_DIR=/dfs/dn
    + [[ true = \t\r\u\e ]]
    + [[ -e /dfs/dn ]]
    + echo 'Testing readability of DataNode data dirs for short circuit reads'
    + '[' -r /dfs/dn ']'
    + echo 'Valid setup: /dfs/dn is accesible for short circuit reads'
    + exec impalad
    --flagfile=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
    /usr/lib/impala/sbin/impalad: error while loading shared libraries:
    libjsig.so: cannot open shared object file: No such file or directory
    + date
    + date
    Mon Jan 28 19:48:03 IST 2013
    + export
    IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf
    +
    IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf
    + export
    HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hadoop-conf
    +
    HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hadoop-conf
    + export
    HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hive-conf
    +
    HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hive-conf
    + export
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hbase-conf
    +
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hbase-conf
    +
    FLAG_FILE=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
    + perl -pi -e
    's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/79-impala-IMPALAD#g'
    /var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
    + '[' impalad = impalad ']'
    + CHECK_SHORT_CIRCUIT_READS=true
    + DN_DATA_DIR=/dfs/dn
    + [[ true = \t\r\u\e ]]
    + [[ -e /dfs/dn ]]
    + echo 'Testing readability of DataNode data dirs for short circuit reads'
    + '[' -r /dfs/dn ']'
    + echo 'Valid setup: /dfs/dn is accesible for short circuit reads'
    + exec impalad
    --flagfile=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
    /usr/lib/impala/sbin/impalad: error while loading shared libraries:
    libjsig.so: cannot open shared object file: No such file or directory



    Kindly Help us,

    Best Regards,
    Radhakrishnan

    --

  • Pari Margu at Dec 27, 2013 at 2:09 pm ⇧
    Facing similar issue, what entry you have added?? like LD_LIBRARY_PATH=??
    in environment variable safety value.



    On Wednesday, January 30, 2013 12:15:56 PM UTC+5:30, Radhakrishnan Natrajan
    wrote:
    Hi Vikas,

    Thanks a lot!!! The issue was resolved after setting LD_LIBRARY_PATH in
    "Environment Variable Safety Valve" in CM UI.

    Best Regards,
    Radhakrishnan
    On Monday, 28 January 2013 23:47:46 UTC+5:30, vikas wrote:

    These libraries are part of JDK, so something is wrong either the way
    they get installed or with the LD_LIBRARY_PATH.

    Which Linux distro are you using? Try finding libjvm.so on your system
    and see something obvious is wrong there. If needed you can specify custom
    LD_LIBRARY_PATH in "Environment Variable Safety Valve" in CM UI. Impala
    does add couple of directories to the path (from /etc/default/impala:
    "export
    LD_LIBRARY_PATH=${LD_LIBRARY_PATH:-${IMPALA_HOME}/lib:${IMPALA_BIN}}"), so
    keep these directories in mind if you experiment with custom path.

    Vikas


    On Mon, Jan 28, 2013 at 1:06 AM, Radhakrishnan Natrajan <
    radhakrishn...@gmail.com> wrote:
    Hi,

    We are trying to install IMPALA on a single node.
    Please find below the steps :
    1) Installed Cloudera Manager (Free edition)
    2) Installed CDH4.1.2
    3) Installed Hive Seperately
    4) Installed MySQL (Created user for IMPALA,Ran
    hive-schema-0.9.0.mysql.sql)
    5) Configured XML's in HIVE as well as in Impala config folder .Please
    find attached configuration files.

    While starting impala service we are getting following error :

    Service did not start successfully; not all of the required roles
    started:
    The state store is not running.

    Child Commands
    Command Context Started at Status
    Start this Impala StateStore Daemon statestore (cldx-1080-975) Role
    Log File Jan 28, 2013 7:47:47 PM IST Finished , Jan 28, 2013
    7:48:04 PM IST

    Supervisor returned FATAL: +
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hbase-conf
    +
    FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    + perl -pi -e
    's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-STATESTORE#g'
    /var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    + '[' impalad = statestore ']'
    + '[' statestore = statestore ']'
    + exec statestored
    --flagfile=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    /usr/lib/impala/sbin/statestored: error while loading shared libraries:
    libjvm.so: cannot open shared object file: No such file or directory
    + date
    + date
    Mon Jan 28 19:48:03 IST 2013
    + export
    IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf
    +
    IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf
    + export
    HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hadoop-conf
    +
    HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hadoop-conf
    + export
    HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hive-conf
    +
    HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hive-conf
    + export
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hbase-conf
    +
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/hbase-conf
    +
    FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    + perl -pi -e
    's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-STATESTORE#g'
    /var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    + '[' impalad = statestore ']'
    + '[' statestore = statestore ']'
    + exec statestored
    --flagfile=/var/run/cloudera-scm-agent/process/80-impala-STATESTORE/impala-conf/state_store_flags
    /usr/lib/impala/sbin/statestored: error while loading shared libraries:
    libjvm.so: cannot open shared object file: No such file or directory

    Start this Impala Daemon impalad (cldx-1080-975) Role Log File
    Jan 28, 2013 7:47:47 PM IST Finished , Jan 28, 2013 7:48:04 PM IST

    Supervisor returned FATAL: + CHECK_SHORT_CIRCUIT_READS=true
    + DN_DATA_DIR=/dfs/dn
    + [[ true = \t\r\u\e ]]
    + [[ -e /dfs/dn ]]
    + echo 'Testing readability of DataNode data dirs for short circuit
    reads'
    + '[' -r /dfs/dn ']'
    + echo 'Valid setup: /dfs/dn is accesible for short circuit reads'
    + exec impalad
    --flagfile=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
    /usr/lib/impala/sbin/impalad: error while loading shared libraries:
    libjsig.so: cannot open shared object file: No such file or directory
    + date
    + date
    Mon Jan 28 19:48:03 IST 2013
    + export
    IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf
    +
    IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf
    + export
    HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hadoop-conf
    +
    HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hadoop-conf
    + export
    HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hive-conf
    +
    HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hive-conf
    + export
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hbase-conf
    +
    HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/hbase-conf
    +
    FLAG_FILE=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
    + perl -pi -e
    's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/79-impala-IMPALAD#g'
    /var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
    + '[' impalad = impalad ']'
    + CHECK_SHORT_CIRCUIT_READS=true
    + DN_DATA_DIR=/dfs/dn
    + [[ true = \t\r\u\e ]]
    + [[ -e /dfs/dn ]]
    + echo 'Testing readability of DataNode data dirs for short circuit
    reads'
    + '[' -r /dfs/dn ']'
    + echo 'Valid setup: /dfs/dn is accesible for short circuit reads'
    + exec impalad
    --flagfile=/var/run/cloudera-scm-agent/process/79-impala-IMPALAD/impala-conf/impalad_flags
    /usr/lib/impala/sbin/impalad: error while loading shared libraries:
    libjsig.so: cannot open shared object file: No such file or directory



    Kindly Help us,

    Best Regards,
    Radhakrishnan

    --

    To unsubscribe from this group and stop receiving emails from it, send an email to impala-user+unsubscribe@cloudera.org.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupimpala-user @
categorieshadoop
postedJan 28, '13 at 9:06a
activeDec 27, '13 at 2:09p
posts3
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Radhakrishnan Natrajan: 2 posts Pari Margu: 1 post

Content

People

Support

Translate

site design / logo © 2022 Grokbase