FAQ
Hi, Gugs:

     I use CM free edition to add service. but there is not all service
available.

From Cloudera Manage Admin Console:

*hosts-> [select a host] -> components:*

*Component*

Cloudera Manager Agent

Cloudera Manager Management Daemons

Hadoop

HBase

HDFS (CDH4 only)

Hive

HttpFS (CDH4 only)

Hue

Hue Plugins

MapReduce 1 (CDH4 only)

MapReduce 2 (CDH4 only)

Oozie

Yarn (CDH4 only)

Zookeeper


When add service:
*services -> add a service,* *there is not all service available*.

*Service Type*

  HDFS

  MapReduce

  YARN

  ZooKeeper

  HBase

  Oozie

  Hue

Search Discussions

  • 杨荣权 at Aug 8, 2012 at 5:54 am
    for example, I want install *Hive, but I don't know how.*


    在 2012年8月8日星期三UTC+8下午1时51分17秒,杨荣权写道:
    Hi, Gugs:

    I use CM free edition to add service. but there is not all service
    available.

    From Cloudera Manage Admin Console:

    *hosts-> [select a host] -> components:*

    *Component*

    Cloudera Manager Agent

    Cloudera Manager Management Daemons

    Hadoop

    HBase

    HDFS (CDH4 only)

    Hive

    HttpFS (CDH4 only)

    Hue

    Hue Plugins

    MapReduce 1 (CDH4 only)

    MapReduce 2 (CDH4 only)

    Oozie

    Yarn (CDH4 only)

    Zookeeper


    When add service:
    *services -> add a service,* *there is not all service available*.

    *Service Type*

    HDFS

    MapReduce

    YARN

    ZooKeeper

    HBase

    Oozie

    Hue

  • bc Wong at Aug 8, 2012 at 6:10 am

    On Tue, Aug 7, 2012 at 10:54 PM, 杨荣权 wrote:

    for example, I want install *Hive, but I don't know how.*
    Hive (in the simplest form) is a client side program.

    You can try "yum install hive". You'll have to setup the metastore. But
    otherwise, there is no "Hive service" for CM to manage, if you just want to
    use Hive. Do deploy the client config, so the `hive' program knows about
    your Hadoop cluster.

    Cheers,
    bc


    在 2012年8月8日星期三UTC+8下午1时51分17秒,杨荣权写道:
    Hi, Gugs:

    I use CM free edition to add service. but there is not all service
    available.

    From Cloudera Manage Admin Console:

    *hosts-> [select a host] -> components:*

    *Component*

    Cloudera Manager Agent

    Cloudera Manager Management Daemons

    Hadoop

    HBase

    HDFS (CDH4 only)

    Hive

    HttpFS (CDH4 only)

    Hue

    Hue Plugins

    MapReduce 1 (CDH4 only)

    MapReduce 2 (CDH4 only)

    Oozie

    Yarn (CDH4 only)

    Zookeeper


    When add service:
    *services -> add a service,* *there is not all service available*.

    *Service Type*

    HDFS

    MapReduce

    YARN

    ZooKeeper

    HBase

    Oozie

    Hue

  • 杨荣权 at Aug 8, 2012 at 9:39 am
    I use Debian 6.

    this is my step:
    1. hive install package
    because the hive component is install from CM, and I can find run *hive *in
    shell.
    so pass this step

    2. create mysql database to store metastore

    3. create a hive-site.xml
    <property>
       <name>hive.exec.scratchdir</name>
       <value>/home/yangrq/hadoop/tmp/hive-${user.name}</value>
       <description>Scratch space for Hive jobs</description>
    </property>

    <property>
       <name>javax.jdo.option.ConnectionURL</name>

    <value>jdbc:mysql://192.168.0.100:3306/test_hivedb?createDatabaseIfNotExist=true</value>
       <description>JDBC connect string for a JDBC metastore</description>
    </property>

    <property>
       <name>javax.jdo.option.ConnectionDriverName</name>
       <value>com.mysql.jdbc.Driver</value>
       <description>Driver class name for a JDBC metastore</description>
    </property>

    <property>
       <name>javax.jdo.option.ConnectionUserName</name>
       <value>hiveuser</value>
       <description>username to use against metastore database</description>
    </property>

    <property>
       <name>javax.jdo.option.ConnectionPassword</name>
       <value>hiveuser</value>
       <description>password to use against metastore database</description>
    </property>

    4. cp hive-site.xml to /etc/hive/conf/hive-site.xml

    5. get JAVA mysql connector: mysql-connector-java-5.1.12.jar from mysql.com

    6. cp mysql-connector-java-5.1.12.jar to /usr/lib/hive/lib

    I can use hive now.

    *My Question:*
    from the upper step, it is some complicated.
    Is there any simple solution?
    *How about this solution (does not need sudo privilege):*
       1. download a hive tarball with the same version from apache.org
       2. untar the package
       3. copy the hive-site.xml and mysql-connector-java-5.1.12.jar into it.


    在 2012年8月8日星期三UTC+8下午2时10分15秒,bc Wong写道:
    On Tue, Aug 7, 2012 at 10:54 PM, 杨荣权 <[email protected] <javascript:>>wrote:
    for example, I want install *Hive, but I don't know how.*
    Hive (in the simplest form) is a client side program.

    You can try "yum install hive". You'll have to setup the metastore. But
    otherwise, there is no "Hive service" for CM to manage, if you just want to
    use Hive. Do deploy the client config, so the `hive' program knows about
    your Hadoop cluster.

    Cheers,
    bc


    在 2012年8月8日星期三UTC+8下午1时51分17秒,杨荣权写道:
    Hi, Gugs:

    I use CM free edition to add service. but there is not all service
    available.

    From Cloudera Manage Admin Console:

    *hosts-> [select a host] -> components:*

    *Component*

    Cloudera Manager Agent

    Cloudera Manager Management Daemons

    Hadoop

    HBase

    HDFS (CDH4 only)

    Hive

    HttpFS (CDH4 only)

    Hue

    Hue Plugins

    MapReduce 1 (CDH4 only)

    MapReduce 2 (CDH4 only)

    Oozie

    Yarn (CDH4 only)

    Zookeeper


    When add service:
    *services -> add a service,* *there is not all service available*.

    *Service Type*

    HDFS

    MapReduce

    YARN

    ZooKeeper

    HBase

    Oozie

    Hue

  • bc Wong at Aug 8, 2012 at 3:32 pm

    On Wed, Aug 8, 2012 at 2:39 AM, 杨荣权 wrote:

    I use Debian 6.

    this is my step:
    1. hive install package
    because the hive component is install from CM, and I can find run *hive *in
    shell.
    so pass this step

    2. create mysql database to store metastore

    3. create a hive-site.xml
    <property>
    <name>hive.exec.scratchdir</name>
    <value>/home/yangrq/hadoop/tmp/hive-${user.name}</value>
    <description>Scratch space for Hive jobs</description>
    </property>

    <property>
    <name>javax.jdo.option.ConnectionURL</name>
    <value>jdbc:mysql://
    192.168.0.100:3306/test_hivedb?createDatabaseIfNotExist=true</value>
    <description>JDBC connect string for a JDBC metastore</description>
    </property>

    <property>
    <name>javax.jdo.option.ConnectionDriverName</name>
    <value>com.mysql.jdbc.Driver</value>
    <description>Driver class name for a JDBC metastore</description>
    </property>

    <property>
    <name>javax.jdo.option.ConnectionUserName</name>
    <value>hiveuser</value>
    <description>username to use against metastore database</description>
    </property>

    <property>
    <name>javax.jdo.option.ConnectionPassword</name>
    <value>hiveuser</value>
    <description>password to use against metastore database</description>
    </property>

    4. cp hive-site.xml to /etc/hive/conf/hive-site.xml

    5. get JAVA mysql connector: mysql-connector-java-5.1.12.jar from
    mysql.com

    6. cp mysql-connector-java-5.1.12.jar to /usr/lib/hive/lib

    I can use hive now.

    *My Question:*
    from the upper step, it is some complicated.
    Is there any simple solution?
    **
    Not really. (At least not yet.)

    *How about this solution (does not need sudo privilege):*
    1. download a hive tarball with the same version from apache.org
    2. untar the package
    3. copy the hive-site.xml and mysql-connector-java-5.1.12.jar into it.
    That'll also give you hive. But looks like the same amount of work. Your
    step 3 is the same as the original 3, 4, 5, 6. (That it's written in one
    sentence doesn't mean it's faster.)

    Cheers,
    bc

    在 2012年8月8日星期三UTC+8下午2时10分15秒,bc Wong写道:
    On Tue, Aug 7, 2012 at 10:54 PM, 杨荣权 wrote:

    for example, I want install *Hive, but I don't know how.*
    Hive (in the simplest form) is a client side program.

    You can try "yum install hive". You'll have to setup the metastore. But
    otherwise, there is no "Hive service" for CM to manage, if you just want to
    use Hive. Do deploy the client config, so the `hive' program knows about
    your Hadoop cluster.

    Cheers,
    bc


    在 2012年8月8日星期三UTC+8下午1时51分17秒,**杨荣权写道:
    Hi, Gugs:

    I use CM free edition to add service. but there is not all service
    available.

    From Cloudera Manage Admin Console:

    *hosts-> [select a host] -> components:*

    *Component*

    Cloudera Manager Agent

    Cloudera Manager Management Daemons

    Hadoop

    HBase

    HDFS (CDH4 only)

    Hive

    HttpFS (CDH4 only)

    Hue

    Hue Plugins

    MapReduce 1 (CDH4 only)

    MapReduce 2 (CDH4 only)

    Oozie

    Yarn (CDH4 only)

    Zookeeper


    When add service:
    *services -> add a service,* *there is not all service available*.

    *Service Type*

    HDFS

    MapReduce

    YARN

    ZooKeeper

    HBase

    Oozie

    Hue

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedAug 8, '12 at 5:51a
activeAug 8, '12 at 3:32p
posts5
users2
websitecloudera.com
irc#hadoop

2 users in discussion

杨荣权: 3 posts bc Wong: 2 posts

People

Translate

site design / logo © 2023 Grokbase