FAQ
Hi All,

I use CM4.0/CDH 4.0.3. I have a hive server running in my cluster.

I need to install thrift hive client on the separate machine outside hadoop
cluser.

Do you guys have install steps for that please?

Thanks

Search Discussions

  • Mike at Sep 27, 2012 at 8:39 pm
    Could you please respond?
    On Thursday, September 27, 2012 11:35:43 AM UTC-4, Mike wrote:

    Hi All,

    I use CM4.0/CDH 4.0.3. I have a hive server running in my cluster.

    I need to install thrift hive client on the separate machine outside
    hadoop cluser.

    Do you guys have install steps for that please?

    Thanks
  • Mike at Oct 1, 2012 at 6:16 pm
    Could you please respond?

    Thanks
    On Thursday, September 27, 2012 4:39:36 PM UTC-4, Mike wrote:

    Could you please respond?
    On Thursday, September 27, 2012 11:35:43 AM UTC-4, Mike wrote:

    Hi All,

    I use CM4.0/CDH 4.0.3. I have a hive server running in my cluster.

    I need to install thrift hive client on the separate machine outside
    hadoop cluser.

    Do you guys have install steps for that please?

    Thanks
  • Adam Smieszny at Oct 1, 2012 at 6:51 pm
    Hi Mike,

    I believe the steps to enable this are as follows (note I have not done
    this myself, but this is my educated guess based on some research).

    1. Install "Hive" RPM/deb on external box
    2. Configure Hive-site.xml
    3. Start hive thrift server with 'hive --service hiveserver'

    A blog post that you might find relevant is available here:
    http://blog.milford.io/2010/06/daemonizing-the-apache-hive-thrift-server-on-centos/

    Cheers,
    Adam
    On Mon, Oct 1, 2012 at 2:16 PM, Mike wrote:

    Could you please respond?

    Thanks

    On Thursday, September 27, 2012 4:39:36 PM UTC-4, Mike wrote:

    Could you please respond?
    On Thursday, September 27, 2012 11:35:43 AM UTC-4, Mike wrote:

    Hi All,

    I use CM4.0/CDH 4.0.3. I have a hive server running in my cluster.

    I need to install thrift hive client on the separate machine outside
    hadoop cluser.

    Do you guys have install steps for that please?

    Thanks

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny
  • Mike at Oct 1, 2012 at 7:27 pm
    Thanks Adam.

    Currently, after getting into hive, I add the jar files manually as below
    hive> add jar /usr/lib/hive/lib/hbase.jar;
    hive> add jar /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    hive> add jar /usr/lib/hive/lib/zookeeper.jar;
    hive> add jar /usr/lib/hive/lib/guava-r09.jar;

    How do I set the jar files for "hive --service hiveserver"?

    select * from tablename works fine without the jar files.

    select key from tablename fails without the jar files.

    Thanks
    On Monday, October 1, 2012 2:51:07 PM UTC-4, Adam Smieszny wrote:

    Hi Mike,

    I believe the steps to enable this are as follows (note I have not done
    this myself, but this is my educated guess based on some research).

    1. Install "Hive" RPM/deb on external box
    2. Configure Hive-site.xml
    3. Start hive thrift server with 'hive --service hiveserver'

    A blog post that you might find relevant is available here:
    http://blog.milford.io/2010/06/daemonizing-the-apache-hive-thrift-server-on-centos/

    Cheers,
    Adam

    On Mon, Oct 1, 2012 at 2:16 PM, Mike <mike...@gmail.com <javascript:>>wrote:
    Could you please respond?

    Thanks

    On Thursday, September 27, 2012 4:39:36 PM UTC-4, Mike wrote:

    Could you please respond?
    On Thursday, September 27, 2012 11:35:43 AM UTC-4, Mike wrote:

    Hi All,

    I use CM4.0/CDH 4.0.3. I have a hive server running in my cluster.

    I need to install thrift hive client on the separate machine outside
    hadoop cluser.

    Do you guys have install steps for that please?

    Thanks

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny
  • Joey Echeverria at Oct 1, 2012 at 7:26 pm
    You need to create a .hiverc file for the user running the hive
    server. You can place your add statements in there.

    -Joey
    On Mon, Oct 1, 2012 at 3:21 PM, Mike wrote:
    Thanks Adam.

    Currently, after getting into hive, I add the jar files manually as below
    hive> add jar /usr/lib/hive/lib/hbase.jar;
    hive> add jar /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    hive> add jar /usr/lib/hive/lib/zookeeper.jar;
    hive> add jar /usr/lib/hive/lib/guava-r09.jar;

    How do I set the jar files for "hive --service hiveserver"?

    select * from tablename works fine without the jar files.

    select key from tablename fails without the jar files.

    Thanks

    On Monday, October 1, 2012 2:51:07 PM UTC-4, Adam Smieszny wrote:

    Hi Mike,

    I believe the steps to enable this are as follows (note I have not done
    this myself, but this is my educated guess based on some research).

    1. Install "Hive" RPM/deb on external box
    2. Configure Hive-site.xml
    3. Start hive thrift server with 'hive --service hiveserver'

    A blog post that you might find relevant is available here:
    http://blog.milford.io/2010/06/daemonizing-the-apache-hive-thrift-server-on-centos/

    Cheers,
    Adam

    On Mon, Oct 1, 2012 at 2:16 PM, Mike wrote:

    Could you please respond?

    Thanks

    On Thursday, September 27, 2012 4:39:36 PM UTC-4, Mike wrote:

    Could you please respond?
    On Thursday, September 27, 2012 11:35:43 AM UTC-4, Mike wrote:

    Hi All,

    I use CM4.0/CDH 4.0.3. I have a hive server running in my cluster.

    I need to install thrift hive client on the separate machine outside
    hadoop cluser.

    Do you guys have install steps for that please?

    Thanks



    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny


    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.
  • Mike at Oct 1, 2012 at 7:39 pm
    Thanks Joey.

    I am logged in as root. I create .hiverc file in /root directory and file
    looks like the below
    add jar /usr/lib/hive/lib/hbase.jar;
    add jar /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    add jar /usr/lib/hive/lib/zookeeper.jar;
    add jar /usr/lib/hive/lib/guava-r09.jar;

    I started
    hive --service hiveserver

    Ran my script it errors out. It is not picking up the .hiverc file.

    Am I missing something?

    Thanks
    On Monday, October 1, 2012 3:26:38 PM UTC-4, Joey Echeverria wrote:

    You need to create a .hiverc file for the user running the hive
    server. You can place your add statements in there.

    -Joey

    On Mon, Oct 1, 2012 at 3:21 PM, Mike <mike...@gmail.com <javascript:>>
    wrote:
    Thanks Adam.

    Currently, after getting into hive, I add the jar files manually as below
    hive> add jar /usr/lib/hive/lib/hbase.jar;
    hive> add jar /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    hive> add jar /usr/lib/hive/lib/zookeeper.jar;
    hive> add jar /usr/lib/hive/lib/guava-r09.jar;

    How do I set the jar files for "hive --service hiveserver"?

    select * from tablename works fine without the jar files.

    select key from tablename fails without the jar files.

    Thanks

    On Monday, October 1, 2012 2:51:07 PM UTC-4, Adam Smieszny wrote:

    Hi Mike,

    I believe the steps to enable this are as follows (note I have not done
    this myself, but this is my educated guess based on some research).

    1. Install "Hive" RPM/deb on external box
    2. Configure Hive-site.xml
    3. Start hive thrift server with 'hive --service hiveserver'

    A blog post that you might find relevant is available here:
    http://blog.milford.io/2010/06/daemonizing-the-apache-hive-thrift-server-on-centos/
    Cheers,
    Adam

    On Mon, Oct 1, 2012 at 2:16 PM, Mike wrote:

    Could you please respond?

    Thanks

    On Thursday, September 27, 2012 4:39:36 PM UTC-4, Mike wrote:

    Could you please respond?
    On Thursday, September 27, 2012 11:35:43 AM UTC-4, Mike wrote:

    Hi All,

    I use CM4.0/CDH 4.0.3. I have a hive server running in my cluster.

    I need to install thrift hive client on the separate machine outside
    hadoop cluser.

    Do you guys have install steps for that please?

    Thanks



    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny


    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.
  • Joey Echeverria at Oct 1, 2012 at 7:42 pm
    My mistake, I gave you bad information. What you really need to do is
    set hive.aux.jars.path in the hive-site.xml:

    <property>
    <name>hive.aux.jars.path</name>
    <value>file:///usr/lib/hive/lib/hbase.jar,file:///usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar,file:///usr/lib/hive/lib/zookeeper.jar,file:///usr/lib/hive/lib/guava-r09.jar</value>
    </property>

    -Joey
    On Mon, Oct 1, 2012 at 3:39 PM, Mike wrote:
    Thanks Joey.

    I am logged in as root. I create .hiverc file in /root directory and file
    looks like the below
    add jar /usr/lib/hive/lib/hbase.jar;
    add jar /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    add jar /usr/lib/hive/lib/zookeeper.jar;
    add jar /usr/lib/hive/lib/guava-r09.jar;

    I started
    hive --service hiveserver

    Ran my script it errors out. It is not picking up the .hiverc file.

    Am I missing something?

    Thanks

    On Monday, October 1, 2012 3:26:38 PM UTC-4, Joey Echeverria wrote:

    You need to create a .hiverc file for the user running the hive
    server. You can place your add statements in there.

    -Joey
    On Mon, Oct 1, 2012 at 3:21 PM, Mike wrote:
    Thanks Adam.

    Currently, after getting into hive, I add the jar files manually as
    below
    hive> add jar /usr/lib/hive/lib/hbase.jar;
    hive> add jar /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    hive> add jar /usr/lib/hive/lib/zookeeper.jar;
    hive> add jar /usr/lib/hive/lib/guava-r09.jar;

    How do I set the jar files for "hive --service hiveserver"?

    select * from tablename works fine without the jar files.

    select key from tablename fails without the jar files.

    Thanks

    On Monday, October 1, 2012 2:51:07 PM UTC-4, Adam Smieszny wrote:

    Hi Mike,

    I believe the steps to enable this are as follows (note I have not done
    this myself, but this is my educated guess based on some research).

    1. Install "Hive" RPM/deb on external box
    2. Configure Hive-site.xml
    3. Start hive thrift server with 'hive --service hiveserver'

    A blog post that you might find relevant is available here:

    http://blog.milford.io/2010/06/daemonizing-the-apache-hive-thrift-server-on-centos/

    Cheers,
    Adam

    On Mon, Oct 1, 2012 at 2:16 PM, Mike wrote:

    Could you please respond?

    Thanks

    On Thursday, September 27, 2012 4:39:36 PM UTC-4, Mike wrote:

    Could you please respond?
    On Thursday, September 27, 2012 11:35:43 AM UTC-4, Mike wrote:

    Hi All,

    I use CM4.0/CDH 4.0.3. I have a hive server running in my cluster.

    I need to install thrift hive client on the separate machine outside
    hadoop cluser.

    Do you guys have install steps for that please?

    Thanks



    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny


    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.


    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.
  • Bryan Peterson at Oct 2, 2012 at 3:02 pm
    As for the actual python thrift library, I'd
    suggest https://github.com/youngwookim/hive-thrift-py
    On Monday, October 1, 2012 3:42:51 PM UTC-4, Joey Echeverria wrote:

    My mistake, I gave you bad information. What you really need to do is
    set hive.aux.jars.path in the hive-site.xml:

    <property>
    <name>hive.aux.jars.path</name>

    <value>file:///usr/lib/hive/lib/hbase.jar,file:///usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar,file:///usr/lib/hive/lib/zookeeper.jar,file:///usr/lib/hive/lib/guava-r09.jar</value>

    </property>

    -Joey

    On Mon, Oct 1, 2012 at 3:39 PM, Mike <mike...@gmail.com <javascript:>>
    wrote:
    Thanks Joey.

    I am logged in as root. I create .hiverc file in /root directory and file
    looks like the below
    add jar /usr/lib/hive/lib/hbase.jar;
    add jar /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    add jar /usr/lib/hive/lib/zookeeper.jar;
    add jar /usr/lib/hive/lib/guava-r09.jar;

    I started
    hive --service hiveserver

    Ran my script it errors out. It is not picking up the .hiverc file.

    Am I missing something?

    Thanks

    On Monday, October 1, 2012 3:26:38 PM UTC-4, Joey Echeverria wrote:

    You need to create a .hiverc file for the user running the hive
    server. You can place your add statements in there.

    -Joey
    On Mon, Oct 1, 2012 at 3:21 PM, Mike wrote:
    Thanks Adam.

    Currently, after getting into hive, I add the jar files manually as
    below
    hive> add jar /usr/lib/hive/lib/hbase.jar;
    hive> add jar
    /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    hive> add jar /usr/lib/hive/lib/zookeeper.jar;
    hive> add jar /usr/lib/hive/lib/guava-r09.jar;

    How do I set the jar files for "hive --service hiveserver"?

    select * from tablename works fine without the jar files.

    select key from tablename fails without the jar files.

    Thanks

    On Monday, October 1, 2012 2:51:07 PM UTC-4, Adam Smieszny wrote:

    Hi Mike,

    I believe the steps to enable this are as follows (note I have not
    done
    this myself, but this is my educated guess based on some research).

    1. Install "Hive" RPM/deb on external box
    2. Configure Hive-site.xml
    3. Start hive thrift server with 'hive --service hiveserver'

    A blog post that you might find relevant is available here:
    http://blog.milford.io/2010/06/daemonizing-the-apache-hive-thrift-server-on-centos/
    Cheers,
    Adam

    On Mon, Oct 1, 2012 at 2:16 PM, Mike wrote:

    Could you please respond?

    Thanks

    On Thursday, September 27, 2012 4:39:36 PM UTC-4, Mike wrote:

    Could you please respond?
    On Thursday, September 27, 2012 11:35:43 AM UTC-4, Mike wrote:

    Hi All,

    I use CM4.0/CDH 4.0.3. I have a hive server running in my
    cluster.
    I need to install thrift hive client on the separate machine
    outside
    hadoop cluser.

    Do you guys have install steps for that please?

    Thanks



    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny


    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.


    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.
  • Mike at Oct 2, 2012 at 7:39 pm
    Thanks Joey. That worked fine.
    On Monday, October 1, 2012 3:42:51 PM UTC-4, Joey Echeverria wrote:

    My mistake, I gave you bad information. What you really need to do is
    set hive.aux.jars.path in the hive-site.xml:

    <property>
    <name>hive.aux.jars.path</name>

    <value>file:///usr/lib/hive/lib/hbase.jar,file:///usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar,file:///usr/lib/hive/lib/zookeeper.jar,file:///usr/lib/hive/lib/guava-r09.jar</value>

    </property>

    -Joey

    On Mon, Oct 1, 2012 at 3:39 PM, Mike <mike...@gmail.com <javascript:>>
    wrote:
    Thanks Joey.

    I am logged in as root. I create .hiverc file in /root directory and file
    looks like the below
    add jar /usr/lib/hive/lib/hbase.jar;
    add jar /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    add jar /usr/lib/hive/lib/zookeeper.jar;
    add jar /usr/lib/hive/lib/guava-r09.jar;

    I started
    hive --service hiveserver

    Ran my script it errors out. It is not picking up the .hiverc file.

    Am I missing something?

    Thanks

    On Monday, October 1, 2012 3:26:38 PM UTC-4, Joey Echeverria wrote:

    You need to create a .hiverc file for the user running the hive
    server. You can place your add statements in there.

    -Joey
    On Mon, Oct 1, 2012 at 3:21 PM, Mike wrote:
    Thanks Adam.

    Currently, after getting into hive, I add the jar files manually as
    below
    hive> add jar /usr/lib/hive/lib/hbase.jar;
    hive> add jar
    /usr/lib/hive/lib/hive-hbase-handler-0.8.1-cdh4.0.1.jar;
    hive> add jar /usr/lib/hive/lib/zookeeper.jar;
    hive> add jar /usr/lib/hive/lib/guava-r09.jar;

    How do I set the jar files for "hive --service hiveserver"?

    select * from tablename works fine without the jar files.

    select key from tablename fails without the jar files.

    Thanks

    On Monday, October 1, 2012 2:51:07 PM UTC-4, Adam Smieszny wrote:

    Hi Mike,

    I believe the steps to enable this are as follows (note I have not
    done
    this myself, but this is my educated guess based on some research).

    1. Install "Hive" RPM/deb on external box
    2. Configure Hive-site.xml
    3. Start hive thrift server with 'hive --service hiveserver'

    A blog post that you might find relevant is available here:
    http://blog.milford.io/2010/06/daemonizing-the-apache-hive-thrift-server-on-centos/
    Cheers,
    Adam

    On Mon, Oct 1, 2012 at 2:16 PM, Mike wrote:

    Could you please respond?

    Thanks

    On Thursday, September 27, 2012 4:39:36 PM UTC-4, Mike wrote:

    Could you please respond?
    On Thursday, September 27, 2012 11:35:43 AM UTC-4, Mike wrote:

    Hi All,

    I use CM4.0/CDH 4.0.3. I have a hive server running in my
    cluster.
    I need to install thrift hive client on the separate machine
    outside
    hadoop cluser.

    Do you guys have install steps for that please?

    Thanks



    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny


    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.


    --
    Joey Echeverria
    Principal Solutions Architect
    Cloudera, Inc.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedSep 27, '12 at 3:42p
activeOct 2, '12 at 7:39p
posts10
users4
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase