FAQ
When you add roles there is an option to choose "Gateway" and it is a check
box.

What is this for? Do I need to select it on all the nodes or only the main
nodes?

Please respond.

Search Discussions

  • Adam Smieszny at Oct 10, 2012 at 11:24 pm
    A "gateway" node is also known as an "edge" node or client node - this will
    get the hadoop/hbase/mapreduce config xml files pushed to it when you use
    "Deploy Client Config Files" from the CM GUI, but does not necessarily
    participate as a NN/DN/JT/TT

    Hope that helps
    Thanks,
    Adam
    On Wed, Oct 10, 2012 at 7:18 PM, Mark wrote:

    When you add roles there is an option to choose "Gateway" and it is a
    check box.

    What is this for? Do I need to select it on all the nodes or only the main
    nodes?

    Please respond.


    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny
  • Mark at Oct 11, 2012 at 12:09 am
    So should there be at-least one gateway node in every cluster?
    On Wednesday, October 10, 2012 4:24:18 PM UTC-7, Adam Smieszny wrote:

    A "gateway" node is also known as an "edge" node or client node - this
    will get the hadoop/hbase/mapreduce config xml files pushed to it when you
    use "Deploy Client Config Files" from the CM GUI, but does not necessarily
    participate as a NN/DN/JT/TT

    Hope that helps
    Thanks,
    Adam

    On Wed, Oct 10, 2012 at 7:18 PM, Mark <mark.go...@gmail.com <javascript:>>wrote:
    When you add roles there is an option to choose "Gateway" and it is a
    check box.

    What is this for? Do I need to select it on all the nodes or only the
    main nodes?

    Please respond.


    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny
  • Adam Smieszny at Oct 11, 2012 at 3:53 am
    As you scale up, we certainly would expect there to be dedicated gateway
    nodes for client use.
    In smaller, test and dev clusters, these generally might live on the same
    machines as are running other Hadoop services. I think you still want to
    establish them as a Gateway via CM in order to ensure you get the correct
    config info deployed in the expected place

    HTH
    Adam
    On Wed, Oct 10, 2012 at 8:09 PM, Mark wrote:

    So should there be at-least one gateway node in every cluster?

    On Wednesday, October 10, 2012 4:24:18 PM UTC-7, Adam Smieszny wrote:

    A "gateway" node is also known as an "edge" node or client node - this
    will get the hadoop/hbase/mapreduce config xml files pushed to it when you
    use "Deploy Client Config Files" from the CM GUI, but does not necessarily
    participate as a NN/DN/JT/TT

    Hope that helps
    Thanks,
    Adam

    On Wed, Oct 10, 2012 at 7:18 PM, Mark wrote:

    When you add roles there is an option to choose "Gateway" and it is a
    check box.

    What is this for? Do I need to select it on all the nodes or only the
    main nodes?

    Please respond.


    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/**about<http://tiny.cloudera.com/about>
    917.830.4156 | http://www.linkedin.com/in/**adamsmieszny<http://www.linkedin.com/in/adamsmieszny>

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny
  • Mark at Oct 11, 2012 at 3:33 pm
    Thanks. Our cluster is pretty small now with only 30 nodes. As we get
    bigger we'll probably use this feature.
    On Wednesday, October 10, 2012 7:13:45 PM UTC-7, Adam Smieszny wrote:

    As you scale up, we certainly would expect there to be dedicated gateway
    nodes for client use.
    In smaller, test and dev clusters, these generally might live on the same
    machines as are running other Hadoop services. I think you still want to
    establish them as a Gateway via CM in order to ensure you get the correct
    config info deployed in the expected place

    HTH
    Adam

    On Wed, Oct 10, 2012 at 8:09 PM, Mark <mark.go...@gmail.com <javascript:>>wrote:
    So should there be at-least one gateway node in every cluster?

    On Wednesday, October 10, 2012 4:24:18 PM UTC-7, Adam Smieszny wrote:

    A "gateway" node is also known as an "edge" node or client node - this
    will get the hadoop/hbase/mapreduce config xml files pushed to it when you
    use "Deploy Client Config Files" from the CM GUI, but does not necessarily
    participate as a NN/DN/JT/TT

    Hope that helps
    Thanks,
    Adam

    On Wed, Oct 10, 2012 at 7:18 PM, Mark wrote:

    When you add roles there is an option to choose "Gateway" and it is a
    check box.

    What is this for? Do I need to select it on all the nodes or only the
    main nodes?

    Please respond.


    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/**about<http://tiny.cloudera.com/about>
    917.830.4156 | http://www.linkedin.com/in/**adamsmieszny<http://www.linkedin.com/in/adamsmieszny>

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/about
    917.830.4156 | http://www.linkedin.com/in/adamsmieszny
  • Philip Langdale at Oct 11, 2012 at 6:19 pm
    Note that CM will deploy client configurations to every node that
    participates in a service,
    so if you're planning to use an existing node as a client, you don't need
    to explicitly
    assign a gateway role to it.

    --phil


    On 11 October 2012 08:25, Mark wrote:

    Thanks. Our cluster is pretty small now with only 30 nodes. As we get
    bigger we'll probably use this feature.

    On Wednesday, October 10, 2012 7:13:45 PM UTC-7, Adam Smieszny wrote:

    As you scale up, we certainly would expect there to be dedicated gateway
    nodes for client use.
    In smaller, test and dev clusters, these generally might live on the same
    machines as are running other Hadoop services. I think you still want to
    establish them as a Gateway via CM in order to ensure you get the correct
    config info deployed in the expected place

    HTH
    Adam

    On Wed, Oct 10, 2012 at 8:09 PM, Mark wrote:

    So should there be at-least one gateway node in every cluster?

    On Wednesday, October 10, 2012 4:24:18 PM UTC-7, Adam Smieszny wrote:

    A "gateway" node is also known as an "edge" node or client node - this
    will get the hadoop/hbase/mapreduce config xml files pushed to it when you
    use "Deploy Client Config Files" from the CM GUI, but does not necessarily
    participate as a NN/DN/JT/TT

    Hope that helps
    Thanks,
    Adam

    On Wed, Oct 10, 2012 at 7:18 PM, Mark wrote:

    When you add roles there is an option to choose "Gateway" and it is a
    check box.

    What is this for? Do I need to select it on all the nodes or only the
    main nodes?

    Please respond.


    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/**abo**ut<http://tiny.cloudera.com/about>
    917.830.4156 | http://www.linkedin.com/in/**a**damsmieszny<http://www.linkedin.com/in/adamsmieszny>

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://tiny.cloudera.com/**about<http://tiny.cloudera.com/about>
    917.830.4156 | http://www.linkedin.com/in/**adamsmieszny<http://www.linkedin.com/in/adamsmieszny>

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedOct 10, '12 at 11:24p
activeOct 11, '12 at 6:19p
posts6
users3
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase