FAQ
Chukwa - Add a config parameter to allow agent to talk to the same collector until connection fails.
----------------------------------------------------------------------------------------------------

Key: HADOOP-4711
URL: https://issues.apache.org/jira/browse/HADOOP-4711
Project: Hadoop Core
Issue Type: New Feature
Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
Reporter: Eric Yang


In chukwa agent, we added ability to rotate collector on each HTTP post. RAD Lab is using Chukwa Agent differently, and would like to have the option to keep agent on the same collector. On the smaller scale of the Chukwa, it makes sense to process data without the map reduce job. A new interface needs to be created as a T pipe line to stream data from collector directly into a Database or external storage. In this configuration, it is better to channel similar data to the same collector to reduce the cost of reassembling chunks.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Mac Yang (JIRA) at Dec 10, 2008 at 1:03 am
    [ https://issues.apache.org/jira/browse/HADOOP-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mac Yang updated HADOOP-4711:
    -----------------------------

    Component/s: contrib/chukwa
    Chukwa - Add a config parameter to allow agent to talk to the same collector until connection fails.
    ----------------------------------------------------------------------------------------------------

    Key: HADOOP-4711
    URL: https://issues.apache.org/jira/browse/HADOOP-4711
    Project: Hadoop Core
    Issue Type: New Feature
    Components: contrib/chukwa
    Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
    Reporter: Eric Yang

    In chukwa agent, we added ability to rotate collector on each HTTP post. RAD Lab is using Chukwa Agent differently, and would like to have the option to keep agent on the same collector. On the smaller scale of the Chukwa, it makes sense to process data without the map reduce job. A new interface needs to be created as a T pipe line to stream data from collector directly into a Database or external storage. In this configuration, it is better to channel similar data to the same collector to reduce the cost of reassembling chunks.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Eric Yang (JIRA) at Dec 11, 2008 at 2:59 am
    [ https://issues.apache.org/jira/browse/HADOOP-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Eric Yang resolved HADOOP-4711.
    -------------------------------

    Resolution: Fixed
    Assignee: Eric Yang

    Since we removed black list feature, Chukwa Agent will stay on the same collector until the collect fail to respond. Hence, this ticket is resolved by HADOOP-4805.
    Chukwa - Add a config parameter to allow agent to talk to the same collector until connection fails.
    ----------------------------------------------------------------------------------------------------

    Key: HADOOP-4711
    URL: https://issues.apache.org/jira/browse/HADOOP-4711
    Project: Hadoop Core
    Issue Type: New Feature
    Components: contrib/chukwa
    Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
    Reporter: Eric Yang
    Assignee: Eric Yang

    In chukwa agent, we added ability to rotate collector on each HTTP post. RAD Lab is using Chukwa Agent differently, and would like to have the option to keep agent on the same collector. On the smaller scale of the Chukwa, it makes sense to process data without the map reduce job. A new interface needs to be created as a T pipe line to stream data from collector directly into a Database or external storage. In this configuration, it is better to channel similar data to the same collector to reduce the cost of reassembling chunks.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedNov 21, '08 at 10:38p
activeDec 11, '08 at 2:59a
posts3
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Eric Yang (JIRA): 3 posts

People

Translate

site design / logo © 2022 Grokbase