[Hadoop-common-dev] [jira] Created: (HADOOP-4711) Chukwa - Add a config parameter to allow agent to talk to the same collector until connection fails.

Chukwa - Add a config parameter to allow agent to talk to the same collector until connection fails.
----------------------------------------------------------------------------------------------------

Key: HADOOP-4711
URL: https://issues.apache.org/jira/browse/HADOOP-4711
Project: Hadoop Core
Issue Type: New Feature
Components: contrib/chukwa
Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
Reporter: Eric Yang

In chukwa agent, we added ability to rotate collector on each HTTP post. RAD Lab is using Chukwa Agent differently, and would like to have the option to keep agent on the same collector. On the smaller scale of the Chukwa, it makes sense to process data without the map reduce job. A new interface needs to be created as a T pipe line to stream data from collector directly into a Database or external storage. In this configuration, it is better to channel similar data to the same collector to reduce the cost of reassembling chunks.

Chukwa - Add a config parameter to allow agent to talk to the same collector until connection fails.
----------------------------------------------------------------------------------------------------

Key: HADOOP-4711
URL: https://issues.apache.org/jira/browse/HADOOP-4711
Project: Hadoop Core
Issue Type: New Feature
Components: contrib/chukwa
Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
Reporter: Eric Yang
Assignee: Eric Yang

In chukwa agent, we added ability to rotate collector on each HTTP post. RAD Lab is using Chukwa Agent differently, and would like to have the option to keep agent on the same collector. On the smaller scale of the Chukwa, it makes sense to process data without the map reduce job. A new interface needs to be created as a T pipe line to stream data from collector directly into a Database or external storage. In this configuration, it is better to channel similar data to the same collector to reduce the cost of reassembling chunks.