Grokbase › Groups › Hadoop › scm-users › October 2012
FAQ
I can specify a config file, all command-line arguments to java and specify
settings for log4j.properties.

I want to add my own "sink" class via my own jar file, but nowhere to
modify FLUME_CLASSPATH.

I tried changing /etc/flume/conf/flume-env.sh but this doesn't seem to be
loaded when the agent is managed by the SCM.

Any recommended best-practices for this?

Thanks,
Pat

Search Discussions

  • Vikram Srivastava at Oct 29, 2012 at 7:46 pm ⇧
    Hey Patrick,

    You can add additional directories to your classpath by modifying the
    config "Additional Java Configuration Options for Flume Agent" in CM UI.
    You need to specify ALL the paths by adding
    "-Djava.library.path={ALL_PATHS}". This string gets sent as-is to Flume
    agent startup script. So make sure it contains all the paths needed by your
    Flume Agents.
    *
    *
    *Regards,
    *
    *
    *
    *Vikram
    *
    On Mon, Oct 29, 2012 at 12:25 PM, Patrick Ethier wrote:

    I can specify a config file, all command-line arguments to java and
    specify settings for log4j.properties.

    I want to add my own "sink" class via my own jar file, but nowhere to
    modify FLUME_CLASSPATH.

    I tried changing /etc/flume/conf/flume-env.sh but this doesn't seem to be
    loaded when the agent is managed by the SCM.

    Any recommended best-practices for this?

    Thanks,
    Pat
  • Patrick Ethier at Oct 29, 2012 at 9:49 pm ⇧
    Thanks,

    That worked.

    Also note, adding the .jar to flume's lib library worked as well, although
    I don't like this option for mass-distribution on my cluster.

    Pat

    On Mon, Oct 29, 2012 at 3:46 PM, Vikram Srivastava wrote:

    Hey Patrick,

    You can add additional directories to your classpath by modifying the
    config "Additional Java Configuration Options for Flume Agent" in CM UI.
    You need to specify ALL the paths by adding
    "-Djava.library.path={ALL_PATHS}". This string gets sent as-is to Flume
    agent startup script. So make sure it contains all the paths needed by your
    Flume Agents.
    *
    *
    *Regards,
    *
    *
    *
    *Vikram
    *
    On Mon, Oct 29, 2012 at 12:25 PM, Patrick Ethier wrote:

    I can specify a config file, all command-line arguments to java and
    specify settings for log4j.properties.

    I want to add my own "sink" class via my own jar file, but nowhere to
    modify FLUME_CLASSPATH.

    I tried changing /etc/flume/conf/flume-env.sh but this doesn't seem to be
    loaded when the agent is managed by the SCM.

    Any recommended best-practices for this?

    Thanks,
    Pat

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedOct 29, '12 at 7:46p
activeOct 29, '12 at 9:49p
posts3
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Patrick Ethier: 2 posts Vikram Srivastava: 1 post

Content

People

Support

Translate

site design / logo © 2023 Grokbase