FAQ
Hi,

just out of curiosity: Is there any particular reason, why Hadoop projects or
ZooKeeper do not use apache commons configuration[1]?
I'm just evaluating it for an internal project. Would you recommend it or not?
I imagine, that it could help to make projects configurable either via XML or
INI files. Some people may prefer one or the other.

[1] http://commons.apache.org/configuration/

Best regards,

Thomas Koch, http://www.koch.ro

Search Discussions

  • Steve Loughran at Aug 24, 2010 at 10:25 am

    On 24/08/10 10:43, Thomas Koch wrote:
    Hi,

    just out of curiosity: Is there any particular reason, why Hadoop projects or
    ZooKeeper do not use apache commons configuration[1]?
    I'm just evaluating it for an internal project. Would you recommend it or not?
    I imagine, that it could help to make projects configurable either via XML or
    INI files. Some people may prefer one or the other.

    [1] http://commons.apache.org/configuration/
    Someone's discussed it, I'm against because (a) there's a lot of
    historical configuration stuff in there, (b) ini files are less flexible
    than XML, (c) neither of them are very dynamic. when the NN goes down
    and you want the DNs to reconnect to a different host, how do you do
    that when all data is read at start time?
  • Stephen Watt at Aug 24, 2010 at 4:40 pm
    Hi Folks

    For those in the Austin, Texas area we'll be meeting again this Thursday
    evening (8/26). Karmasphere and Pentaho will be presenting and I'll also
    be giving a quick introduction to Hadoop for all the new attendees before
    we begin.

    Full details are available here -
    http://austinhug.blogspot.com/2010/08/august-meeting-826.html

    Regards
    Steve Watt



    From:
    Steve Loughran <[email protected]>
    To:
    [email protected]
    Date:
    08/24/2010 05:25 AM
    Subject:
    Re: apache commons configuration


    On 24/08/10 10:43, Thomas Koch wrote:
    Hi,

    just out of curiosity: Is there any particular reason, why Hadoop
    projects or
    ZooKeeper do not use apache commons configuration[1]?
    I'm just evaluating it for an internal project. Would you recommend it or not?
    I imagine, that it could help to make projects configurable either via XML or
    INI files. Some people may prefer one or the other.

    [1] http://commons.apache.org/configuration/
    Someone's discussed it, I'm against because (a) there's a lot of
    historical configuration stuff in there, (b) ini files are less flexible
    than XML, (c) neither of them are very dynamic. when the NN goes down
    and you want the DNs to reconnect to a different host, how do you do
    that when all data is read at start time?
  • Stephen Watt at Aug 24, 2010 at 4:50 pm
    Hi Folks

    15,000 people attended SXSW Interactive last year. As such, a couple of
    folks from the Apache Hadoop and Cassandra community have joined up to put
    together a "Big Data for everyone" panel at SXSW next year. The intent is
    to proselytize both the Online and Offline Big Data stack (incl. HBase,
    Pig, Hive, etc.) to the as yet uninformed. There are no agendas here other
    than getting the word out and educating the audience.

    Acceptance to SXSW is partially democratic and community votes for the
    session greatly affect the outcome.

    If you have a few minutes, please sign up and vote for our panel. We'd
    really appreciate it. Voting closes on Friday.

    http://panelpicker.sxsw.com/ideas/view/7475

    Regards
    Steve Watt
  • Jeff Hammerbacher at Aug 25, 2010 at 8:35 am
    For some recent discussion, see
    https://issues.apache.org/jira/browse/HADOOP-6910
    On Tue, Aug 24, 2010 at 3:24 AM, Steve Loughran wrote:
    On 24/08/10 10:43, Thomas Koch wrote:

    Hi,

    just out of curiosity: Is there any particular reason, why Hadoop projects
    or
    ZooKeeper do not use apache commons configuration[1]?
    I'm just evaluating it for an internal project. Would you recommend it or
    not?
    I imagine, that it could help to make projects configurable either via XML
    or
    INI files. Some people may prefer one or the other.

    [1] http://commons.apache.org/configuration/
    Someone's discussed it, I'm against because (a) there's a lot of historical
    configuration stuff in there, (b) ini files are less flexible than XML, (c)
    neither of them are very dynamic. when the NN goes down and you want the DNs
    to reconnect to a different host, how do you do that when all data is read
    at start time?

  • Bob Li at Sep 2, 2010 at 6:54 pm
    Hi experts,

    For hadoop 0.20.2, we have following task tracker configuration
    <property>
    <name>mapred.local.dir</name>
    <value>/data/mapred/local</value>
    </property>

    It seems not what I expected -- the directory /tmp/hadoop-user/mapred/local
    was used.

    Any suggestion?

    Thanks,
    Bob
    On Wed, Aug 25, 2010 at 4:34 AM, Jeff Hammerbacher wrote:

    For some recent discussion, see
    https://issues.apache.org/jira/browse/HADOOP-6910
    On Tue, Aug 24, 2010 at 3:24 AM, Steve Loughran wrote:
    On 24/08/10 10:43, Thomas Koch wrote:

    Hi,

    just out of curiosity: Is there any particular reason, why Hadoop
    projects
    or
    ZooKeeper do not use apache commons configuration[1]?
    I'm just evaluating it for an internal project. Would you recommend it
    or
    not?
    I imagine, that it could help to make projects configurable either via
    XML
    or
    INI files. Some people may prefer one or the other.

    [1] http://commons.apache.org/configuration/
    Someone's discussed it, I'm against because (a) there's a lot of
    historical
    configuration stuff in there, (b) ini files are less flexible than XML, (c)
    neither of them are very dynamic. when the NN goes down and you want the DNs
    to reconnect to a different host, how do you do that when all data is read
    at start time?

  • Allen Wittenauer at Sep 2, 2010 at 7:03 pm

    On Sep 2, 2010, at 11:53 AM, Bob Li wrote:

    Hi experts,

    For hadoop 0.20.2, we have following task tracker configuration
    <property>
    <name>mapred.local.dir</name>
    <value>/data/mapred/local</value>
    </property>

    It seems not what I expected -- the directory /tmp/hadoop-user/mapred/local
    was used.

    Any suggestion?

    Config problems like this seem to usually be traced back to broken XML formatting prior to this entry or the property being in the wrong file (in this case, it should be in mapred-site.xml).

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupgeneral @
categorieshadoop
postedAug 24, '10 at 9:45a
activeSep 2, '10 at 7:03p
posts7
users6
websitehadoop.apache.org
irc#hadoop

People

Translate

site design / logo © 2023 Grokbase