FAQ
Is it possible to tell hadoop to restrict space usage of a specific dfs folder in the cluster, e.g. a user home directory (/user/accountA in dfs)?

And is there a way to restrict the size of map/reduce output that can be saved to dfs? E.g. if a job creates over-limit data, it won't be allowed to save the result to the dfs.

Thanks,

Michael

Search Discussions

  • Ted Yu at Aug 25, 2010 at 10:47 pm
    Refer to
    http://hadoop.apache.org/common/docs/r0.20.0/hdfs_quota_admin_guide.html#Space+Quotas
    On Wed, Aug 25, 2010 at 3:43 PM, jiang licht wrote:

    Is it possible to tell hadoop to restrict space usage of a specific dfs
    folder in the cluster, e.g. a user home directory (/user/accountA in dfs)?

    And is there a way to restrict the size of map/reduce output that can be
    saved to dfs? E.g. if a job creates over-limit data, it won't be allowed to
    save the result to the dfs.

    Thanks,

    Michael

  • Jiang licht at Aug 25, 2010 at 11:02 pm
    Thanks, Ted.


    Michael

    --- On Wed, 8/25/10, Ted Yu wrote:

    From: Ted Yu <yuzhihong@gmail.com>
    Subject: Re: quota?
    To: common-user@hadoop.apache.org
    Date: Wednesday, August 25, 2010, 5:47 PM

    Refer to
    http://hadoop.apache.org/common/docs/r0.20.0/hdfs_quota_admin_guide.html#Space+Quotas
    On Wed, Aug 25, 2010 at 3:43 PM, jiang licht wrote:

    Is it possible to tell hadoop to restrict space usage of a specific dfs
    folder in the cluster, e.g. a user home directory (/user/accountA in dfs)?

    And is there a way to restrict the size of map/reduce output that can be
    saved to dfs? E.g. if a job creates over-limit data, it won't be allowed to
    save the result to the dfs.

    Thanks,

    Michael

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedAug 25, '10 at 10:43p
activeAug 25, '10 at 11:02p
posts3
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Jiang licht: 2 posts Ted Yu: 1 post

People

Translate

site design / logo © 2021 Grokbase