FAQ
map/reduce clients should not access the system dir directly
------------------------------------------------------------

Key: HADOOP-3626
URL: https://issues.apache.org/jira/browse/HADOOP-3626
Project: Hadoop Core
Issue Type: Improvement
Components: mapred
Reporter: Owen O'Malley


Map/Reduce's use of the system directory with clients creating directories and files directly is very insecure. We should change the job client to create a staging directory in the user's home directory on the same file system as the system directory.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Owen O'Malley (JIRA) at Jun 24, 2008 at 6:42 am
    [ https://issues.apache.org/jira/browse/HADOOP-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607491#action_12607491 ]

    Owen O'Malley commented on HADOOP-3626:
    ---------------------------------------

    I'd propose something like:

    {code}
    ~/.staging/$jobid/
    {code}

    The JobClient would create the job directory and the job tracker would move the job directory into the system directory and delete it when the job is finished.
    map/reduce clients should not access the system dir directly
    ------------------------------------------------------------

    Key: HADOOP-3626
    URL: https://issues.apache.org/jira/browse/HADOOP-3626
    Project: Hadoop Core
    Issue Type: Improvement
    Components: mapred
    Reporter: Owen O'Malley

    Map/Reduce's use of the system directory with clients creating directories and files directly is very insecure. We should change the job client to create a staging directory in the user's home directory on the same file system as the system directory.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Amar Kamat (JIRA) at Jun 24, 2008 at 7:02 am
    [ https://issues.apache.org/jira/browse/HADOOP-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Amar Kamat resolved HADOOP-3626.
    --------------------------------

    Resolution: Duplicate

    Duplicate of HADOOP-3578.
    map/reduce clients should not access the system dir directly
    ------------------------------------------------------------

    Key: HADOOP-3626
    URL: https://issues.apache.org/jira/browse/HADOOP-3626
    Project: Hadoop Core
    Issue Type: Improvement
    Components: mapred
    Reporter: Owen O'Malley

    Map/Reduce's use of the system directory with clients creating directories and files directly is very insecure. We should change the job client to create a staging directory in the user's home directory on the same file system as the system directory.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJun 24, '08 at 6:40a
activeJun 24, '08 at 7:02a
posts3
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Amar Kamat (JIRA): 3 posts

People

Translate

site design / logo © 2022 Grokbase