Grokbase › Groups › Hadoop › common-user › March 2008
FAQ
I am interested to know the internal working of Hadoop regarding
distribution of jobs. How are the jobs copied to other nodes?

Is the class file copied to all other nodes where they are executed?

Search Discussions

  • Amar Kamat at Mar 8, 2008 at 6:59 pm ⇧
    The job file i.e job.jar is copied to the dfs by the job client. When the
    task tracker prepares for new task it makes a local copy of the job.
    On Sat, 8 Mar 2008, Ben Kucinich wrote:

    I am interested to know the internal working of Hadoop regarding
    distribution of jobs. How are the jobs copied to other nodes?

    Is the class file copied to all other nodes where they are executed?
    Yes.
    Btw I think this should be posted on core-dev!
    Amar
    >

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedMar 8, '08 at 7:28a
activeMar 8, '08 at 6:59p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Ben Kucinich: 1 post Amar Kamat: 1 post

Content

People

Support

Translate

site design / logo © 2023 Grokbase