FAQ
JVM reuse across task types
---------------------------

Key: HADOOP-5425
URL: https://issues.apache.org/jira/browse/HADOOP-5425
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Vinod K V


Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Devaraj Das (JIRA) at May 1, 2009 at 7:29 am
    [ https://issues.apache.org/jira/browse/HADOOP-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Devaraj Das updated HADOOP-5425:
    --------------------------------

    Attachment: 5425.1.patch

    Straightforward patch. The patch removes the JvmManager's internal class JvmManagerForType and all the methods defined there are now accessible via JvmManager. The patch looks big mainly because of indentation changes.
    JVM reuse across task types
    ---------------------------

    Key: HADOOP-5425
    URL: https://issues.apache.org/jira/browse/HADOOP-5425
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Reporter: Vinod K V
    Attachments: 5425.1.patch


    Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Devaraj Das (JIRA) at May 1, 2009 at 7:31 am
    [ https://issues.apache.org/jira/browse/HADOOP-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Devaraj Das updated HADOOP-5425:
    --------------------------------

    Affects Version/s: 0.19.0
    Fix Version/s: 0.21.0
    Assignee: Devaraj Das
    JVM reuse across task types
    ---------------------------

    Key: HADOOP-5425
    URL: https://issues.apache.org/jira/browse/HADOOP-5425
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.19.0
    Reporter: Vinod K V
    Assignee: Devaraj Das
    Fix For: 0.21.0

    Attachments: 5425.1.patch


    Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Devaraj Das (JIRA) at May 1, 2009 at 7:33 am
    [ https://issues.apache.org/jira/browse/HADOOP-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Devaraj Das updated HADOOP-5425:
    --------------------------------

    Status: Patch Available (was: Open)
    JVM reuse across task types
    ---------------------------

    Key: HADOOP-5425
    URL: https://issues.apache.org/jira/browse/HADOOP-5425
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.19.0
    Reporter: Vinod K V
    Assignee: Devaraj Das
    Fix For: 0.21.0

    Attachments: 5425.1.patch


    Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Devaraj Das (JIRA) at May 4, 2009 at 5:52 am
    [ https://issues.apache.org/jira/browse/HADOOP-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Devaraj Das updated HADOOP-5425:
    --------------------------------

    Status: Open (was: Patch Available)

    Vinod pointed out that we cannot reuse the same jvm across multiple task types at least for the reason that one might want to specify different heap sizes for the map and reduce jvms.
    JVM reuse across task types
    ---------------------------

    Key: HADOOP-5425
    URL: https://issues.apache.org/jira/browse/HADOOP-5425
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.19.0
    Reporter: Vinod K V
    Assignee: Devaraj Das
    Fix For: 0.21.0

    Attachments: 5425.1.patch


    Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedMar 6, '09 at 11:42a
activeMay 4, '09 at 5:52a
posts5
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Devaraj Das (JIRA): 5 posts

People

Translate

site design / logo © 2022 Grokbase