FAQ
[HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
--------------------------------------------------------------------------------------

Key: HADOOP-2766
URL: https://issues.apache.org/jira/browse/HADOOP-2766
Project: Hadoop Core
Issue Type: Bug
Components: contrib/hod
Affects Versions: 0.16.0
Reporter: Hemanth Yamijala
Assignee: Hemanth Yamijala
Priority: Critical


For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.



--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Hemanth Yamijala (JIRA) at Feb 1, 2008 at 11:41 am
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Hemanth Yamijala reassigned HADOOP-2766:
    ----------------------------------------

    Assignee: Vinod Kumar Vavilapalli (was: Hemanth Yamijala)
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical

    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod Kumar Vavilapalli (JIRA) at Feb 1, 2008 at 12:31 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Vinod Kumar Vavilapalli updated HADOOP-2766:
    --------------------------------------------

    Attachment: hadoop-2766

    Fixed this. Now users can set HADOOP_OPTS by specifying it in configuration parameters gridservice-mapred.envs or gridservice-hdfs.envs depending on where it need to be specified. Any special characters present have to escaped.
    e.g: ./bin/hod -c ~/hodrc.old -o "allocate ~/hod/clusterpath 4" -t ~/hadoop-0.17.0-dev.tar.gz --gridservice-hdfs.envs="HADOOP_OPTS=-XX:+MaxFDLimit\ -XX:MaxHeapFreeRatio\=70" --gridservice-mapred.envs="HADOOP_OPTS=-XX:MaxHeapFreeRatio\=70"

    Also forcing validation of both envs variables, absence of which was throwing uncaught exceptions when invalid list of keyval pairs is specified by user.
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod Kumar Vavilapalli (JIRA) at Feb 1, 2008 at 12:33 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12564734#action_12564734 ]

    vinodkv edited comment on HADOOP-2766 at 2/1/08 4:31 AM:
    -------------------------------------------------------------------------

    Fixed this. Now users can set HADOOP_OPTS by specifying it in configuration parameters gridservice-mapred.envs or gridservice-hdfs.envs depending on where it need to be specified. Any special characters present have to escaped.

    e.g: ./bin/hod -c ~/hodrc.old -o "allocate ~/hod/clusterpath 4" -t ~/hadoop-0.17.0-dev.tar.gz --gridservice-hdfs.envs="HADOOP_OPTS=-XX:+MaxFDLimit\ -XX:MaxHeapFreeRatio\=70" --gridservice-mapred.envs="HADOOP_OPTS=-XX:MaxHeapFreeRatio\=70"

    Also forcing validation of both envs variables, absence of which was throwing uncaught exceptions when invalid list of keyval pairs is specified by user.

    was (Author: vinodkv):
    Fixed this. Now users can set HADOOP_OPTS by specifying it in configuration parameters gridservice-mapred.envs or gridservice-hdfs.envs depending on where it need to be specified. Any special characters present have to escaped.
    e.g: ./bin/hod -c ~/hodrc.old -o "allocate ~/hod/clusterpath 4" -t ~/hadoop-0.17.0-dev.tar.gz --gridservice-hdfs.envs="HADOOP_OPTS=-XX:+MaxFDLimit\ -XX:MaxHeapFreeRatio\=70" --gridservice-mapred.envs="HADOOP_OPTS=-XX:MaxHeapFreeRatio\=70"

    Also forcing validation of both envs variables, absence of which was throwing uncaught exceptions when invalid list of keyval pairs is specified by user.
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hemanth Yamijala (JIRA) at Feb 1, 2008 at 1:17 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12564750#action_12564750 ]

    Hemanth Yamijala commented on HADOOP-2766:
    ------------------------------------------

    +1

    Patch looks good.
    Also tested with both trunk and earlier version and passing single and multiple values in the HADOOP_OPTS through the envs option.

    Also tested that invalid key value pairs now fail with a proper error.
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Karam Singh (JIRA) at Feb 1, 2008 at 3:39 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12564801#action_12564801 ]

    Karam Singh commented on HADOOP-2766:
    -------------------------------------

    +1
    Ran hod after applying patch with follwoing options -:
    hod -c conf/hodrc0.16 -b 4 -o "allocate clusterDir1 3" --gridservice-mapred.envs='HADOOP_OPTS=-Dmy.env\=\"Hello\,World\:Test\/test1\;tt\"\ -Xms512m\ -XX\:\-UseParallelGC -XX\:\-RelaxAccessControlCheck,HADOOP_HEAPSIZE=2048,HADOOP_ROOT_LOGGER=DEBUG\,console' --gridservice-hdfs.envs="HADOOP_OPTS=-Dmy.env\=\'World\:Test\'\ -Dmy.env2\=\'hodtest/HOD\'\ -XX\:\+MaxFDLimit -
    XX\:\+UseBoundThreads -XX\:\+UseTLAB,HADOOP_CLASSPATH=/home\:/proc,HADOOP_HEAPSIZE=2048,HADOOP_ROOT_LOGGER=DEBUG\,console"

    Also tried it by setting value in hodrc.
    Note--: If in hodrc some value of key=value params contains ';' then value from ';' afterwards will be ignored. Same thing works from commandline.
    Tried with bot hadoop 0.16 and hadoop 0.15
    Also ran smoke test successfully with static dfs
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Allen Wittenauer (JIRA) at Feb 1, 2008 at 8:49 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12564929#action_12564929 ]

    Allen Wittenauer commented on HADOOP-2766:
    ------------------------------------------

    See also https://issues.apache.org/jira/browse/HADOOP-2551
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod Kumar Vavilapalli (JIRA) at Feb 5, 2008 at 9:41 am
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Vinod Kumar Vavilapalli updated HADOOP-2766:
    --------------------------------------------

    Fix Version/s: 0.17.0
    0.16.1
    0.16.0
    Affects Version/s: 0.17.0
    0.16.1
    Status: Patch Available (was: Open)

    Patch looks fine. Submitting now.
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0, 0.16.1, 0.17.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Fix For: 0.16.0, 0.16.1, 0.17.0

    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Feb 5, 2008 at 11:01 am
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12565702#action_12565702 ]

    Hadoop QA commented on HADOOP-2766:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12374543/hadoop-2766
    against trunk revision 616796.

    @author +1. The patch does not contain any @author tags.

    javadoc +1. The javadoc tool did not generate any warning messages.

    javac +1. The applied patch does not generate any new javac compiler warnings.

    release audit +1. The applied patch does not generate any new release audit warnings.

    findbugs +1. The patch does not introduce any new Findbugs warnings.

    core tests -1. The patch failed core unit tests.

    contrib tests +1. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1739/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1739/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1739/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1739/console

    This message is automatically generated.
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0, 0.16.1, 0.17.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Fix For: 0.16.0, 0.16.1, 0.17.0

    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod Kumar Vavilapalli (JIRA) at Feb 5, 2008 at 12:00 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12565713#action_12565713 ]

    Vinod Kumar Vavilapalli commented on HADOOP-2766:
    -------------------------------------------------

    Hudson gave a -1 because of failure of the test case org.apache.hadoop.dfs.TestBalancer.testBalancer0 which is in no way related to this patch or HOD. The patch can be passed.
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0, 0.16.1, 0.17.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Fix For: 0.16.0, 0.16.1, 0.17.0

    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Nigel Daley (JIRA) at Feb 5, 2008 at 5:14 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Nigel Daley updated HADOOP-2766:
    --------------------------------

    Fix Version/s: (was: 0.16.0)
    (was: 0.17.0)
    Affects Version/s: (was: 0.16.1)
    (was: 0.17.0)
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Fix For: 0.16.1

    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Vinod Kumar Vavilapalli (JIRA) at Feb 14, 2008 at 11:07 am
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12568874#action_12568874 ]

    Vinod Kumar Vavilapalli commented on HADOOP-2766:
    -------------------------------------------------

    The same patch applies cleanly to both trunk and release 0.16. No issue being left unresolved, the patch is committable.
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Fix For: 0.16.1

    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Devaraj Das (JIRA) at Feb 20, 2008 at 4:25 am
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Devaraj Das updated HADOOP-2766:
    --------------------------------

    Resolution: Fixed
    Status: Resolved (was: Patch Available)

    I just committed this. Thanks, Vinod!
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Fix For: 0.16.1

    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Feb 20, 2008 at 12:09 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12570660#action_12570660 ]

    Hudson commented on HADOOP-2766:
    --------------------------------

    Integrated in Hadoop-trunk #406 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/406/])
    [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
    --------------------------------------------------------------------------------------

    Key: HADOOP-2766
    URL: https://issues.apache.org/jira/browse/HADOOP-2766
    Project: Hadoop Core
    Issue Type: Bug
    Components: contrib/hod
    Affects Versions: 0.16.0
    Reporter: Hemanth Yamijala
    Assignee: Vinod Kumar Vavilapalli
    Priority: Critical
    Fix For: 0.16.1

    Attachments: hadoop-2766


    For purposes of performance tuning it should be possible to set some environment variables that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS, which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC. This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable, but it does not read the java-opts variable anywhere properly.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedFeb 1, '08 at 10:17a
activeFeb 20, '08 at 12:09p
posts14
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hudson (JIRA): 14 posts

People

Translate

site design / logo © 2022 Grokbase