Can¹t seem to get past this heap size error, any ideas where to look? Below
are my heap size settings, at least the ones I attempted to increase.

Thanks in advance for any thoughts.


# The maximum amount of heap to use, in MB. Default is 1000.
export HADOOP_HEAPSIZE=10000



<name>mapred.child.java.opts</name>
<value>-Xmx1048576m</value>
</property>





11/11/12 17:38:27 INFO hpc.Driver: Jar Name:
/home/hadoop/querry/HadoopTest.jar
0 [main] INFO nccs.hpc.Driver - Jar Name:
/home/hadoop/querry/HadoopTest.jar
0 [main] INFO nccs.hpc.Driver - Jar Name:
/home/hadoop/querry/HadoopTest.jar
11/11/12 17:38:27 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
146 [main] WARN org.apache.hadoop.mapred.JobClient - Use
GenericOptionsParser for parsing the arguments. Applications should
implement Tool for the same.
146 [main] WARN org.apache.hadoop.mapred.JobClient - Use
GenericOptionsParser for parsing the arguments. Applications should
implement Tool for the same.
11/11/12 17:38:30 INFO input.FileInputFormat: Total input paths to process :
2329
3330 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat -
Total input paths to process : 2329
3330 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat -
Total input paths to process : 2329
11/11/12 17:38:34 INFO mapred.JobClient: Running job: job_201111121210_0001
7919 [main] INFO org.apache.hadoop.mapred.JobClient - Running job:
job_201111121210_0001
7919 [main] INFO org.apache.hadoop.mapred.JobClient - Running job:
job_201111121210_0001
11/11/12 17:38:35 INFO mapred.JobClient: map 0% reduce 0%
8922 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
8922 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
11/11/12 17:40:37 INFO mapred.JobClient: map 1% reduce 0%
130058 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
130058 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
11/11/12 17:42:17 INFO mapred.JobClient: map 2% reduce 0%
230162 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
230162 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
11/11/12 17:43:47 INFO mapred.JobClient: map 3% reduce 0%
320251 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
320251 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
11/11/12 17:45:26 INFO mapred.JobClient: map 4% reduce 0%
419346 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
419346 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
11/11/12 17:46:59 INFO mapred.JobClient: map 5% reduce 0%
512435 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
512435 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
11/11/12 17:48:26 INFO mapred.JobClient: Task Id :
attempt_201111121210_0001_r_000000_0, Status : FAILED
599520 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
attempt_201111121210_0001_r_000000_0, Status : FAILED
599520 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
attempt_201111121210_0001_r_000000_0, Status : FAILED
Error: java.lang.OutOfMemoryError: Java heap space
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.shuffleInMe
mory(ReduceTask.java:1685)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutpu
t(ReduceTask.java:1545)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(
ReduceTask.java:1394)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceT
ask.java:1326)

Search Discussions

  • Eric Fiala at Nov 13, 2011 at 11:35 pm
    Hoot, these are big numbers - some thoughts
    1) does your machine have 1000GB to spare for each java child thread (each
    mapper + each reducer)? mapred.child.java.opts / -Xmx1048576m
    2) does each of your daemons need / have 10G? HADOOP_HEAPSIZE=10000

    hth
    EF
    # The maximum amount of heap to use, in MB. Default is 1000.
    export HADOOP_HEAPSIZE=10000

    <name>mapred.child.java.opts</name>
    <value>-Xmx1048576m</value>
    </property>
  • Hoot Thompson at Nov 14, 2011 at 12:24 am
    I cranked those setting up in an attempt to solve the heap issues. Just to
    verify, I restored the defaults and cycled both dfs and mapred daemons.
    Still getting same error.

    On 11/13/11 6:34 PM, "Eric Fiala" wrote:

    Hoot, these are big numbers - some thoughts
    1) does your machine have 1000GB to spare for each java child thread (each
    mapper + each reducer)?  mapred.child.java.opts / -Xmx1048576m
    2) does each of your daemons need / have 10G? HADOOP_HEAPSIZE=10000

    hth
    EF
    # The maximum amount of heap to use, in MB. Default is 1000.
     export HADOOP_HEAPSIZE=10000
    <name>mapred.child.java.opts</name>
    <value>-Xmx1048576m</value>
    </property>
  • Hoot Thompson at Nov 15, 2011 at 12:50 am
    Any suggestions as to how to track down the root cause of these errors?

    1178709 [main] INFO org.apache.hadoop.mapred.JobClient - map 6% reduce 0%
    1178709 [main] INFO org.apache.hadoop.mapred.JobClient - map 6% reduce 0%
    11/11/15 00:45:29 INFO mapred.JobClient: Task Id :
    attempt_201111150008_0002_r_000000_0, Status : FAILED
    1208771 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
    attempt_201111150008_0002_r_000000_0, Status : FAILED
    1208771 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
    attempt_201111150008_0002_r_000000_0, Status : FAILED
    Error: java.lang.OutOfMemoryError: Java heap space
    at org.apache.hadoop.mapred.IFile$Reader.readNextBlock(IFile.java:342)
    at org.apache.hadoop.mapred.IFile$Reader.next(IFile.java:404)
    at org.apache.hadoop.mapred.Merger$Segment.next(Merger.java:220)
    at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:420)
    at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:381)
    at org.apache.hadoop.mapred.Merger.merge(Merger.java:60)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$LocalFSMerger.run(ReduceTas
    k.java:2651)

    On 11/13/11 6:34 PM, "Eric Fiala" wrote:

    Hoot, these are big numbers - some thoughts
    1) does your machine have 1000GB to spare for each java child thread (each
    mapper + each reducer)?  mapred.child.java.opts / -Xmx1048576m
    2) does each of your daemons need / have 10G? HADOOP_HEAPSIZE=10000

    hth
    EF
    # The maximum amount of heap to use, in MB. Default is 1000.
     export HADOOP_HEAPSIZE=10000
    <name>mapred.child.java.opts</name>
    <value>-Xmx1048576m</value>
    </property>
  • Mohamed Riadh Trad at Nov 15, 2011 at 1:16 am
    try the -D mapred.child.java.opts=-Xmx4096M on the command line:

    bin/hadoop jar yourjar.jar yourclass -D mapred.child.java.opts=-Xmx8219M ......................................

    How many files do you have in your input folder?

    Bests,

    Trad Mohamed Riadh, M.Sc, Ing.
    PhD. student
    INRIA-TELECOM PARISTECH - ENPC School of International Management

    Office: 11-15
    Phone: (33)-1 39 63 59 33
    Fax: (33)-1 39 63 56 74
    Email: riadh.trad@inria.fr
    Home page: http://www-rocq.inria.fr/who/Mohamed.Trad/




    Le 14 nov. 2011 à 22:50, Hoot Thompson a écrit :
    Any suggestions as to how to track down the root cause of these errors?

    1178709 [main] INFO org.apache.hadoop.mapred.JobClient - map 6% reduce 0%
    1178709 [main] INFO org.apache.hadoop.mapred.JobClient - map 6% reduce 0%
    11/11/15 00:45:29 INFO mapred.JobClient: Task Id : attempt_201111150008_0002_r_000000_0, Status : FAILED
    1208771 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id : attempt_201111150008_0002_r_000000_0, Status : FAILED
    1208771 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id : attempt_201111150008_0002_r_000000_0, Status : FAILED
    Error: java.lang.OutOfMemoryError: Java heap space
    at org.apache.hadoop.mapred.IFile$Reader.readNextBlock(IFile.java:342)
    at org.apache.hadoop.mapred.IFile$Reader.next(IFile.java:404)
    at org.apache.hadoop.mapred.Merger$Segment.next(Merger.java:220)
    at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:420)
    at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:381)
    at org.apache.hadoop.mapred.Merger.merge(Merger.java:60)
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$LocalFSMerger.run(ReduceTask.java:2651)

    On 11/13/11 6:34 PM, "Eric Fiala" wrote:

    Hoot, these are big numbers - some thoughts
    1) does your machine have 1000GB to spare for each java child thread (each mapper + each reducer)? mapred.child.java.opts / -Xmx1048576m
    2) does each of your daemons need / have 10G? HADOOP_HEAPSIZE=10000

    hth
    EF
    # The maximum amount of heap to use, in MB. Default is 1000.
    export HADOOP_HEAPSIZE=10000
    <name>mapred.child.java.opts</name>
    <value>-Xmx1048576m</value>
    </property>
  • Hoot Thompson at Nov 15, 2011 at 2:39 am
    Still issues, around 2300 unique files....


    hadoop@lobster-nfs:~/querry$ hadoop jar HadoopTest.jar -D
    mapred.child.java.opts=-Xmx4096M
    hdfs://lobster-nfs:9000/hadoop_fs/dfs/merra/seq_out
    /hadoop_fs/dfs/output/test_111114_r2.out
    11/11/15 01:56:20 INFO hpc.Driver: Jar Name:
    /home/hadoop/querry/HadoopTest.jar
    0 [main] INFO nccs.hpc.Driver - Jar Name:
    /home/hadoop/querry/HadoopTest.jar
    0 [main] INFO nccs.hpc.Driver - Jar Name:
    /home/hadoop/querry/HadoopTest.jar
    11/11/15 01:56:20 WARN mapred.JobClient: Use GenericOptionsParser for
    parsing the arguments. Applications should implement Tool for the same.
    60 [main] WARN org.apache.hadoop.mapred.JobClient - Use
    GenericOptionsParser for parsing the arguments. Applications should
    implement Tool for the same.
    60 [main] WARN org.apache.hadoop.mapred.JobClient - Use
    GenericOptionsParser for parsing the arguments. Applications should
    implement Tool for the same.
    11/11/15 01:56:22 INFO input.FileInputFormat: Total input paths to process :
    2329
    2154 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat -
    Total input paths to process : 2329
    2154 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat -
    Total input paths to process : 2329
    11/11/15 01:56:24 INFO mapred.JobClient: Running job: job_201111150008_0003
    3693 [main] INFO org.apache.hadoop.mapred.JobClient - Running job:
    job_201111150008_0003
    3693 [main] INFO org.apache.hadoop.mapred.JobClient - Running job:
    job_201111150008_0003
    11/11/15 01:56:25 INFO mapred.JobClient: map 0% reduce 0%
    4696 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
    4696 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
    11/11/15 01:58:03 INFO mapred.JobClient: map 1% reduce 0%
    102916 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
    102916 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
    11/11/15 01:59:07 INFO mapred.JobClient: map 2% reduce 0%
    167042 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
    167042 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
    11/11/15 02:00:12 INFO mapred.JobClient: map 3% reduce 0%
    232168 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
    232168 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
    11/11/15 02:01:18 INFO mapred.JobClient: map 4% reduce 0%
    298290 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
    298290 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
    11/11/15 02:02:21 INFO mapred.JobClient: map 5% reduce 0%
    361418 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
    361418 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
    11/11/15 02:02:51 INFO mapred.JobClient: Task Id :
    attempt_201111150008_0003_r_000000_0, Status : FAILED
    391477 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
    attempt_201111150008_0003_r_000000_0, Status : FAILED
    391477 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
    attempt_201111150008_0003_r_000000_0, Status : FAILED
    Error: java.lang.OutOfMemoryError: Java heap space
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.shuffleInMe
    mory(ReduceTask.java:1685)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutpu
    t(ReduceTask.java:1545)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(
    ReduceTask.java:1394)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceT
    ask.java:1326)


    On 11/14/11 8:23 PM, "Mohamed Riadh Trad" wrote:

    -D mapred.child.java.opts=-Xmx4096M
  • Mohamed Riadh Trad at Nov 15, 2011 at 9:46 am
    java -version

    to check if the java you are using is a 32 bits or 64 bits version.

    If you are using a 32bits version you cannot allow more than 3,5 Gbyte for the heap.


    Trad Mohamed Riadh, M.Sc, Ing.
    PhD. student
    INRIA-TELECOM PARISTECH - ENPC School of International Management

    Office: 11-15
    Phone: (33)-1 39 63 59 33
    Fax: (33)-1 39 63 56 74
    Email: riadh.trad@inria.fr
    Home page: http://www-rocq.inria.fr/who/Mohamed.Trad/




    Le 15 nov. 2011 à 00:39, Hoot Thompson a écrit :
    Still issues, around 2300 unique files....


    hadoop@lobster-nfs:~/querry$ hadoop jar HadoopTest.jar -D mapred.child.java.opts=-Xmx4096M hdfs://lobster-nfs:9000/hadoop_fs/dfs/merra/seq_out /hadoop_fs/dfs/output/test_111114_r2.out
    11/11/15 01:56:20 INFO hpc.Driver: Jar Name: /home/hadoop/querry/HadoopTest.jar
    0 [main] INFO nccs.hpc.Driver - Jar Name: /home/hadoop/querry/HadoopTest.jar
    0 [main] INFO nccs.hpc.Driver - Jar Name: /home/hadoop/querry/HadoopTest.jar
    11/11/15 01:56:20 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    60 [main] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    60 [main] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    11/11/15 01:56:22 INFO input.FileInputFormat: Total input paths to process : 2329
    2154 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 2329
    2154 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 2329
    11/11/15 01:56:24 INFO mapred.JobClient: Running job: job_201111150008_0003
    3693 [main] INFO org.apache.hadoop.mapred.JobClient - Running job: job_201111150008_0003
    3693 [main] INFO org.apache.hadoop.mapred.JobClient - Running job: job_201111150008_0003
    11/11/15 01:56:25 INFO mapred.JobClient: map 0% reduce 0%
    4696 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
    4696 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
    11/11/15 01:58:03 INFO mapred.JobClient: map 1% reduce 0%
    102916 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
    102916 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
    11/11/15 01:59:07 INFO mapred.JobClient: map 2% reduce 0%
    167042 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
    167042 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
    11/11/15 02:00:12 INFO mapred.JobClient: map 3% reduce 0%
    232168 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
    232168 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
    11/11/15 02:01:18 INFO mapred.JobClient: map 4% reduce 0%
    298290 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
    298290 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
    11/11/15 02:02:21 INFO mapred.JobClient: map 5% reduce 0%
    361418 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
    361418 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
    11/11/15 02:02:51 INFO mapred.JobClient: Task Id : attempt_201111150008_0003_r_000000_0, Status : FAILED
    391477 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id : attempt_201111150008_0003_r_000000_0, Status : FAILED
    391477 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id : attempt_201111150008_0003_r_000000_0, Status : FAILED
    Error: java.lang.OutOfMemoryError: Java heap space
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.shuffleInMemory(ReduceTask.java:1685)
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1545)
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)


    On 11/14/11 8:23 PM, "Mohamed Riadh Trad" wrote:

    -D mapred.child.java.opts=-Xmx4096M
  • Hoot Thompson at Nov 15, 2011 at 1:36 pm
    hadoop@lobster-nfs:/root$ java -d64 -version
    java version "1.6.0_26"
    Java(TM) SE Runtime Environment (build 1.6.0_26-b03)
    Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02, mixed mode)

    On 11/15/11 4:53 AM, "Mohamed Riadh Trad" wrote:

    java -version

    to check if the java you are using is a 32 bits or 64 bits version.

    If you are using a 32bits version you cannot allow more than 3,5 Gbyte for the
    heap.


    Trad Mohamed Riadh, M.Sc, Ing.
    PhD. student
    INRIA-TELECOM PARISTECH - ENPC School of International Management

    Office: 11-15
    Phone: (33)-1 39 63 59 33
    Fax: (33)-1 39 63 56 74
    Email: riadh.trad@inria.fr <http://inria.fr/>
    Home page: http://www-rocq.inria.fr/who/Mohamed.Trad/
    <http://www-rocq.inria.fr/%7Etrad/>




    Le 15 nov. 2011 à 00:39, Hoot Thompson a écrit :
    Re: Mapreduce heap size error
    Still issues, around 2300 unique files....


    hadoop@lobster-nfs:~/querry$ hadoop jar HadoopTest.jar -D
    mapred.child.java.opts=-Xmx4096M
    hdfs://lobster-nfs:9000/hadoop_fs/dfs/merra/seq_out
    /hadoop_fs/dfs/output/test_111114_r2.out
    11/11/15 01:56:20 INFO hpc.Driver: Jar Name:
    /home/hadoop/querry/HadoopTest.jar
    0 [main] INFO nccs.hpc.Driver - Jar Name: /home/hadoop/querry/HadoopTest.jar
    0 [main] INFO nccs.hpc.Driver - Jar Name: /home/hadoop/querry/HadoopTest.jar
    11/11/15 01:56:20 WARN mapred.JobClient: Use GenericOptionsParser for parsing
    the arguments. Applications should implement Tool for the same.
    60 [main] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    60 [main] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    11/11/15 01:56:22 INFO input.FileInputFormat: Total input paths to process :
    2329
    2154 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat -
    Total input paths to process : 2329
    2154 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat -
    Total input paths to process : 2329
    11/11/15 01:56:24 INFO mapred.JobClient: Running job: job_201111150008_0003
    3693 [main] INFO org.apache.hadoop.mapred.JobClient - Running job:
    job_201111150008_0003
    3693 [main] INFO org.apache.hadoop.mapred.JobClient - Running job:
    job_201111150008_0003
    11/11/15 01:56:25 INFO mapred.JobClient: map 0% reduce 0%
    4696 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
    4696 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
    11/11/15 01:58:03 INFO mapred.JobClient: map 1% reduce 0%
    102916 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
    102916 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
    11/11/15 01:59:07 INFO mapred.JobClient: map 2% reduce 0%
    167042 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
    167042 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
    11/11/15 02:00:12 INFO mapred.JobClient: map 3% reduce 0%
    232168 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
    232168 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
    11/11/15 02:01:18 INFO mapred.JobClient: map 4% reduce 0%
    298290 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
    298290 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
    11/11/15 02:02:21 INFO mapred.JobClient: map 5% reduce 0%
    361418 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
    361418 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
    11/11/15 02:02:51 INFO mapred.JobClient: Task Id :
    attempt_201111150008_0003_r_000000_0, Status : FAILED
    391477 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
    attempt_201111150008_0003_r_000000_0, Status : FAILED
    391477 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
    attempt_201111150008_0003_r_000000_0, Status : FAILED
    Error: java.lang.OutOfMemoryError: Java heap space
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.shuffleInMem
    ory(ReduceTask.java:1685)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput
    (ReduceTask.java:1545)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(R
    educeTask.java:1394)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTa
    sk.java:1326)



    On 11/14/11 8:23 PM, "Mohamed Riadh Trad" <Mohamed.trad@inria.fr
    wrote:
    -D mapred.child.java.opts=-Xmx4096M
  • Hoot Thompson at Nov 15, 2011 at 3:54 pm
    Is there a good way to get logging enabled so I can get a better idea of
    what¹s going on? I¹m starting to think that the ³heap² error is not the
    systemic problem. I have changed heap related parameters and can¹t seem to
    fix or even change the error conditions.



    On 11/15/11 4:53 AM, "Mohamed Riadh Trad" wrote:

    java -version

    to check if the java you are using is a 32 bits or 64 bits version.

    If you are using a 32bits version you cannot allow more than 3,5 Gbyte for the
    heap.


    Trad Mohamed Riadh, M.Sc, Ing.
    PhD. student
    INRIA-TELECOM PARISTECH - ENPC School of International Management

    Office: 11-15
    Phone: (33)-1 39 63 59 33
    Fax: (33)-1 39 63 56 74
    Email: riadh.trad@inria.fr <http://inria.fr/>
    Home page: http://www-rocq.inria.fr/who/Mohamed.Trad/
    <http://www-rocq.inria.fr/%7Etrad/>




    Le 15 nov. 2011 à 00:39, Hoot Thompson a écrit :
    Re: Mapreduce heap size error
    Still issues, around 2300 unique files....


    hadoop@lobster-nfs:~/querry$ hadoop jar HadoopTest.jar -D
    mapred.child.java.opts=-Xmx4096M
    hdfs://lobster-nfs:9000/hadoop_fs/dfs/merra/seq_out
    /hadoop_fs/dfs/output/test_111114_r2.out
    11/11/15 01:56:20 INFO hpc.Driver: Jar Name:
    /home/hadoop/querry/HadoopTest.jar
    0 [main] INFO nccs.hpc.Driver - Jar Name: /home/hadoop/querry/HadoopTest.jar
    0 [main] INFO nccs.hpc.Driver - Jar Name: /home/hadoop/querry/HadoopTest.jar
    11/11/15 01:56:20 WARN mapred.JobClient: Use GenericOptionsParser for parsing
    the arguments. Applications should implement Tool for the same.
    60 [main] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    60 [main] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    11/11/15 01:56:22 INFO input.FileInputFormat: Total input paths to process :
    2329
    2154 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat -
    Total input paths to process : 2329
    2154 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat -
    Total input paths to process : 2329
    11/11/15 01:56:24 INFO mapred.JobClient: Running job: job_201111150008_0003
    3693 [main] INFO org.apache.hadoop.mapred.JobClient - Running job:
    job_201111150008_0003
    3693 [main] INFO org.apache.hadoop.mapred.JobClient - Running job:
    job_201111150008_0003
    11/11/15 01:56:25 INFO mapred.JobClient: map 0% reduce 0%
    4696 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
    4696 [main] INFO org.apache.hadoop.mapred.JobClient - map 0% reduce 0%
    11/11/15 01:58:03 INFO mapred.JobClient: map 1% reduce 0%
    102916 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
    102916 [main] INFO org.apache.hadoop.mapred.JobClient - map 1% reduce 0%
    11/11/15 01:59:07 INFO mapred.JobClient: map 2% reduce 0%
    167042 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
    167042 [main] INFO org.apache.hadoop.mapred.JobClient - map 2% reduce 0%
    11/11/15 02:00:12 INFO mapred.JobClient: map 3% reduce 0%
    232168 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
    232168 [main] INFO org.apache.hadoop.mapred.JobClient - map 3% reduce 0%
    11/11/15 02:01:18 INFO mapred.JobClient: map 4% reduce 0%
    298290 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
    298290 [main] INFO org.apache.hadoop.mapred.JobClient - map 4% reduce 0%
    11/11/15 02:02:21 INFO mapred.JobClient: map 5% reduce 0%
    361418 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
    361418 [main] INFO org.apache.hadoop.mapred.JobClient - map 5% reduce 0%
    11/11/15 02:02:51 INFO mapred.JobClient: Task Id :
    attempt_201111150008_0003_r_000000_0, Status : FAILED
    391477 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
    attempt_201111150008_0003_r_000000_0, Status : FAILED
    391477 [main] INFO org.apache.hadoop.mapred.JobClient - Task Id :
    attempt_201111150008_0003_r_000000_0, Status : FAILED
    Error: java.lang.OutOfMemoryError: Java heap space
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.shuffleInMem
    ory(ReduceTask.java:1685)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput
    (ReduceTask.java:1545)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(R
    educeTask.java:1394)
    at
    org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTa
    sk.java:1326)



    On 11/14/11 8:23 PM, "Mohamed Riadh Trad" <Mohamed.trad@inria.fr
    wrote:
    -D mapred.child.java.opts=-Xmx4096M

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupmapreduce-user @
categorieshadoop
postedNov 12, '11 at 11:32p
activeNov 15, '11 at 3:54p
posts9
users3
websitehadoop.apache.org...
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase