FAQ
Hi Guys,

We have using CM-4.0.4 we have problem with JobTracker Retire Job Interval
(milliseconds) 86400000 [1 day] *mapred.jobtracker.retirejob.interval=
86400000. *We configured keep one day log only. What I have seen the job
tracker page, all job history available.

It's any way to debug, To understand CM configuration working fine.

Please guide me How to resolve this.

-Dhanasekaran.
Did I learn something today? If not, I wasted it.

Search Discussions

  • bc Wong at Feb 5, 2013 at 5:08 pm
    Do you see a lot of completed jobs? Retired jobs? Or job history? How many
    are there? And take a look at
    http://blog.cloudera.com/blog/2010/11/hadoop-log-location-and-retention/.

    Cheers,
    bc


    On Tue, Feb 5, 2013 at 7:50 AM, Dhanasekaran Anbalagan
    wrote:
    Hi Guys,

    We have using CM-4.0.4 we have problem with JobTracker Retire Job Interval
    (milliseconds) 86400000 [1 day] *mapred.jobtracker.retirejob.interval=
    86400000. *We configured keep one day log only. What I have seen the job
    tracker page, all job history available.

    It's any way to debug, To understand CM configuration working fine.

    Please guide me How to resolve this.

    -Dhanasekaran.
    Did I learn something today? If not, I wasted it.
  • Dhanasekaran Anbalagan at Feb 5, 2013 at 5:41 pm
    Hi bc Wong,

    We configured via CM.

    *mapred.jobtracker.retirejob.interval=86400000 [1 day]*
    mapred.jobtracker.completeuserjobs.maximum=5 [ job per user to retain ]

    It's correct. Other property we need to add. please guide me.

    -Dhanasekaran.




    Did I learn something today? If not, I wasted it.

    On Tue, Feb 5, 2013 at 12:07 PM, bc Wong wrote:

    Do you see a lot of completed jobs? Retired jobs? Or job history? How many
    are there? And take a look at
    http://blog.cloudera.com/blog/2010/11/hadoop-log-location-and-retention/.

    Cheers,
    bc


    On Tue, Feb 5, 2013 at 7:50 AM, Dhanasekaran Anbalagan <bugcy013@gmail.com
    wrote:
    Hi Guys,

    We have using CM-4.0.4 we have problem with JobTracker Retire Job
    Interval (milliseconds) 86400000 [1 day] *
    mapred.jobtracker.retirejob.interval=86400000. *We configured keep one
    day log only. What I have seen the job tracker page, all job history
    available.

    It's any way to debug, To understand CM configuration working fine.

    Please guide me How to resolve this.

    -Dhanasekaran.
    Did I learn something today? If not, I wasted it.
  • bc Wong at Feb 5, 2013 at 5:44 pm
    I need some more clarification. Do you see a lot of completed jobs? Retired
    jobs? Or job history? How many are there?

    On Tue, Feb 5, 2013 at 9:40 AM, Dhanasekaran Anbalagan
    wrote:
    Hi bc Wong,

    We configured via CM.

    *mapred.jobtracker.retirejob.interval=86400000 [1 day]*
    mapred.jobtracker.completeuserjobs.maximum=5 [ job per user to retain ]

    It's correct. Other property we need to add. please guide me.

    -Dhanasekaran.




    Did I learn something today? If not, I wasted it.

    On Tue, Feb 5, 2013 at 12:07 PM, bc Wong wrote:

    Do you see a lot of completed jobs? Retired jobs? Or job history? How
    many are there? And take a look at
    http://blog.cloudera.com/blog/2010/11/hadoop-log-location-and-retention/.

    Cheers,
    bc


    On Tue, Feb 5, 2013 at 7:50 AM, Dhanasekaran Anbalagan <
    bugcy013@gmail.com> wrote:
    Hi Guys,

    We have using CM-4.0.4 we have problem with JobTracker Retire Job
    Interval (milliseconds) 86400000 [1 day] *
    mapred.jobtracker.retirejob.interval=86400000. *We configured keep one
    day log only. What I have seen the job tracker page, all job history
    available.

    It's any way to debug, To understand CM configuration working fine.

    Please guide me How to resolve this.

    -Dhanasekaran.
    Did I learn something today? If not, I wasted it.
  • Dhanasekaran Anbalagan at Feb 5, 2013 at 6:00 pm
    HI bc,

    My console output for files location in logs.
    http://paste.ubuntu.com/1613556/

    JobHistory:
    http://i.imgur.com/jevUXUW.png

    In logs

    root@dvcliftonhera122:/var/log/hadoop-0.20-mapreduce# ls -ltr
    total 36203520
    -rw-r--r-- 1 mapred mapred 0 Jul 24 2012 SecurityAuth.audit
    -rw-r--r-- 1 mapred mapred 2340620 Aug 27 13:03
    hadoop-cmf-mapreduce1-JOBTRACKER-dvcliftonhera122.dv.net.log.out
    drwxr-xr-x 2 mapred mapred 4096 Sep 10 13:09 userlogs
    -rw-r--r-- 1 mapred mapred 11314 Sep 10 15:19
    hadoop-cmf-mapreduce1-TASKTRACKER-dvcliftonhera122.log.out
    -rw-r--r-- 1 mapred mapred 89777 Sep 18 14:08
    job_201209101529_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 89775 Sep 18 14:11
    job_201209101529_0005_conf.xml
    -rw-r--r-- 1 mapred mapred 89777 Sep 18 14:13
    job_201209101529_0006_conf.xml
    -rw-r--r-- 1 mapred mapred 89777 Sep 18 14:18
    job_201209101529_0007_conf.xml
    -rw-r--r-- 1 mapred mapred 89777 Sep 18 15:54
    job_201209101529_0008_conf.xml
    -rw-r--r-- 1 mapred mapred 105574 Sep 18 15:55
    job_201209101529_0009_conf.xml
    -rw-r--r-- 1 mapred mapred 53305 Sep 20 10:49
    job_201209201022_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 53305 Sep 20 11:01
    job_201209201055_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 53303 Sep 20 11:05
    job_201209201055_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 53305 Sep 20 11:14
    job_201209201055_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 53305 Sep 20 11:20
    job_201209201055_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 52964 Sep 20 12:22
    job_201209201216_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 52966 Sep 20 12:23
    job_201209201216_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 52966 Sep 20 12:25
    job_201209201216_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 54162 Sep 20 12:36
    job_201209201216_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 68679 Sep 21 10:05
    job_201209201216_0006_conf.xml
    -rw-r--r-- 1 mapred mapred 68580 Sep 24 15:01
    job_201209211016_0011_conf.xml
    -rw-r--r-- 1 mapred mapred 68291 Sep 24 15:06
    job_201209211016_0012_conf.xml
    -rw-r--r-- 1 mapred mapred 68580 Sep 24 15:12
    job_201209241510_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 68291 Sep 24 15:18
    job_201209241510_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 54162 Sep 25 13:50
    job_201209251310_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 83879 Sep 25 14:14
    job_201209251310_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 83893 Sep 25 14:16
    job_201209251310_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 71368 Sep 26 10:11
    job_201209251430_0016_conf.xml
    -rw-r--r-- 1 mapred mapred 71409 Sep 26 10:20
    job_201209251430_0017_conf.xml
    -rw-r--r-- 1 mapred mapred 78030 Sep 26 10:26
    job_201209251430_0018_conf.xml
    -rw-r--r-- 1 mapred mapred 82801 Sep 26 14:51
    job_201209251430_0019_conf.xml
    -rw-r--r-- 1 mapred mapred 82801 Sep 26 14:57
    job_201209251430_0020_conf.xml
    -rw-r--r-- 1 mapred mapred 82815 Sep 27 07:46
    job_201209261704_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 55953 Oct 10 13:11
    job_201210081053_0037_conf.xml
    -rw-r--r-- 1 mapred mapred 55955 Oct 10 13:16
    job_201210081053_0038_conf.xml
    -rw-r--r-- 1 mapred mapred 56768 Oct 10 14:30
    job_201210081053_0039_conf.xml
    -rw-r--r-- 1 mapred mapred 55945 Oct 10 14:35
    job_201210081053_0040_conf.xml
    -rw-r--r-- 1 mapred mapred 55954 Oct 10 15:17
    job_201210081053_0041_conf.xml
    -rw-r--r-- 1 mapred mapred 55955 Oct 10 15:49
    job_201210101524_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 70718 Oct 10 15:55
    job_201210101524_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 55951 Oct 10 15:57
    job_201210101524_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 55954 Oct 10 16:49
    job_201210101524_0005_conf.xml
    -rw-r--r-- 1 mapred mapred 55952 Oct 10 17:24
    job_201210101524_0006_conf.xml
    -rw-r--r-- 1 mapred mapred 56363 Oct 11 11:54
    job_201210101743_0023_conf.xml
    -rw-r--r-- 1 mapred mapred 55955 Oct 11 11:59
    job_201210101743_0024_conf.xml
    -rw-r--r-- 1 mapred mapred 56771 Oct 11 12:04
    job_201210101743_0026_conf.xml
    -rw-r--r-- 1 mapred mapred 56778 Oct 11 12:07
    job_201210101743_0028_conf.xml
    -rw-r--r-- 1 mapred mapred 53479 Oct 11 13:26
    job_201210101743_0029_conf.xml
    -rw-r--r-- 1 mapred mapred 53461 Oct 12 06:52
    job_201210111515_0068_conf.xml
    -rw-r--r-- 1 mapred mapred 68389 Oct 12 07:02
    job_201210111515_0069_conf.xml
    -rw-r--r-- 1 mapred mapred 68390 Oct 12 07:14
    job_201210111515_0070_conf.xml
    -rw-r--r-- 1 mapred mapred 53633 Oct 12 08:28
    job_201210111515_0071_conf.xml
    -rw-r--r-- 1 mapred mapred 56613 Oct 12 08:39
    job_201210111515_0072_conf.xml
    -rw-r--r-- 1 mapred mapred 56778 Oct 12 10:07
    job_201210111515_0073_conf.xml
    -rw-r--r-- 1 mapred mapred 60796 Oct 19 07:55
    job_201210151226_0065_conf.xml
    -rw-r--r-- 1 mapred mapred 56797 Oct 19 08:30
    job_201210151226_0068_conf.xml
    -rw-r--r-- 1 mapred mapred 56797 Oct 19 08:38
    job_201210151226_0069_conf.xml
    -rw-r--r-- 1 mapred mapred 60768 Oct 19 08:48
    job_201210151226_0070_conf.xml
    -rw-r--r-- 1 mapred mapred 60768 Oct 19 08:50
    job_201210151226_0071_conf.xml
    -rw-r--r-- 1 mapred mapred 56796 Oct 19 10:03
    job_201210190855_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56796 Oct 19 10:22
    job_201210191021_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56797 Oct 19 10:26
    job_201210191021_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 56796 Oct 19 10:27
    job_201210191021_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 56797 Oct 19 10:35
    job_201210191021_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 56788 Oct 19 16:28
    job_201210191547_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56792 Oct 19 17:50
    job_201210191547_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 56794 Oct 19 17:56
    job_201210191547_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 76108 Oct 22 15:38
    job_201210191759_0037_conf.xml
    -rw-r--r-- 1 mapred mapred 56218 Oct 22 15:51
    job_201210191759_0038_conf.xml
    -rw-r--r-- 1 mapred mapred 56220 Oct 22 16:07
    job_201210191759_0039_conf.xml
    -rw-r--r-- 1 mapred mapred 56795 Oct 22 16:25
    job_201210191759_0040_conf.xml
    -rw-r--r-- 1 mapred mapred 56218 Oct 22 16:33
    job_201210191759_0041_conf.xml
    -rw-r--r-- 1 mapred mapred 56786 Oct 22 17:23
    job_201210221722_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 77126 Oct 29 12:50
    job_201210221730_0134_conf.xml
    -rw-r--r-- 1 mapred mapred 827332 Oct 29 13:17
    job_201210221730_0137_conf.xml
    -rw-r--r-- 1 mapred mapred 56219 Oct 29 14:37
    job_201210221730_0138_conf.xml
    -rw-r--r-- 1 mapred mapred 56219 Oct 29 14:40
    job_201210221730_0139_conf.xml
    -rw-r--r-- 1 mapred mapred 56222 Oct 29 14:46
    job_201210221730_0140_conf.xml
    -rw-r--r-- 1 mapred mapred 56222 Oct 29 14:58
    job_201210291456_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56220 Oct 29 15:01
    job_201210291459_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56222 Oct 29 15:02
    job_201210291459_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 827312 Oct 30 02:12
    job_201210291512_0014_conf.xml
    -rw-r--r-- 1 mapred mapred 60651 Oct 30 04:02
    job_201210291512_0016_conf.xml
    -rw-r--r-- 1 mapred mapred 60768 Oct 30 04:43
    job_201210291512_0017_conf.xml
    -rw-r--r-- 1 mapred mapred 60768 Oct 30 05:26
    job_201210291512_0018_conf.xml
    -rw-r--r-- 1 mapred mapred 827312 Oct 30 06:18
    job_201210291512_0019_conf.xml
    -rw-r--r-- 1 mapred mapred 73089 Oct 30 06:20
    job_201210291512_0020_conf.xml
    -rw-r--r-- 1 mapred mapred 73089 Oct 30 06:34
    job_201210291512_0021_conf.xml
    -rw-r--r-- 1 mapred mapred 827312 Oct 30 07:13
    job_201210300658_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 73089 Oct 30 07:31
    job_201210300658_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 60731 Oct 30 07:52
    job_201210300658_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 76876 Oct 30 10:34
    job_201210301029_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 71314 Oct 30 13:29
    job_201210301029_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 71314 Oct 30 14:06
    job_201210301345_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 71314 Oct 30 14:10
    job_201210301345_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 71314 Oct 30 14:23
    job_201210301422_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 71320 Oct 30 14:55
    job_201210301422_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 71320 Oct 30 14:59
    job_201210301422_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 60880 Nov 1 08:38
    job_201210301712_0159_conf.xml
    -rw-r--r-- 1 mapred mapred 60699 Nov 1 08:38
    job_201210301712_0161_conf.xml
    -rw-r--r-- 1 mapred mapred 83477 Nov 1 08:38
    job_201210301712_0162_conf.xml
    -rw-r--r-- 1 mapred mapred 60806 Nov 1 08:38
    job_201210301712_0163_conf.xml
    -rw-r--r-- 1 mapred mapred 83459 Nov 1 08:38
    job_201210301712_0164_conf.xml
    -rw-r--r-- 1 mapred mapred 68203 Nov 9 13:08
    job_201211010945_2298_conf.xml
    -rw-r--r-- 1 mapred mapred 83471 Nov 9 13:12
    job_201211010945_2309_conf.xml
    -rw-r--r-- 1 mapred mapred 60800 Nov 9 13:12
    job_201211010945_2310_conf.xml
    -rw-r--r-- 1 mapred mapred 83453 Nov 9 13:12
    job_201211010945_2311_conf.xml
    -rw-r--r-- 1 mapred mapred 68204 Nov 9 13:16
    job_201211010945_2312_conf.xml
    -rw-r--r-- 1 mapred mapred 60877 Nov 16 13:47
    job_201211091329_4192_conf.xml
    -rw-r--r-- 1 mapred mapred 60700 Nov 16 13:48
    job_201211091329_4194_conf.xml


    When I restart the job tracker some the lob will deleted, It's doing CM

    Please how to debug this.?

    -Dhanaseakaran.

    Did I learn something today? If not, I wasted it.

    On Tue, Feb 5, 2013 at 12:44 PM, bc Wong wrote:

    I need some more clarification. Do you see a lot of completed jobs?
    Retired jobs? Or job history? How many are there?


    On Tue, Feb 5, 2013 at 9:40 AM, Dhanasekaran Anbalagan <bugcy013@gmail.com
    wrote:
    Hi bc Wong,

    We configured via CM.

    *mapred.jobtracker.retirejob.interval=86400000 [1 day]*
    mapred.jobtracker.completeuserjobs.maximum=5 [ job per user to retain ]

    It's correct. Other property we need to add. please guide me.

    -Dhanasekaran.




    Did I learn something today? If not, I wasted it.

    On Tue, Feb 5, 2013 at 12:07 PM, bc Wong wrote:

    Do you see a lot of completed jobs? Retired jobs? Or job history? How
    many are there? And take a look at
    http://blog.cloudera.com/blog/2010/11/hadoop-log-location-and-retention/
    .

    Cheers,
    bc


    On Tue, Feb 5, 2013 at 7:50 AM, Dhanasekaran Anbalagan <
    bugcy013@gmail.com> wrote:
    Hi Guys,

    We have using CM-4.0.4 we have problem with JobTracker Retire Job
    Interval (milliseconds) 86400000 [1 day] *
    mapred.jobtracker.retirejob.interval=86400000. *We configured keep one
    day log only. What I have seen the job tracker page, all job history
    available.

    It's any way to debug, To understand CM configuration working fine.

    Please guide me How to resolve this.

    -Dhanasekaran.
    Did I learn something today? If not, I wasted it.
  • bc Wong at Feb 5, 2013 at 9:50 pm
    What CDH version are you using? You may have hit a known issue. Moving to
    cdh-user. They can provide more info.

    Cheers,
    bc

    On Tue, Feb 5, 2013 at 9:59 AM, Dhanasekaran Anbalagan
    wrote:
    HI bc,

    My console output for files location in logs.
    http://paste.ubuntu.com/1613556/

    JobHistory:
    http://i.imgur.com/jevUXUW.png

    In logs

    root@dvcliftonhera122:/var/log/hadoop-0.20-mapreduce# ls -ltr
    total 36203520
    -rw-r--r-- 1 mapred mapred 0 Jul 24 2012 SecurityAuth.audit
    -rw-r--r-- 1 mapred mapred 2340620 Aug 27 13:03
    hadoop-cmf-mapreduce1-JOBTRACKER-dvcliftonhera122.dv.net.log.out
    drwxr-xr-x 2 mapred mapred 4096 Sep 10 13:09 userlogs
    -rw-r--r-- 1 mapred mapred 11314 Sep 10 15:19
    hadoop-cmf-mapreduce1-TASKTRACKER-dvcliftonhera122.log.out
    -rw-r--r-- 1 mapred mapred 89777 Sep 18 14:08
    job_201209101529_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 89775 Sep 18 14:11
    job_201209101529_0005_conf.xml
    -rw-r--r-- 1 mapred mapred 89777 Sep 18 14:13
    job_201209101529_0006_conf.xml
    -rw-r--r-- 1 mapred mapred 89777 Sep 18 14:18
    job_201209101529_0007_conf.xml
    -rw-r--r-- 1 mapred mapred 89777 Sep 18 15:54
    job_201209101529_0008_conf.xml
    -rw-r--r-- 1 mapred mapred 105574 Sep 18 15:55
    job_201209101529_0009_conf.xml
    -rw-r--r-- 1 mapred mapred 53305 Sep 20 10:49
    job_201209201022_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 53305 Sep 20 11:01
    job_201209201055_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 53303 Sep 20 11:05
    job_201209201055_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 53305 Sep 20 11:14
    job_201209201055_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 53305 Sep 20 11:20
    job_201209201055_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 52964 Sep 20 12:22
    job_201209201216_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 52966 Sep 20 12:23
    job_201209201216_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 52966 Sep 20 12:25
    job_201209201216_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 54162 Sep 20 12:36
    job_201209201216_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 68679 Sep 21 10:05
    job_201209201216_0006_conf.xml
    -rw-r--r-- 1 mapred mapred 68580 Sep 24 15:01
    job_201209211016_0011_conf.xml
    -rw-r--r-- 1 mapred mapred 68291 Sep 24 15:06
    job_201209211016_0012_conf.xml
    -rw-r--r-- 1 mapred mapred 68580 Sep 24 15:12
    job_201209241510_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 68291 Sep 24 15:18
    job_201209241510_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 54162 Sep 25 13:50
    job_201209251310_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 83879 Sep 25 14:14
    job_201209251310_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 83893 Sep 25 14:16
    job_201209251310_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 71368 Sep 26 10:11
    job_201209251430_0016_conf.xml
    -rw-r--r-- 1 mapred mapred 71409 Sep 26 10:20
    job_201209251430_0017_conf.xml
    -rw-r--r-- 1 mapred mapred 78030 Sep 26 10:26
    job_201209251430_0018_conf.xml
    -rw-r--r-- 1 mapred mapred 82801 Sep 26 14:51
    job_201209251430_0019_conf.xml
    -rw-r--r-- 1 mapred mapred 82801 Sep 26 14:57
    job_201209251430_0020_conf.xml
    -rw-r--r-- 1 mapred mapred 82815 Sep 27 07:46
    job_201209261704_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 55953 Oct 10 13:11
    job_201210081053_0037_conf.xml
    -rw-r--r-- 1 mapred mapred 55955 Oct 10 13:16
    job_201210081053_0038_conf.xml
    -rw-r--r-- 1 mapred mapred 56768 Oct 10 14:30
    job_201210081053_0039_conf.xml
    -rw-r--r-- 1 mapred mapred 55945 Oct 10 14:35
    job_201210081053_0040_conf.xml
    -rw-r--r-- 1 mapred mapred 55954 Oct 10 15:17
    job_201210081053_0041_conf.xml
    -rw-r--r-- 1 mapred mapred 55955 Oct 10 15:49
    job_201210101524_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 70718 Oct 10 15:55
    job_201210101524_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 55951 Oct 10 15:57
    job_201210101524_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 55954 Oct 10 16:49
    job_201210101524_0005_conf.xml
    -rw-r--r-- 1 mapred mapred 55952 Oct 10 17:24
    job_201210101524_0006_conf.xml
    -rw-r--r-- 1 mapred mapred 56363 Oct 11 11:54
    job_201210101743_0023_conf.xml
    -rw-r--r-- 1 mapred mapred 55955 Oct 11 11:59
    job_201210101743_0024_conf.xml
    -rw-r--r-- 1 mapred mapred 56771 Oct 11 12:04
    job_201210101743_0026_conf.xml
    -rw-r--r-- 1 mapred mapred 56778 Oct 11 12:07
    job_201210101743_0028_conf.xml
    -rw-r--r-- 1 mapred mapred 53479 Oct 11 13:26
    job_201210101743_0029_conf.xml
    -rw-r--r-- 1 mapred mapred 53461 Oct 12 06:52
    job_201210111515_0068_conf.xml
    -rw-r--r-- 1 mapred mapred 68389 Oct 12 07:02
    job_201210111515_0069_conf.xml
    -rw-r--r-- 1 mapred mapred 68390 Oct 12 07:14
    job_201210111515_0070_conf.xml
    -rw-r--r-- 1 mapred mapred 53633 Oct 12 08:28
    job_201210111515_0071_conf.xml
    -rw-r--r-- 1 mapred mapred 56613 Oct 12 08:39
    job_201210111515_0072_conf.xml
    -rw-r--r-- 1 mapred mapred 56778 Oct 12 10:07
    job_201210111515_0073_conf.xml
    -rw-r--r-- 1 mapred mapred 60796 Oct 19 07:55
    job_201210151226_0065_conf.xml
    -rw-r--r-- 1 mapred mapred 56797 Oct 19 08:30
    job_201210151226_0068_conf.xml
    -rw-r--r-- 1 mapred mapred 56797 Oct 19 08:38
    job_201210151226_0069_conf.xml
    -rw-r--r-- 1 mapred mapred 60768 Oct 19 08:48
    job_201210151226_0070_conf.xml
    -rw-r--r-- 1 mapred mapred 60768 Oct 19 08:50
    job_201210151226_0071_conf.xml
    -rw-r--r-- 1 mapred mapred 56796 Oct 19 10:03
    job_201210190855_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56796 Oct 19 10:22
    job_201210191021_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56797 Oct 19 10:26
    job_201210191021_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 56796 Oct 19 10:27
    job_201210191021_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 56797 Oct 19 10:35
    job_201210191021_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 56788 Oct 19 16:28
    job_201210191547_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56792 Oct 19 17:50
    job_201210191547_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 56794 Oct 19 17:56
    job_201210191547_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 76108 Oct 22 15:38
    job_201210191759_0037_conf.xml
    -rw-r--r-- 1 mapred mapred 56218 Oct 22 15:51
    job_201210191759_0038_conf.xml
    -rw-r--r-- 1 mapred mapred 56220 Oct 22 16:07
    job_201210191759_0039_conf.xml
    -rw-r--r-- 1 mapred mapred 56795 Oct 22 16:25
    job_201210191759_0040_conf.xml
    -rw-r--r-- 1 mapred mapred 56218 Oct 22 16:33
    job_201210191759_0041_conf.xml
    -rw-r--r-- 1 mapred mapred 56786 Oct 22 17:23
    job_201210221722_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 77126 Oct 29 12:50
    job_201210221730_0134_conf.xml
    -rw-r--r-- 1 mapred mapred 827332 Oct 29 13:17
    job_201210221730_0137_conf.xml
    -rw-r--r-- 1 mapred mapred 56219 Oct 29 14:37
    job_201210221730_0138_conf.xml
    -rw-r--r-- 1 mapred mapred 56219 Oct 29 14:40
    job_201210221730_0139_conf.xml
    -rw-r--r-- 1 mapred mapred 56222 Oct 29 14:46
    job_201210221730_0140_conf.xml
    -rw-r--r-- 1 mapred mapred 56222 Oct 29 14:58
    job_201210291456_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56220 Oct 29 15:01
    job_201210291459_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 56222 Oct 29 15:02
    job_201210291459_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 827312 Oct 30 02:12
    job_201210291512_0014_conf.xml
    -rw-r--r-- 1 mapred mapred 60651 Oct 30 04:02
    job_201210291512_0016_conf.xml
    -rw-r--r-- 1 mapred mapred 60768 Oct 30 04:43
    job_201210291512_0017_conf.xml
    -rw-r--r-- 1 mapred mapred 60768 Oct 30 05:26
    job_201210291512_0018_conf.xml
    -rw-r--r-- 1 mapred mapred 827312 Oct 30 06:18
    job_201210291512_0019_conf.xml
    -rw-r--r-- 1 mapred mapred 73089 Oct 30 06:20
    job_201210291512_0020_conf.xml
    -rw-r--r-- 1 mapred mapred 73089 Oct 30 06:34
    job_201210291512_0021_conf.xml
    -rw-r--r-- 1 mapred mapred 827312 Oct 30 07:13
    job_201210300658_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 73089 Oct 30 07:31
    job_201210300658_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 60731 Oct 30 07:52
    job_201210300658_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 76876 Oct 30 10:34
    job_201210301029_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 71314 Oct 30 13:29
    job_201210301029_0004_conf.xml
    -rw-r--r-- 1 mapred mapred 71314 Oct 30 14:06
    job_201210301345_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 71314 Oct 30 14:10
    job_201210301345_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 71314 Oct 30 14:23
    job_201210301422_0001_conf.xml
    -rw-r--r-- 1 mapred mapred 71320 Oct 30 14:55
    job_201210301422_0002_conf.xml
    -rw-r--r-- 1 mapred mapred 71320 Oct 30 14:59
    job_201210301422_0003_conf.xml
    -rw-r--r-- 1 mapred mapred 60880 Nov 1 08:38
    job_201210301712_0159_conf.xml
    -rw-r--r-- 1 mapred mapred 60699 Nov 1 08:38
    job_201210301712_0161_conf.xml
    -rw-r--r-- 1 mapred mapred 83477 Nov 1 08:38
    job_201210301712_0162_conf.xml
    -rw-r--r-- 1 mapred mapred 60806 Nov 1 08:38
    job_201210301712_0163_conf.xml
    -rw-r--r-- 1 mapred mapred 83459 Nov 1 08:38
    job_201210301712_0164_conf.xml
    -rw-r--r-- 1 mapred mapred 68203 Nov 9 13:08
    job_201211010945_2298_conf.xml
    -rw-r--r-- 1 mapred mapred 83471 Nov 9 13:12
    job_201211010945_2309_conf.xml
    -rw-r--r-- 1 mapred mapred 60800 Nov 9 13:12
    job_201211010945_2310_conf.xml
    -rw-r--r-- 1 mapred mapred 83453 Nov 9 13:12
    job_201211010945_2311_conf.xml
    -rw-r--r-- 1 mapred mapred 68204 Nov 9 13:16
    job_201211010945_2312_conf.xml
    -rw-r--r-- 1 mapred mapred 60877 Nov 16 13:47
    job_201211091329_4192_conf.xml
    -rw-r--r-- 1 mapred mapred 60700 Nov 16 13:48
    job_201211091329_4194_conf.xml


    When I restart the job tracker some the lob will deleted, It's doing CM

    Please how to debug this.?

    -Dhanaseakaran.

    Did I learn something today? If not, I wasted it.

    On Tue, Feb 5, 2013 at 12:44 PM, bc Wong wrote:

    I need some more clarification. Do you see a lot of completed jobs?
    Retired jobs? Or job history? How many are there?


    On Tue, Feb 5, 2013 at 9:40 AM, Dhanasekaran Anbalagan <
    bugcy013@gmail.com> wrote:
    Hi bc Wong,

    We configured via CM.

    *mapred.jobtracker.retirejob.interval=86400000 [1 day]*
    mapred.jobtracker.completeuserjobs.maximum=5 [ job per user to retain ]

    It's correct. Other property we need to add. please guide me.

    -Dhanasekaran.




    Did I learn something today? If not, I wasted it.

    On Tue, Feb 5, 2013 at 12:07 PM, bc Wong wrote:

    Do you see a lot of completed jobs? Retired jobs? Or job history? How
    many are there? And take a look at
    http://blog.cloudera.com/blog/2010/11/hadoop-log-location-and-retention/
    .

    Cheers,
    bc


    On Tue, Feb 5, 2013 at 7:50 AM, Dhanasekaran Anbalagan <
    bugcy013@gmail.com> wrote:
    Hi Guys,

    We have using CM-4.0.4 we have problem with JobTracker Retire Job
    Interval (milliseconds) 86400000 [1 day] *
    mapred.jobtracker.retirejob.interval=86400000. *We configured keep
    one day log only. What I have seen the job tracker page, all job history
    available.

    It's any way to debug, To understand CM configuration working fine.

    Please guide me How to resolve this.

    -Dhanasekaran.
    Did I learn something today? If not, I wasted it.
  • Dvohra at Jun 12, 2013 at 10:59 pm
    *mapred.jobtracker.retirejob.interval is supported in pre 0.20.1 version
    only.*
    On Tuesday, February 5, 2013 7:50:12 AM UTC-8, Dhanasekaran Anbalagan wrote:

    Hi Guys,

    We have using CM-4.0.4 we have problem with JobTracker Retire Job Interval
    (milliseconds) 86400000 [1 day] *mapred.jobtracker.retirejob.interval=
    86400000. *We configured keep one day log only. What I have seen the job
    tracker page, all job history available.

    It's any way to debug, To understand CM configuration working fine.

    Please guide me How to resolve this.

    -Dhanasekaran.
    Did I learn something today? If not, I wasted it.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedFeb 5, '13 at 3:58p
activeJun 12, '13 at 10:59p
posts7
users3
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase