FAQ
Hello Friends,
I am seeing Hadoop log timestamps & file timestamps not same as system
time. I found that this problem was discussed on on mailing list earlier but
there was no solution posted.

http://www.mail-archive.com/hdfs-user@hadoop.apache.org/msg00310.html

I am wondering what is causing this behaviour and how to fix it.

As you can see below system time is in UTC and Hadoop is showing EST.

[hadoop@hadoop~]$ date
Mon Jan 10 21:54:17 UTC 2011

[hadoop@hadoop ~]$ hadoop jar $HADOOP_HOME/*examples.jar teragen 1000
tera-dir
Generating 1000 using 2 maps with step of 500
11/01/10 16:50:33 INFO mapred.JobClient: Running job: job_201101061958_2590
11/01/10 16:50:34 INFO mapred.JobClient: map 0% reduce 0%
11/01/10 16:50:40 INFO mapred.JobClient: map 100% reduce 0%
11/01/10 16:50:40 INFO mapred.JobClient: Job complete: job_201101061958_2590
11/01/10 16:50:40 INFO mapred.JobClient: Counters: 6
11/01/10 16:50:40 INFO mapred.JobClient: Job Counters
11/01/10 16:50:40 INFO mapred.JobClient: Launched map tasks=2
11/01/10 16:50:40 INFO mapred.JobClient: FileSystemCounters

I thought possible workaround for this issue to add -Duser.timezone in
conf/hadoop-env.sh but it works only on my localsystem but not on cluster.

Why is hadoop reporting wrong EST time format? From where hadoop reads time?

Any help is greatly appreciated.
Thanks in advance,
Ravi

Search Discussions

  • Owen O'Malley at Jan 11, 2011 at 6:42 pm

    On Mon, Jan 10, 2011 at 11:23 PM, Ravi Phulari wrote:

    Hello Friends,
    I am seeing Hadoop log timestamps & file timestamps not same as system
    time.

    Please use common-user for general usage questions. General is for
    announcements and discussions about the project.

    Thanks,
    Owen

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupmapreduce-user @
categorieshadoop
postedJan 11, '11 at 7:24a
activeJan 11, '11 at 6:42p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Owen O'Malley: 1 post Ravi Phulari: 1 post

People

Translate

site design / logo © 2022 Grokbase