Grokbase › Groups › Hadoop › scm-users › April 2013
FAQ
Hello,

I have configured flume service through cloudera manager. Through my
custom sink class, i am printing some logging to stdout.

Through the cloudera manager, the stdout.log is not complete. As more
logging through system.out, the beginning of the log data is not shown in
the stdout.log from clouder manager.

Where does the cloudera manager stores the whole stdout.log for individual
services.

I am able to find the the flume log at /var/log/flume-ng/.....

but unable to find the complete stdout.log neither on flume host or
clouders manager installed host.

When you mouse hover, the path it shows a Rest API call


Thanks
Madhu

Search Discussions

  • Vikram Srivastava at Apr 10, 2013 at 4:22 am ⇧
    You can goto the Flume Agent's role page and under the "Processes" tab, you
    can find stdout.log.
    On Tue, Apr 9, 2013 at 9:04 PM, Madhu M wrote:

    Hello,

    I have configured flume service through cloudera manager. Through my
    custom sink class, i am printing some logging to stdout.

    Through the cloudera manager, the stdout.log is not complete. As more
    logging through system.out, the beginning of the log data is not shown in
    the stdout.log from clouder manager.

    Where does the cloudera manager stores the whole stdout.log for individual
    services.

    I am able to find the the flume log at /var/log/flume-ng/.....

    but unable to find the complete stdout.log neither on flume host or
    clouders manager installed host.

    When you mouse hover, the path it shows a Rest API call


    Thanks
    Madhu
  • Madhu M at Apr 10, 2013 at 4:29 am ⇧
    Vikram,

    I am aware of that location. But the issue is when i open the stdout.log
    from cloudera manager, it doesn't have all the system.out i have printed.
    so i would like to find if there is any rolling for stdout.log some where
    on the server where cloudera manager reads this stdout.log.


    Thanks
    Madhu

    On Tuesday, April 9, 2013 11:22:38 PM UTC-5, Vikram Srivastava wrote:

    You can goto the Flume Agent's role page and under the "Processes" tab,
    you can find stdout.log.

    On Tue, Apr 9, 2013 at 9:04 PM, Madhu M <madhu.m...@gmail.com<javascript:>
    wrote:
    Hello,

    I have configured flume service through cloudera manager. Through my
    custom sink class, i am printing some logging to stdout.

    Through the cloudera manager, the stdout.log is not complete. As more
    logging through system.out, the beginning of the log data is not shown in
    the stdout.log from clouder manager.

    Where does the cloudera manager stores the whole stdout.log for
    individual services.

    I am able to find the the flume log at /var/log/flume-ng/.....

    but unable to find the complete stdout.log neither on flume host or
    clouders manager installed host.

    When you mouse hover, the path it shows a Rest API call


    Thanks
    Madhu
  • Vikram Srivastava at Apr 10, 2013 at 4:37 am ⇧
    I see what you mean. I don't think there is a log for any system.out
    statements in your custom sink. However, if you use normal log4j logging,
    these statements should start showing up in flume agent's logs.
    On Tue, Apr 9, 2013 at 9:29 PM, Madhu M wrote:

    Vikram,

    I am aware of that location. But the issue is when i open the stdout.log
    from cloudera manager, it doesn't have all the system.out i have printed.
    so i would like to find if there is any rolling for stdout.log some where
    on the server where cloudera manager reads this stdout.log.


    Thanks
    Madhu

    On Tuesday, April 9, 2013 11:22:38 PM UTC-5, Vikram Srivastava wrote:

    You can goto the Flume Agent's role page and under the "Processes" tab,
    you can find stdout.log.
    On Tue, Apr 9, 2013 at 9:04 PM, Madhu M wrote:

    Hello,

    I have configured flume service through cloudera manager. Through my
    custom sink class, i am printing some logging to stdout.

    Through the cloudera manager, the stdout.log is not complete. As more
    logging through system.out, the beginning of the log data is not shown in
    the stdout.log from clouder manager.

    Where does the cloudera manager stores the whole stdout.log for
    individual services.

    I am able to find the the flume log at /var/log/flume-ng/.....

    but unable to find the complete stdout.log neither on flume host or
    clouders manager installed host.

    When you mouse hover, the path it shows a Rest API call


    Thanks
    Madhu
  • Madhu Gmail at Apr 10, 2013 at 4:59 am ⇧
    Thanks Vikram. I will have the regular logging.

    Thanks

    Madhu Munagala
    (214)679-2872
    On Apr 9, 2013, at 11:37 PM, Vikram Srivastava wrote:

    I see what you mean. I don't think there is a log for any system.out statements in your custom sink. However, if you use normal log4j logging, these statements should start showing up in flume agent's logs.
    On Tue, Apr 9, 2013 at 9:29 PM, Madhu M wrote:
    Vikram,

    I am aware of that location. But the issue is when i open the stdout.log from cloudera manager, it doesn't have all the system.out i have printed. so i would like to find if there is any rolling for stdout.log some where on the server where cloudera manager reads this stdout.log.


    Thanks
    Madhu

    On Tuesday, April 9, 2013 11:22:38 PM UTC-5, Vikram Srivastava wrote:
    You can goto the Flume Agent's role page and under the "Processes" tab, you can find stdout.log.
    On Tue, Apr 9, 2013 at 9:04 PM, Madhu M wrote:
    Hello,

    I have configured flume service through cloudera manager. Through my custom sink class, i am printing some logging to stdout.

    Through the cloudera manager, the stdout.log is not complete. As more logging through system.out, the beginning of the log data is not shown in the stdout.log from clouder manager.

    Where does the cloudera manager stores the whole stdout.log for individual services.

    I am able to find the the flume log at /var/log/flume-ng/.....

    but unable to find the complete stdout.log neither on flume host or clouders manager installed host.

    When you mouse hover, the path it shows a Rest API call


    Thanks
    Madhu

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedApr 10, '13 at 4:04a
activeApr 10, '13 at 4:59a
posts5
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Madhu Gmail: 3 posts Vikram Srivastava: 2 posts

Content

People

Support

Translate

site design / logo © 2022 Grokbase