Grokbase › Groups › Hadoop › common-user › September 2009
FAQ
Hi.

I get a strange error in Hadoop 0.18.3 (Cloudera) while I am trying to run a streaming job.
The error is: "ERROR streaming.StreamJob: Unexpected -D while processing -input|-output|-mapper|-combiner|-reducer| etc etc etc"
If I remove all -D parameters the job is accepted by Hadoop. However, I still have a warning: "WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same."

Anybody knows what this means?
Thanks

Search Discussions

  • Matt Massie at Sep 30, 2009 at 4:10 pm ⇧
    Gabriel-

    Removing the -D is the right thing to do. The warning re:
    GenericOptionsParser can be safely ignored.

    If you want more info about the warning to put your mind at ease, take a look at
    src/mapred/org/apache/hadoop/mapred/JobClient.java (line 1550 for
    context on the warning)
    src/core/org/apache/hadoop/util/Tool.java (for the Tool interface)

    -Matt
    On Wed, Sep 30, 2009 at 8:29 AM, Gabriel Moraru wrote:
    Hi.

    I get a strange error in Hadoop 0.18.3 (Cloudera) while I am trying to run a streaming job.
    The error is: "ERROR streaming.StreamJob: Unexpected -D while processing -input|-output|-mapper|-combiner|-reducer| etc etc etc"
    If I remove all -D parameters the job is accepted by Hadoop. However, I still have a warning: "WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same."

    Anybody knows what this means?
    Thanks

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedSep 30, '09 at 3:40p
activeSep 30, '09 at 4:10p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Gabriel Moraru: 1 post Matt Massie: 1 post

Content

People

Support

Translate

site design / logo © 2023 Grokbase