Grokbase Groups Pig user March 2010
FAQ
Hi,

I suddenly started getting this error and I don't understand why since the
input path exists on the dfs. It started a couple of days ago when I checked
out trunk again (the previous working version was checked out about two
weeks ago). I'm working on hadoop 0.20.1.

The log file shows:
Backend error message during job submission
-------------------------------------------
org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Unable to
create input splits for: hdfs://ips-h01:54310/user/tkamara/report/20090301
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:256)
at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)
at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378)
at
org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247)
at
org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279)
at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException:
Input path does not exist: hdfs://ips-h01:54310/user/tkamara/report/20090301
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:224)
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:245)
... 7 more

Do you know why it happens?

Thanks,
Tamir

Search Discussions

  • Tamir Kamara at Mar 2, 2010 at 12:58 pm
    Hi,

    I Found my problem.

    Thanks,
    Tamir
    On Tue, Mar 2, 2010 at 8:54 AM, Tamir Kamara wrote:

    Hi,

    I suddenly started getting this error and I don't understand why since the
    input path exists on the dfs. It started a couple of days ago when I checked
    out trunk again (the previous working version was checked out about two
    weeks ago). I'm working on hadoop 0.20.1.

    The log file shows:
    Backend error message during job submission
    -------------------------------------------
    org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Unable to
    create input splits for: hdfs://ips-h01:54310/user/tkamara/report/20090301
    at
    org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:256)
    at
    org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
    at
    org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)
    at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378)
    at
    org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247)
    at
    org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279)
    at java.lang.Thread.run(Thread.java:619)
    Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException:
    Input path does not exist: hdfs://ips-h01:54310/user/tkamara/report/20090301
    at
    org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:224)
    at
    org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
    at
    org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:245)
    ... 7 more

    Do you know why it happens?

    Thanks,
    Tamir

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categoriespig, hadoop
postedMar 2, '10 at 6:54a
activeMar 2, '10 at 12:58p
posts2
users1
websitepig.apache.org

1 user in discussion

Tamir Kamara: 2 posts

People

Translate

site design / logo © 2021 Grokbase