Grokbase Groups Hive user July 2009
FAQ
Apparently, hive can't access the temporary file or something. My SQLs
fail with an IPException,

+++++++++
hive> select 1 from netflow;
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Job Submission failed with exception 'java.io.IOException(cannot find
dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)'
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.ExecDriver
+++++++++

but I can see that the files are there,

+++++++++
$HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1
Found 1 items
-rw-r--r-- 2 viadhi supergroup 87 2009-07-28 09:37 /tmp/hive-viadhi/1
+++++++++

Please help.
--
Vijay

Search Discussions

  • Ashish Thusoo at Jul 28, 2009 at 7:16 pm
    Can you put out the contents of

    /tmp/<username>/hive.log
    From the machine where you launched the hive cli from.
    Ashish

    -----Original Message-----
    From: Vijay Kumar Adhikari
    Sent: Tuesday, July 28, 2009 7:42 AM
    To: hive-user@hadoop.apache.org
    Subject: Hive can't see a DFS file

    Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException,

    +++++++++
    hive> select 1 from netflow;
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)'
    FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver
    +++++++++

    but I can see that the files are there,

    +++++++++
    $HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1
    Found 1 items
    -rw-r--r-- 2 viadhi supergroup 87 2009-07-28 09:37 /tmp/hive-viadhi/1
    +++++++++

    Please help.
    --
    Vijay
  • Vijay Kumar Adhikari at Jul 28, 2009 at 9:26 pm
    Attached.

    On Tue, Jul 28, 2009 at 2:17 PM, Ashish Thusoowrote:
    Can you put out the contents of

    /tmp/<username>/hive.log

    From the machine where you launched the hive cli from.

    Ashish

    -----Original Message-----
    From: Vijay Kumar Adhikari
    Sent: Tuesday, July 28, 2009 7:42 AM
    To: hive-user@hadoop.apache.org
    Subject: Hive can't see a DFS file

    Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException,

    +++++++++
    hive> select 1 from netflow;
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)'
    FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver
    +++++++++

    but I can see that the files are there,

    +++++++++
    $HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1
    Found 1 items
    -rw-r--r--   2 viadhi supergroup         87 2009-07-28 09:37 /tmp/hive-viadhi/1
    +++++++++

    Please help.
    --
    Vijay


    --
    Vijay

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedJul 28, '09 at 2:40p
activeJul 28, '09 at 9:26p
posts3
users2
websitehive.apache.org

People

Translate

site design / logo © 2021 Grokbase