FAQ
hive> LOAD DATA INPATH 'hdfs://xx-mapred000.xx01:54310/test/shixing/log' INTO TABLE log_stg4;
FAILED: Error in semantic analysis: line 1:17 Path is not legal 'hdfs://xx-mapred000.xx01:54310/test/shixing/log': Cannot load data across filesystems, use load data local



在2008-12-02 17:22:28,"Zheng Shao" <zshao@facebook.com> 写道:


Let’s use hive-user@hadoop.apache.org instead of hive-users@publists.facebook.com



Try adding a prefix like this:

LOAD DATA INPATH 'hdfs://namenode:50001/test/shixing/log' INTO TABLE log_stg2;



The hdfs address can be found in hadoop/conf/hadoop-site.xml.



Zheng

From:hive-users-bounces@publists.facebook.com On Behalf Of paradisehi
Sent: Tuesday, December 02, 2008 1:04 AM
To:hive-users@publists.facebook.com
Subject: [hive-users] "LOAD DATA" From hdfs can'r work under hadoop 0.19



The hive is also downloads from http://mirror.facebook.com/facebook/hive/hadoop-0.19/

hive> LOAD DATA INPATH '/test/shixing/log' INTO TABLE log_stg2;
FAILED: Error in semantic analysis: line 1:17 Path is not legal '/test/shixing/log': Cannot load data across filesystems, use load data local
Time taken: 0.064 seconds







网易免费邮,全球最大的中文免费邮箱

Search Discussions

  • Joydeep Sen Sarma at Dec 2, 2008 at 6:40 pm
    Hi Paradisehi

    The issue is that the default file system uri obtained from hadoop config variable fs.default.name (from hadoop-default/site.xml) does not match the uri that u are loading from.

    As Zheng mentioned �C can u please use the hdfs://namenode:xxxxx/test/shixing/log �C where ‘namenode:xxxxx’ appears in fs.default.name setting?

    Also �C please use hive from the svn repository at
    http://svn.apache.org/repos/asf/hadoop/hive/trunk �C the facebook mirror distribution is out of date

    Joydeep



    ________________________________
    From: paradisehi
    Sent: Tuesday, December 02, 2008 1:46 AM
    To: Zheng Shao
    Cc: hive-user@hadoop.apache.org
    Subject: Re:RE: [hive-users] "LOAD DATA" From hdfs can'r work under hadoop 0.19

    hive> LOAD DATA INPATH 'hdfs://xx-mapred000.xx01:54310/test/shixing/log' INTO TABLE log_stg4;
    FAILED: Error in semantic analysis: line 1:17 Path is not legal 'hdfs://xx-mapred000.xx01:54310/test/shixing/log': Cannot load data across filesystems, use load data local



    在2008-12-02 17:22:28,"Zheng Shao" <zshao@facebook.com> 写道:

    Let’s use hive-user@hadoop.apache.org instead of hive-users@publists.facebook.com

    Try adding a prefix like this:
    LOAD DATA INPATH 'hdfs://namenode:50001/test/shixing/log' INTO TABLE log_stg2;

    The hdfs address can be found in hadoop/conf/hadoop-site.xml.

    Zheng
    From: hive-users-bounces@publists.facebook.com On Behalf Of paradisehi
    Sent: Tuesday, December 02, 2008 1:04 AM
    To: hive-users@publists.facebook.com
    Subject: [hive-users] "LOAD DATA" From hdfs can'r work under hadoop 0.19

    The hive is also downloads from http://mirror.facebook.com/facebook/hive/hadoop-0.19/

    hive> LOAD DATA INPATH '/test/shixing/log' INTO TABLE log_stg2;
    FAILED: Error in semantic analysis: line 1:17 Path is not legal '/test/shixing/log': Cannot load data across filesystems, use load data local
    Time taken: 0.064 seconds




    ________________________________
    网易免费邮,全球最大的中文免费邮箱<http://www.yeah.net>


    ________________________________
    网易免费邮,全球最大的中文免费邮箱<http://www.yeah.net>
  • Zheng Shao at Dec 2, 2008 at 8:50 pm
    Hi Paradisehi,

    If it still didn’t work, try the following step:

    From Joey Pan who encountered the same problem before:
    “If I remember correctly, may also change the conf of hive under hive-default.xml for “hive.metastore.warehouse.dir” and point to the right hdfs place for the hive table. ”

    In short copy the property “hive.metastore.warehouse.dir” from hive-default.xml to hive-site.xml, and change the dir to “hdfs://namenode:xxxx/yyy/zz” (the prefix is from fs.default.name in conf/hadoop-site.xml as Joy mentioned.

    Let us know how it goes.

    Thanks,
    Zheng
    From: Joydeep Sen Sarma
    Sent: Tuesday, December 02, 2008 10:40 AM
    To: hive-user@hadoop.apache.org; Zheng Shao
    Subject: RE: Re:RE: [hive-users] "LOAD DATA" From hdfs can'r work under hadoop 0.19

    Hi Paradisehi

    The issue is that the default file system uri obtained from hadoop config variable fs.default.name (from hadoop-default/site.xml) does not match the uri that u are loading from.

    As Zheng mentioned �C can u please use the hdfs://namenode:xxxxx/test/shixing/log �C where ‘namenode:xxxxx’ appears in fs.default.name setting?

    Also �C please use hive from the svn repository at
    http://svn.apache.org/repos/asf/hadoop/hive/trunk �C the facebook mirror distribution is out of date

    Joydeep



    ________________________________
    From: paradisehi
    Sent: Tuesday, December 02, 2008 1:46 AM
    To: Zheng Shao
    Cc: hive-user@hadoop.apache.org
    Subject: Re:RE: [hive-users] "LOAD DATA" From hdfs can'r work under hadoop 0.19

    hive> LOAD DATA INPATH 'hdfs://xx-mapred000.xx01:54310/test/shixing/log' INTO TABLE log_stg4;
    FAILED: Error in semantic analysis: line 1:17 Path is not legal 'hdfs://xx-mapred000.xx01:54310/test/shixing/log': Cannot load data across filesystems, use load data local



    在2008-12-02 17:22:28,"Zheng Shao" <zshao@facebook.com> 写道:
    Let’s use hive-user@hadoop.apache.org instead of hive-users@publists.facebook.com

    Try adding a prefix like this:
    LOAD DATA INPATH 'hdfs://namenode:50001/test/shixing/log' INTO TABLE log_stg2;

    The hdfs address can be found in hadoop/conf/hadoop-site.xml.

    Zheng
    From: hive-users-bounces@publists.facebook.com On Behalf Of paradisehi
    Sent: Tuesday, December 02, 2008 1:04 AM
    To: hive-users@publists.facebook.com
    Subject: [hive-users] "LOAD DATA" From hdfs can'r work under hadoop 0.19

    The hive is also downloads from http://mirror.facebook.com/facebook/hive/hadoop-0.19/

    hive> LOAD DATA INPATH '/test/shixing/log' INTO TABLE log_stg2;
    FAILED: Error in semantic analysis: line 1:17 Path is not legal '/test/shixing/log': Cannot load data across filesystems, use load data local
    Time taken: 0.064 seconds



    ________________________________
    网易免费邮,全球最大的中文免费邮箱<http://www.yeah.net>

    ________________________________
    网易免费邮,全球最大的中文免费邮箱<http://www.yeah.net>

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedDec 2, '08 at 9:46a
activeDec 2, '08 at 8:50p
posts3
users3
websitehive.apache.org

People

Translate

site design / logo © 2022 Grokbase