Grokbase › Groups › Pig › user › September 2008
FAQ
Hi All

Am a student trying to integrate PIG and Hadoop technologies to build a
custom application as a part of my MS project.
Am trying out a simple scenario where I have setup a single node hadoop
cluster and trying to execute the pig script "script1-*hadoop*.*pig" *mentioned
in the pig tutorial.

Am hitting several issues like "Failed to create data storage "etc.
Had posted same to the groups already.
http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Failed-to-create-DataStorage%22-error.-td18931962.html

Could you please suggest me the proper steps to integrate pig and hadoop.
Right now, am following the below ones.

1) Have downloded latest source for hadoop and PIG
2) Compiled hadoop and started single node cluster
3) Compiled PIG and replaced the hadoop class files with the new ones from
step 2 in the pig.jar
4) executing the pig script by setting HADOOPSITEPATH

Please let me if the above steps needs are incorrect (or) should i use any
specific pig and hadoop versions? We are stuck up with the errors. Request
you to pls help in resolving the same.

Thankyou
Srilatha

Search Discussions

  • Daniel at Sep 22, 2008 at 3:23 pm ⇧
    Which version of hadoop are you using? Is that hadoop 18 as you said "the
    latest hadoop source"? If it is the case, try hadoop 17. Currently pig only
    works with hadoop 17 I think.

    Daniel

    ----- Original Message -----
    From: "Latha" <uslatha@gmail.com>
    To: <pig-user@incubator.apache.org>; <core-user@hadoop.apache.org>;
    <core-dev@hadoop.apache.org>
    Sent: Sunday, September 21, 2008 3:02 PM
    Subject: Facing issues Integrating PIG with Hadoop.

    Hi All

    Am a student trying to integrate PIG and Hadoop technologies to build a
    custom application as a part of my MS project.
    Am trying out a simple scenario where I have setup a single node hadoop
    cluster and trying to execute the pig script "script1-*hadoop*.*pig"
    *mentioned
    in the pig tutorial.

    Am hitting several issues like "Failed to create data storage "etc.
    Had posted same to the groups already.
    http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Failed-to-create-DataStorage%22-error.-td18931962.html

    Could you please suggest me the proper steps to integrate pig and hadoop.
    Right now, am following the below ones.

    1) Have downloded latest source for hadoop and PIG
    2) Compiled hadoop and started single node cluster
    3) Compiled PIG and replaced the hadoop class files with the new ones from
    step 2 in the pig.jar
    4) executing the pig script by setting HADOOPSITEPATH

    Please let me if the above steps needs are incorrect (or) should i use any
    specific pig and hadoop versions? We are stuck up with the errors. Request
    you to pls help in resolving the same.

    Thankyou
    Srilatha
  • Olga Natkovich at Sep 22, 2008 at 3:51 pm ⇧
    The official release works with Hadoop 17. The latest trunk has been
    covnerted to Hadoop 18 on Friday.

    Olga
    -----Original Message-----
    From: Daniel
    Sent: Sunday, September 21, 2008 10:25 PM
    To: pig-user@incubator.apache.org
    Subject: Re: Facing issues Integrating PIG with Hadoop.

    Which version of hadoop are you using? Is that hadoop 18 as
    you said "the latest hadoop source"? If it is the case, try
    hadoop 17. Currently pig only works with hadoop 17 I think.

    Daniel

    ----- Original Message -----
    From: "Latha" <uslatha@gmail.com>
    To: <pig-user@incubator.apache.org>;
    <core-user@hadoop.apache.org>; <core-dev@hadoop.apache.org>
    Sent: Sunday, September 21, 2008 3:02 PM
    Subject: Facing issues Integrating PIG with Hadoop.

    Hi All

    Am a student trying to integrate PIG and Hadoop
    technologies to build
    a custom application as a part of my MS project.
    Am trying out a simple scenario where I have setup a single node
    hadoop cluster and trying to execute the pig script
    "script1-*hadoop*.*pig"
    *mentioned
    in the pig tutorial.

    Am hitting several issues like "Failed to create data storage "etc.
    Had posted same to the groups already.
    http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Fail
    ed-to-create-DataStorage%22-error.-td18931962.html

    Could you please suggest me the proper steps to integrate
    pig and hadoop.
    Right now, am following the below ones.

    1) Have downloded latest source for hadoop and PIG
    2) Compiled hadoop and started single node cluster
    3) Compiled PIG and replaced the hadoop class files with
    the new ones
    from step 2 in the pig.jar
    4) executing the pig script by setting HADOOPSITEPATH

    Please let me if the above steps needs are incorrect (or)
    should i use
    any specific pig and hadoop versions? We are stuck up with
    the errors.
    Request you to pls help in resolving the same.

    Thankyou
    Srilatha
  • Alan Gates at Nov 24, 2008 at 7:29 pm ⇧
    Pig questions should be sent to pig-user@hadoop.apache.org.

    The error you're getting usually means that you have a version of
    hadoop that doesn't match your version of pig. If you downloaded
    latest for hadoop, that will be the case, as pig currently supports
    hadoop 0.18, but not 0.19 or top of trunk. Try running your pig
    version with a released 0.18 version of hadoop and see if you get
    better results.

    Alan.
    On Nov 24, 2008, at 10:09 AM, cutepooja54321 wrote:


    hi , i am also trying to do the same thing,,
    can u please help me if u managed to do it ,, pleassee.. i am also
    a student

    us latha wrote:
    Hi All

    Am a student trying to integrate PIG and Hadoop technologies to
    build a
    custom application as a part of my MS project.
    Am trying out a simple scenario where I have setup a single node
    hadoop
    cluster and trying to execute the pig script "script1-*hadoop*.*pig"
    *mentioned
    in the pig tutorial.

    Am hitting several issues like "Failed to create data storage "etc.
    Had posted same to the groups already.
    http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%
    22Failed-to-create-DataStorage%22-error.-td18931962.html

    Could you please suggest me the proper steps to integrate pig and
    hadoop.
    Right now, am following the below ones.

    1) Have downloded latest source for hadoop and PIG
    2) Compiled hadoop and started single node cluster
    3) Compiled PIG and replaced the hadoop class files with the new
    ones from
    step 2 in the pig.jar
    4) executing the pig script by setting HADOOPSITEPATH

    Please let me if the above steps needs are incorrect (or) should i
    use any
    specific pig and hadoop versions? We are stuck up with the errors.
    Request
    you to pls help in resolving the same.

    Thankyou
    Srilatha
    --
    View this message in context: http://www.nabble.com/Facing-issues-
    Integrating-PIG-with-Hadoop.-tp19597351p20666428.html
    Sent from the Hadoop core-user mailing list archive at Nabble.com.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categoriespig, hadoop
postedSep 21, '08 at 7:03p
activeNov 24, '08 at 7:29p
posts4
users4
websitepig.apache.org

4 users in discussion

Latha: 1 post Olga Natkovich: 1 post Alan Gates: 1 post Daniel: 1 post

Content

People

Support

Translate

site design / logo © 2022 Grokbase