Grokbase › Groups › Pig › dev › June 2011
FAQ
pig script should have command line option to use pig-withouthadoop.jar instead of pig-core.jar
-----------------------------------------------------------------------------------------------

Key: PIG-2148
URL: https://issues.apache.org/jira/browse/PIG-2148
Project: Pig
Issue Type: New Feature
Components: impl
Affects Versions: 0.9.0
Reporter: Alan Gates
Assignee: Alan Gates
Priority: Minor


If you use Pig downloaded from Apache with Hadoop 0.20.203 or CDH3, you have to use the pig-withouthadoop.jar instead of pig-core.jar. However bin/pig uses pig-core.jar, meaning you can't use the shell script to start Pig. We need to add a -without option to bin/pig so that it will pick up the pig-withouthadoop.jar.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Search Discussions

  • Alan Gates (JIRA) at Jun 28, 2011 at 10:09 pm ⇧
    [ https://issues.apache.org/jira/browse/PIG-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Alan Gates updated PIG-2148:
    ----------------------------

    Fix Version/s: 0.10
    Status: Patch Available (was: Open)
    pig script should have command line option to use pig-withouthadoop.jar instead of pig-core.jar
    -----------------------------------------------------------------------------------------------

    Key: PIG-2148
    URL: https://issues.apache.org/jira/browse/PIG-2148
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.9.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Minor
    Fix For: 0.10

    Attachments: PIG-2148.patch


    If you use Pig downloaded from Apache with Hadoop 0.20.203 or CDH3, you have to use the pig-withouthadoop.jar instead of pig-core.jar. However bin/pig uses pig-core.jar, meaning you can't use the shell script to start Pig. We need to add a -without option to bin/pig so that it will pick up the pig-withouthadoop.jar.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Alan Gates (JIRA) at Jun 28, 2011 at 10:09 pm ⇧
    [ https://issues.apache.org/jira/browse/PIG-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Alan Gates updated PIG-2148:
    ----------------------------

    Attachment: PIG-2148.patch
    pig script should have command line option to use pig-withouthadoop.jar instead of pig-core.jar
    -----------------------------------------------------------------------------------------------

    Key: PIG-2148
    URL: https://issues.apache.org/jira/browse/PIG-2148
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.9.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Minor
    Fix For: 0.10

    Attachments: PIG-2148.patch


    If you use Pig downloaded from Apache with Hadoop 0.20.203 or CDH3, you have to use the pig-withouthadoop.jar instead of pig-core.jar. However bin/pig uses pig-core.jar, meaning you can't use the shell script to start Pig. We need to add a -without option to bin/pig so that it will pick up the pig-withouthadoop.jar.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Dmitriy V. Ryaboy (JIRA) at Jun 28, 2011 at 10:37 pm ⇧
    [ https://issues.apache.org/jira/browse/PIG-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13056827#comment-13056827 ]

    Dmitriy V. Ryaboy commented on PIG-2148:
    ----------------------------------------

    Alan, this doesn't seem like an elegant solution.
    A cleaner approach would be to make the build declare dependencies in the pom, and make the default jar have no dependencies bundled in -- let people add dependencies into the jar as they see fit, or pull them in via configurable "register"s
    pig script should have command line option to use pig-withouthadoop.jar instead of pig-core.jar
    -----------------------------------------------------------------------------------------------

    Key: PIG-2148
    URL: https://issues.apache.org/jira/browse/PIG-2148
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.9.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Minor
    Fix For: 0.10

    Attachments: PIG-2148.patch


    If you use Pig downloaded from Apache with Hadoop 0.20.203 or CDH3, you have to use the pig-withouthadoop.jar instead of pig-core.jar. However bin/pig uses pig-core.jar, meaning you can't use the shell script to start Pig. We need to add a -without option to bin/pig so that it will pick up the pig-withouthadoop.jar.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Eric Yang (JIRA) at Jun 28, 2011 at 10:53 pm ⇧
    [ https://issues.apache.org/jira/browse/PIG-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13056867#comment-13056867 ]

    Eric Yang commented on PIG-2148:
    --------------------------------

    +1 on Dmitriy's proposal. Alan, if we can use the directory structure proposed by Owen in HADOOP-6255, it would be helpful to trim down the size of pig.jar file, and setup dependency properly from single $PREFIX/share/[hadoop|hbase] location to refer to hadoop and hbase jar files.
    pig script should have command line option to use pig-withouthadoop.jar instead of pig-core.jar
    -----------------------------------------------------------------------------------------------

    Key: PIG-2148
    URL: https://issues.apache.org/jira/browse/PIG-2148
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.9.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Minor
    Fix For: 0.10

    Attachments: PIG-2148.patch


    If you use Pig downloaded from Apache with Hadoop 0.20.203 or CDH3, you have to use the pig-withouthadoop.jar instead of pig-core.jar. However bin/pig uses pig-core.jar, meaning you can't use the shell script to start Pig. We need to add a -without option to bin/pig so that it will pick up the pig-withouthadoop.jar.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Alan Gates (JIRA) at Jul 1, 2011 at 9:13 pm ⇧
    [ https://issues.apache.org/jira/browse/PIG-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Alan Gates updated PIG-2148:
    ----------------------------

    Fix Version/s: (was: 0.10)
    Status: Open (was: Patch Available)
    pig script should have command line option to use pig-withouthadoop.jar instead of pig-core.jar
    -----------------------------------------------------------------------------------------------

    Key: PIG-2148
    URL: https://issues.apache.org/jira/browse/PIG-2148
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.9.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Minor
    Attachments: PIG-2148.patch


    If you use Pig downloaded from Apache with Hadoop 0.20.203 or CDH3, you have to use the pig-withouthadoop.jar instead of pig-core.jar. However bin/pig uses pig-core.jar, meaning you can't use the shell script to start Pig. We need to add a -without option to bin/pig so that it will pick up the pig-withouthadoop.jar.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Alan Gates (JIRA) at Jul 1, 2011 at 9:13 pm ⇧
    [ https://issues.apache.org/jira/browse/PIG-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058803#comment-13058803 ]

    Alan Gates commented on PIG-2148:
    ---------------------------------

    I'm fine with figuring out how we move to the default version not being a fat jar. I suspect we'll need to continue the fatjar for backward compatibility. But I'm not sure how long until we'll make this change. I'll leave this patch up for those who want to patch their existing systems in the meantime.
    pig script should have command line option to use pig-withouthadoop.jar instead of pig-core.jar
    -----------------------------------------------------------------------------------------------

    Key: PIG-2148
    URL: https://issues.apache.org/jira/browse/PIG-2148
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.9.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Minor
    Attachments: PIG-2148.patch


    If you use Pig downloaded from Apache with Hadoop 0.20.203 or CDH3, you have to use the pig-withouthadoop.jar instead of pig-core.jar. However bin/pig uses pig-core.jar, meaning you can't use the shell script to start Pig. We need to add a -without option to bin/pig so that it will pick up the pig-withouthadoop.jar.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categoriespig, hadoop
postedJun 28, '11 at 10:07p
activeJul 1, '11 at 9:13p
posts7
users1
websitepig.apache.org

1 user in discussion

Alan Gates (JIRA): 7 posts

Content

People

Support

Translate

site design / logo © 2022 Grokbase