Grokbase › Groups › Hive › dev › May 2009
FAQ

[Hive-dev] [jira] Created: (HIVE-469) empty files are not handled properly

Namit Jain (JIRA)
May 4, 2009 at 10:34 pm
empty files are not handled properly
-------------------------------------

Key: HIVE-469
URL: https://issues.apache.org/jira/browse/HIVE-469
Project: Hadoop Hive
Issue Type: Bug
Components: Query Processor
Reporter: Namit Jain
Assignee: Namit Jain


empty files are not handled properly.

The job fails if a union is performed on a sub-query with a empty partition.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
reply

Search Discussions

10 responses

  • Namit Jain (JIRA) at May 5, 2009 at 12:09 am ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Namit Jain updated HIVE-469:
    ----------------------------

    Attachment: hive.469.1.patch
    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Attachments: hive.469.1.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Namit Jain (JIRA) at May 5, 2009 at 12:11 am ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Namit Jain updated HIVE-469:
    ----------------------------

    Status: Patch Available (was: Open)
    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Attachments: hive.469.1.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Namit Jain (JIRA) at May 8, 2009 at 4:16 pm ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Namit Jain updated HIVE-469:
    ----------------------------

    Attachment: hive.469.2.patch

    incorporated ashish's comments
    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Attachments: hive.469.1.patch, hive.469.2.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Namit Jain (JIRA) at May 8, 2009 at 4:43 pm ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Namit Jain updated HIVE-469:
    ----------------------------

    Attachment: hive.469.3.patch

    As part of this, changed nullgroup3.q to drop the tables at the end - it was leading to some intermittent problems for other tests
    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Attachments: hive.469.1.patch, hive.469.2.patch, hive.469.3.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ashish Thusoo (JIRA) at May 11, 2009 at 8:55 pm ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12708216#action_12708216 ]

    Ashish Thusoo commented on HIVE-469:
    ------------------------------------

    Looks good to me.

    +1

    Will run the tests and check in if they succeed.

    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Attachments: hive.469.1.patch, hive.469.2.patch, hive.469.3.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ashish Thusoo (JIRA) at May 15, 2009 at 7:20 pm ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709934#action_12709934 ]

    Ashish Thusoo commented on HIVE-469:
    ------------------------------------

    I am not able to apply this patch in 0.3 branch. Can you generate another one for 0.3? Will also try on my end.
    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Attachments: hive.469.1.patch, hive.469.2.patch, hive.469.3.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ashish Thusoo (JIRA) at May 15, 2009 at 7:36 pm ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709940#action_12709940 ]

    Ashish Thusoo commented on HIVE-469:
    ------------------------------------

    A bunch of classes that are needed in addInputPath are not there in 0.3, so I think we will have to generate a new patch for 0.3 or agree to not fix this in 0.3. I do feel that this is important enough that we should get a fix for this issue in 0.3.

    Thoughts?

    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Attachments: hive.469.1.patch, hive.469.2.patch, hive.469.3.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Namit Jain (JIRA) at May 18, 2009 at 5:43 pm ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12710415#action_12710415 ]

    Namit Jain commented on HIVE-469:
    ---------------------------------

    I dont think we need it in 0.3 - it is a pretty esoteric case.
    Did you already merge it in trunk ?
    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Attachments: hive.469.1.patch, hive.469.2.patch, hive.469.3.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ashish Thusoo (JIRA) at May 18, 2009 at 11:51 pm ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12710543#action_12710543 ]

    Ashish Thusoo commented on HIVE-469:
    ------------------------------------

    I already merged it into trunk. Will mark this as fixed.

    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Attachments: hive.469.1.patch, hive.469.2.patch, hive.469.3.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Ashish Thusoo (JIRA) at May 18, 2009 at 11:53 pm ⇧
    [ https://issues.apache.org/jira/browse/HIVE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Ashish Thusoo updated HIVE-469:
    -------------------------------

    Resolution: Fixed
    Fix Version/s: 0.4.0
    Hadoop Flags: [Reviewed]
    Status: Resolved (was: Patch Available)

    committed. Thanks Namit!!
    empty files are not handled properly
    -------------------------------------

    Key: HIVE-469
    URL: https://issues.apache.org/jira/browse/HIVE-469
    Project: Hadoop Hive
    Issue Type: Bug
    Components: Query Processor
    Reporter: Namit Jain
    Assignee: Namit Jain
    Fix For: 0.4.0

    Attachments: hive.469.1.patch, hive.469.2.patch, hive.469.3.patch


    empty files are not handled properly.
    The job fails if a union is performed on a sub-query with a empty partition.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
Notice: Undefined variable: pl_domain_short in /home/whirl/sites/grokbase/root/www/public_html__www/cc/flow/tpc.php on line 1543
categorieshive, hadoop
postedMay 4, '09 at 10:34p
activeMay 18, '09 at 11:53p
posts11
users1
websitehive.apache.org

1 user in discussion

Ashish Thusoo (JIRA): 11 posts