[Pig-dev] [jira] Created: (PIG-392) When a pig script creates multiple MR jobs, if any job but the last fails, pig report success and returns no results.

[ https://issues.apache.org/jira/browse/PIG-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alan Gates updated PIG-392:
---------------------------

Status: Patch Available (was: Open)

[ https://issues.apache.org/jira/browse/PIG-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alan Gates updated PIG-392:
---------------------------

Attachment: PIG-392.patch

This patch changes the launcher classes to check for any failed jobs, instead of just checking that progress is 100% when hadoop declares all jobs finished.

[ https://issues.apache.org/jira/browse/PIG-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12625215#action_12625215 ]

Olga Natkovich commented on PIG-392:
------------------------------------

Alan, how do I validate the patch?

[ https://issues.apache.org/jira/browse/PIG-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12625318#action_12625318 ]

Shravan Matthur Narayanamurthy commented on PIG-392:
----------------------------------------------------

But the calculateProgress does the same thing. It returns the progress of all the jobs as (sum of all successful jobs and running progress of running jobs). The launchers know how many jobs were launched. If JobControl works correctly, the completion check to see that the progress returned by calculateProgress equals num MR jobs submitted is right. Can you give me a sample script where it was failing?

[ https://issues.apache.org/jira/browse/PIG-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich updated PIG-392:
-------------------------------

Resolution: Fixed
Status: Resolved (was: Patch Available)

patch committed. thanks, Alan