Grokbase Groups Pig dev October 2010
FAQ
Dimitry,

Could you send me your filter expression on which the logical expression simplifier failed upon to help me debug the problem as this sits in the critical path of pig optimization?

I do not need your full query script and not even the exact filter expression but just the same expression structure with whatever field names you may put there. For instance if you have a filter as follows:

B = FILTER a BY (twitterField1 > 7 AND twitterField2 <3);

It will suffice for me to debug if you send me the following

B = FILTER a BY (foo1 > 7 AND foo2 <3);

In other word, it is the expression tree structure and operators that matters not the field names on the tree.

Thanks for help!

Yan

-----Original Message-----
From: Yan Zhou
Sent: Monday, October 11, 2010 5:02 PM
To: 'dvryaboy@gmail.com'
Cc: 'dev@pig.apache.org'
Subject: RE: Turning off individual rules in new optimizer

Please try "-t FilterLogicExpressionSimplifier" to turn it off.

In the meanwhile, could you send me your filter expression that you suspect the simplifier fails on?

Thanks,

Yan

-----Original Message-----
From: Dmitriy Ryaboy
Sent: Monday, October 11, 2010 4:51 PM
To: dev@pig.apache.org
Subject: Turning off individual rules in new optimizer

I am getting mysterious errors that I think are due to the new optimizer in
pig 8.
How can I turn off individual rules (LogicalExpressionSimplifier in this
case)?

Thanks,
-Dmitriy

Search Discussions

Discussion Posts

Previous

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 3 of 4 | next ›
Discussion Overview
groupdev @
categoriespig, hadoop
postedOct 11, '10 at 11:51p
activeOct 14, '10 at 3:03p
posts4
users2
websitepig.apache.org

2 users in discussion

Dmitriy Ryaboy: 2 posts Yan Zhou: 2 posts

People

Translate

site design / logo © 2022 Grokbase