FAQ
There was an error I was facing where Impala can't seem to detect rows of a
table whose data is stored in the RCfile format. But the new release impala
1.1-1.p0.8 seemed to have fixed it. However, now certain queried that did
work don't anymore. For example, tpch query #1 (also stored in rcfile
format):

select L_RETURNFLAG,
        L_LINESTATUS,
        SUM(L_QUANTITY),
        SUM(L_EXTENDEDPRICE),
        SUM(L_EXTENDEDPRICE*(1-L_DISCOUNT)),
        SUM(L_EXTENDEDPRICE*(1-L_DISCOUNT)*(1+L_TAX)),
        AVG(L_QUANTITY),
        AVG(L_EXTENDEDPRICE),
        AVG(L_DISCOUNT),
        COUNT(1)
FROM lineitem
WHERE L_SHIPDATE<='1998-09-02'
GROUP BY L_RETURNFLAG,
          L_LINESTATUS
ORDER BY L_RETURNFLAG,
          L_LINESTATUS limit 1000

results in the following error:
Backend 25:Memory limit exceeded
Format error in record or block header at end of file.
Format error in record or block header at end of file.
Format error in record or block header at end of file.
Format error in record or block header at end of file.
.....


Did the RCfile format fix cause this?

Search Discussions

Discussion Posts

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 1 of 7 | next ›
Discussion Overview
groupimpala-user @
categorieshadoop
postedJul 30, '13 at 12:26a
activeAug 1, '13 at 4:55p
posts7
users2
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase