You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Basically, the predicates that get pushed down to the parquet exec scan now are fully qualified, for example #foo.bar > 5 however, the parquet schema only has columns named bar and thus the code can not match them up
The reason this was not caught in #55 is that there is no end-to-end test of parquet that exercises the entire path.
The fix for this issue is fairly straightforward (it is to strip the qualifiers from the expressions) but the end-to-end test is quite involved. I plan to fix this in two PRs
Activity
alamb commentedon Jul 2, 2021
FYI @houqp and @yordan-pavlov
houqp commentedon Jul 3, 2021
Good catch 👍 If you are busy with something else, i am happy to take up on this fix as well.
alamb commentedon Jul 3, 2021
Thanks for the offer @houqp -- now that I have the test setup, this will be straightforward to fix :)
alamb commentedon Jul 7, 2021
Closed in #689
feat: Show user a more intuitive message when queries fall back to Sp…