Support window functions with window frame

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and why for this feature, in addition to the what)

Implement frame spec in window clause

Describe the solution you'd like
A clear and concise description of what you want to happen.

We'd like to support window function in three or more steps:

Support window functions with basic logical planning and physical planning #359 basic structure
Support window functions with empty OVER clause #298 empty over clause
Support window functions with PARTITION BY clause #299 with partition clause
Support window functions with order by #360 with order by
Support window functions with window frame #361 with window frame (this one)

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

For anyone following this, a window frame query looks like this (the ROWS BETWEEN 2 PRECEDING AND 0 FOLLOWING)

SELECT water_level, avg(water_level) OVER (ORDER BY time desc ROWS BETWEEN 2 PRECEDING AND 0 FOLLOWING)
FROM
  "h2o_feet"
WHERE
  time >= cast ('2019-09-17T20:00:00Z' as timestamp) AND
  time <= cast ('2019-09-17T21:42:00Z' as timestamp);

Which results in an error

This feature is not implemented: window expression with window frame definition is not yet supported

It appears there is some work afoot to support this in https://github.com/synnada-ai/arrow-datafusion/pull/1

It appears there is some work afoot to support this in synnada-ai#1

Yes, we plan to submit a PR draft early next week that makes progress on this issue. We hope to resolve it fully once we get community feedback.

i am going to fix this window func issue. So we can do window func in ballista ✌️

I have run some query success in out internal version ballista 😄 and fix some issues.

@ozankabak

@ozankabak Thanks again for supporting window frame.👍

@ozankabak

I am going to claim this ticket is done. Thank you to the Synnada team and @ozankabak and @mustafasrepo for helping make it happen 👏

You are welcome, looking forward to helping in the future too!

feat: Use enum to represent CAST eval_mode in expr.proto (apache#415)

build(deps): bump mimalloc from 0.1.36 to 0.1.37 (apache#361)

Navigation Menu

Repository navigation

Support window functions with window frame #361

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Support window functions with window frame #361

Description

Activity

alamb commented on Sep 16, 2022

alamb commented on Sep 16, 2022

ozankabak commented on Sep 18, 2022

Ted-Jiang commented on Dec 2, 2022

Ted-Jiang commented on Dec 2, 2022

Ted-Jiang commented on Dec 2, 2022

alamb commented on Dec 2, 2022

ozankabak commented on Dec 5, 2022

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions