You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This effectively stalls out constructing the rest of the physical plan until the sort has completed, and prevents result streaming from working correctly.
To Reproduce
Run a query with a large SortExec, observe surprising amount of time spent in ExecutionPlan::execute
Expected behavior
ExecutionPlan::execute should return a stream of results, but should not block on those results being available
@yjshen Are you still planning to pick this one up, otherwise I can take a stab at it. It's causing me some excitement whilst experimenting with query scheduling, as the sort is taking place during the plan 😆
Activity
yjshen commentedon Mar 9, 2022
Thanks, @tustvold . I'll have time to work on this later in the week. 😅 Please let me know if it has a higher priority.
tustvold commentedon Mar 9, 2022
No rush, whenever you have time 😀
tustvold commentedon Apr 6, 2022
@yjshen Are you still planning to pick this one up, otherwise I can take a stab at it. It's causing me some excitement whilst experimenting with query scheduling, as the sort is taking place during the plan 😆
yjshen commentedon Apr 6, 2022
Please go ahead. I am occupied with enabling all TPC-DS queries in Blaze and getting performance gains these days. Sorry for the delay.