You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[C++][Python] Performant aggregating by fragments. #33832
pc._group_by requires loaded arrays, which means it's not practical to group and aggregate large datasets. Even if the dataset is partitioned, there is no built-in way to aggregate by partition keys. Iterating get_fragments is the only option.
Another variant would be to aggregate by batch, but that would still require grouping, and in practice would limit the aggregations to simple associative ones, e.g., sum. So probably focusing on fragments first is better.
This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.
Activity
Field `fragments` groups by partitions and aggregates.
thisisnic commentedon Feb 18, 2026
This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.