Skip to content

[Python] Add a pyarrow.Table.aggregate function to compute aggregates against the whole table #14896

Open

Description

@westonpace

Describe the enhancement requested

The implementation would be almost identical to pyarrow.TableGroupBy.aggregate except the keys list would be empty. Currently this does not appear to be possible using an empty array of keys:

>>> tab.group_by([]).aggregate([("x", "sum")])
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "pyarrow/table.pxi", line 5325, in pyarrow.lib.TableGroupBy.aggregate
  File "pyarrow/_compute.pyx", line 2145, in pyarrow._compute._group_by
  File "pyarrow/error.pxi", line 144, in pyarrow.lib.pyarrow_internal_check_status
  File "pyarrow/error.pxi", line 100, in pyarrow.lib.check_status
pyarrow.lib.ArrowInvalid: Cannot infer ExecBatch length without at least one value

Even if it were possible, I don't think it would be obvious to obtain the result in this way.

Component(s)

Python

Activity

  1. changed the title [-][python] Add a pyarrow.Table.aggregate function to compute aggregates against the whole table[/-] [+][Python] Add a pyarrow.Table.aggregate function to compute aggregates against the whole table[/+] on Dec 9, 2022
  2. westonpace commented on Dec 9, 2022

    @westonpace
    MemberAuthor

    Note, we may want to wait until #14867 merges as the corresponding C++ functionality will be more obvious (and tested)

  3. coady commented on Feb 11, 2023

    @coady

    Also related to #33832. Because if it's worth doing for tables, it would be even more valuable on datasets or scanners, for out-of-core aggregation.

  4. added
    Status: stale-warningIssues and PRs flagged as stale which are due to be closed if no indication otherwise
    on Feb 18, 2026
  5. thisisnic commented on Feb 18, 2026

    @thisisnic
    Member

    This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.

  6. removed
    Status: stale-warningIssues and PRs flagged as stale which are due to be closed if no indication otherwise
    on May 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions