You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Python] Add missing APIs to RecordBatch class #36399
I think there is also an open question as to what type join and join_asof should return. I'm not sure it makes sense for these methods to return a RecordBatch since, depending on the data and join type, they may return many more rows than either of the input RecordBatches. The obvious option would then be to return a Table or a RecordBatchReader. A Table might be more immediately useful to consumers as it allows for methods to be chained without calling .read_all, however, a RecordBatchReader in some ways makes more sense given that cases where the users is operating on a RecordBatch are likely to be cases where streaming type workflows are preferable.
This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.
Activity
jorisvandenbossche commentedon Jun 30, 2023
Thanks for the overview!
I would personally start with the methods to manipulate the RecordBatch, i.e. the ones for adding/removing/renaming columns, and
cast.jorisvandenbossche commentedon Mar 15, 2024
With #39506 merged, the remaining relevant methods missing on RecordBatch are:
GH-30915: [C++][Python] Add missing methods to `RecordBatch` (#39506)
judahrand commentedon Mar 18, 2024
And now that #34234 is merged
join_asofas well?judahrand commentedon Mar 18, 2024
I think there is also an open question as to what type
joinandjoin_asofshould return. I'm not sure it makes sense for these methods to return aRecordBatchsince, depending on the data and join type, they may return many more rows than either of the inputRecordBatches. The obvious option would then be to return aTableor aRecordBatchReader. ATablemight be more immediately useful to consumers as it allows for methods to be chained without calling.read_all, however, aRecordBatchReaderin some ways makes more sense given that cases where the users is operating on aRecordBatchare likely to be cases where streaming type workflows are preferable.What do you think @jorisvandenbossche?
GH-36399: [Python] Add missing `shape` property to `RecordBatch` (#40643
thisisnic commentedon Feb 18, 2026
This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.