You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Flight] Add received bytes to ipc::ReadStats #47171
Hi @rustyconover , a similar discussion was raised on the PR linked above about exposing the arrow::ipc::ReadStats to the FligthStreamReader with the changes we implemented to have dictionary replacement and dictionary deltas for Flight DoGet (DoExchange on the works). Are those the stats you were looking for, or were you referring to other type of stats?
I'm mostly interested in measures of bytes received. That way I can surface it in the EXPLAIN ANALYZE output of Airport in DuckDB to show users how much data they read from the Flight server.
Exposing the existing ipc::ReadStats in the FlightStreamReader PR has been merged. We can update the title for this issue to specifically request for the total size in bytes of the data read to be added to ipc::ReadStats. It would be inline with the ipc::WriteStats were we already have:
This issue has been marked as stale because it has had no activity in the past 365 days. Please remove the stale label or comment below, or this issue will be closed in 14 days. If this improvement is still desired but has no current owner, please add the 'Status: needs champion' label.
Activity
raulcd commentedon Aug 19, 2025
Hi @rustyconover , a similar discussion was raised on the PR linked above about exposing the
arrow::ipc::ReadStatsto theFligthStreamReaderwith the changes we implemented to have dictionary replacement and dictionary deltas for Flight DoGet (DoExchange on the works). Are those the stats you were looking for, or were you referring to other type of stats?arrow/cpp/src/arrow/ipc/reader.h
Lines 47 to 62 in 69d2487
rustyconover commentedon Aug 21, 2025
Hi @raulcd,
I'm mostly interested in measures of bytes received. That way I can surface it in the
EXPLAIN ANALYZEoutput of Airport in DuckDB to show users how much data they read from the Flight server.Rusty
raulcd commentedon Aug 25, 2025
Thanks @rustyconover , as a first step I've created:
To expose the existing
ReadStatsinFlightStreamReader.We can probably rename this issue to explicitly add bytes received to
ReadStats?raulcd commentedon Sep 4, 2025
Exposing the existing
ipc::ReadStatsin theFlightStreamReaderPR has been merged. We can update the title for this issue to specifically request for the total size in bytes of the data read to be added toipc::ReadStats. It would be inline with theipc::WriteStatswere we already have:arrow/cpp/src/arrow/ipc/writer.h
Lines 81 to 85 in 69d2487
[-][Flight] Return read stats from FlightStreamReader[/-][+][Flight] Add received bytes to ipc::ReadStats[/+]rustyconover commentedon Sep 27, 2025
@raulcd thanks for making this go forward. I'll be looking to try it out shortly and match catch up with you in Paris.
github-actions commentedon Sep 28, 2026
This issue has been marked as stale because it has had no activity in the past 365 days. Please remove the stale label or comment below, or this issue will be closed in 14 days. If this improvement is still desired but has no current owner, please add the 'Status: needs champion' label.