You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
datalake_fdw: storage I/O over object storage (S3) #2009
Part of #2008. Letters (A, B0–B7, C, D, E) are the PRs listed there; this is A.
Scope
An S3 backend (AWS SDK for C++) in backend_registry, configured from the volume server and user-mapping options the validator already accepts (endpoint, region, path style, credentials, session token).
Arrow RandomAccessFile / OutputStream adapters over common/file_system_wrapper.h; parquet_read.cpp and parquet_write.cpp are the only format files that change.
The writer's rule carried over: an object is created once, never overwritten, and a failed writer removes exactly that object.
A storage_s3 smoke category against MinIO, and the CI job that starts MinIO (the CATEGORY_SERVICES hook in run_smoke_tests.sh).
Out of scope
HDFS (libhdfs3 is unmaintained; the wrapper leaves room for a second backend). Iceberg path layout (C).
Activity
datalake_fdw: add S3 storage and pluggable backends (apache#2044)