You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Add DuckDB partitioned Parquet cleaning and export recipe #495
As outlined in the Contributor Roadmap, DuckDB is widely used for analytical pipelines querying partitioned Parquet datasets. Providing a standalone recipe makes it easy for developers to clean and export partitioned datasets.
Task
Add a runnable example script in examples/integrations/duckdb_parquet_export.py showing how to read a partitioned Parquet dataset, clean it using FreshData, and write the cleaned result back out using DuckDB.
Acceptance Criteria
Create examples/integrations/duckdb_parquet_export.py with standalone, executable code.
Demonstrates creating/loading a multi-partition Parquet directory, executing fd.clean(), and exporting back to DuckDB table or Parquet destination.
Document required dependency (pip install "freshdata-cleaner[duckdb]") in script docstring.
Register the new recipe in examples/README.md.
Script runs cleanly without errors via python examples/integrations/duckdb_parquet_export.py.
Activity
Lan-Anh-12 commentedon Sep 27, 2026
Hi @JohnnyWilson16,
I would like to work on this DuckDB partitioned Parquet recipe. Could you please assign this issue to me?
Thank you!
JohnnyWilson16 commentedon Sep 27, 2026
Assigned to you, @Lan-Anh-12. Looking forward to the PR!