Skip to content

Add DataFusion 56.0.0 release blog post - #217

Open
alamb wants to merge 11 commits into
apache:mainfrom
alamb:alamb/datafusion_56_blog
Open

alamb wants to merge 11 commits into
apache:mainfrom
alamb:alamb/datafusion_56_blog

Conversation

@alamb

@alamb alamb commented Nov 10, 2026 •

Copy link
Copy Markdown
Contributor

alamb and others added 2 commits November 10, 2026 12:50
Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
@alamb alamb changed the title Blog post for DataFusion 56.0.0 release Add DataFusion 56.0.0 release blog post Nov 20, 2026

### `ASOF` Joins

DataFusion 56 adds `ASOF JOIN`, a long-standing feature request ([#318])

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI @Xuanwo 🫶

[Variant shredding]: https://parquet.apache.org/docs/file-format/types/variantshredding/
[datafusion-variant roadmap]: https://github.com/datafusion-contrib/datafusion-variant/issues/69

### Geospatial Data

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI @Xuanwo I was hoping to feature geodatafusion for this blog post -- do you think that is a good idea / would the datafusion 56 integration be ready relatively shortly after datafusion 56 is released?

projects in the DataFusion ecosystem that are made possible by the
extension points in DataFusion 56.

### Semi-Structured Data (e.g. JSON)

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI @sdf-jkl I am hoping to higlight Variant here

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@alamb
alamb marked this pull request as ready for review November 20, 2026 21:59
@alamb

alamb commented Nov 20, 2026

Copy link
Copy Markdown
Contributor Author

FYI You are mentioned in the post, let me know if you would like any changes or see any omissions

@2010YOUY01 @AdamGS @adriangb @andygrove @brancz @cblp @cetra3 @comphead @cyberbeam524 @Dandandan @friendlymatthew @gadomski @geoffreyclaude @getChan @haohuaijin @ianthetechie @jay-dee7 @jayzhan211 @jonathanc-n @kosiew @Kristofferjoha @kumarUjjawal @kylebarron @lyne7-sc @M-Tesla @martin-g @matthewmturner @mbutrovich @neilconway @Omega359 @osipovartem @paleolimbot @pepijnve @peterxcli @QinXi-ai @raghuvanshraj @Rich-T-kid @sdf-jkl @sharkinsspatial @SubhamSinghal @Surajsuthar @TTyChud @viirya @Xuanwo @xudong963 @yashrb24 @yiaany @zhuqi-lucas

implement `OFFSET` pushdown, which is useful for paging through results
([#25404]). Thanks to [@SubhamSinghal], [@peterxcli], and [@martin-g].

### Faster Joins

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For JOINs we also added apache/datafusion#26249 which improved high partitioned hash joins by ~2x in TPC-DS benches.

@SubhamSinghal

Copy link
Copy Markdown

Shall we also mention PWMJ related improvements apache/datafusion#23870, apache/datafusion#25467, apache/datafusion#25840, apache/datafusion#26287 etc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants