Skip to content

chore: sync Apache DataFusion branch-55 updates - #87

Merged
osipovartem merged 6 commits into
embucket-sync-df55.0.0from
sync-df55-1.1
Sep 13, 2026
Merged

osipovartem merged 6 commits into
embucket-sync-df55.0.0from
sync-df55-1.1

Conversation

@osipovartem

Copy link
Copy Markdown
Collaborator

Summary

  • merge the five latest Apache branch-55 commits into the Embucket DF55 branch
  • update the fork to DataFusion 55.1.0
  • include upstream cast target-field metadata propagation and projection metadata preservation
  • retain Embucket Snowflake planner and optimizer changes

Conflict resolution

  • combined independent scalar-subquery and cast-metadata test imports
  • selected the upstream general projection metadata preservation implementation
  • updated the existing Embucket projection regression test to assert that metadata-overriding projections are retained
  • accepted the upstream h2 lockfile update

Validation

  • cargo +1.95.0 fmt --all -- --check
  • datafusion-expr: target field metadata cast test passed
  • datafusion-physical-expr: 3 cast lowering metadata tests passed
  • datafusion-physical-plan: 16/17 metadata-filtered tests passed initially; the only failure was the obsolete optimizer-transformed expectation in the Embucket regression test
  • updated regression test passed after aligning it with the upstream no-removal contract

timsaucer and others added 6 commits September 2, 2026 09:40
… and new_default (apache#24582) (apache#24876)

This is a back port of apache#24582 into `branch-55` for inclusion in 55.1.0.
Please see the original PR for details.

Co-authored-by: Unik Dahal <61407386+unikdahal@users.noreply.github.com>
This is a small update to the Cargo.lock file to update

- chacha20 v0.10.0 -> v0.10.2
- h2 v0.4.13 -> v0.4.19

The first was due to a yanked crate. The second was due to a security
vulnerability, RUSTSEC-2026-0258.

The yanked crate is a warning in cargo audit and will auto-resolve on
building to the newer 0.10.2, and the security vulnerability is already
updated in `main`.
…asts (apache#23169) (apache#24875)

This PR is a backport of apache#23169 onto `branch-55`. 

I made one update the `use` statement in `planner.rs`.

Co-authored-by: Dewey Dunnington <dewey@wherobots.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
…ache#24670) (apache#24992)

Backports apache#24670 to branch-55.

Co-authored-by: Tim Saucer <timsaucer@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
This PR updates the version number and changelog for the 55.1.0 release.
# Conflicts:
#	Cargo.lock
#	datafusion/physical-expr/src/planner.rs
#	datafusion/physical-plan/src/projection.rs
@osipovartem
osipovartem merged commit 4ba4fc0 into embucket-sync-df55.0.0 Sep 13, 2026
19 of 21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants