Skip to content

GH-45877: [C++][Acero] Cleanup 64-bit temp states of Swiss join by using 32-bit - #45878

Merged
zanmato1984 merged 2 commits into
apache:mainfrom
zanmato1984:reduce-swiss-join-thread-state
Mar 24, 2025
Merged

zanmato1984 merged 2 commits into
apache:mainfrom
zanmato1984:reduce-swiss-join-thread-state

Conversation

@zanmato1984

@zanmato1984 zanmato1984 commented Mar 21, 2025 •

Copy link
Copy Markdown
Contributor

Rationale for this change

See #45877.

What changes are included in this PR?

  1. Normalize all temp states/variables representing "row id"s to uint32_t.
  2. Cleanup many DCHECKs (some added though) and static_casts.

Are these changes tested?

Existing tests should suffice.

Are there any user-facing changes?

None.

@zanmato1984
zanmato1984 requested a review from westonpace as a code owner March 21, 2025 08:43
@zanmato1984
zanmato1984 force-pushed the reduce-swiss-join-thread-state branch 3 times, most recently from f311142 to b53bd36 Compare March 21, 2025 09:46
@zanmato1984

Copy link
Copy Markdown
Contributor Author

@github-actions crossbow submit -g cpp

@zanmato1984

Copy link
Copy Markdown
Contributor Author

Nothing functional. Just some cleanup that should be quite safe already. cc @pitrou @kou . Thanks.

@github-actions

Copy link
Copy Markdown

Revision: b53bd36e92a6b11500dcc821a95407aef0eb2598

Submitted crossbow builds: ursacomputing/crossbow @ actions-3e7a3282e6

Task Status
example-cpp-minimal-build-static GitHub Actions
example-cpp-minimal-build-static-system-dependency GitHub Actions
example-cpp-tutorial GitHub Actions
test-alpine-linux-cpp GitHub Actions
test-build-cpp-fuzz GitHub Actions
test-conda-cpp GitHub Actions
test-conda-cpp-meson GitHub Actions
test-conda-cpp-valgrind GitHub Actions
test-cuda-cpp-ubuntu-22.04-cuda-11.7.1 GitHub Actions
test-debian-12-cpp-amd64 GitHub Actions
test-debian-12-cpp-i386 GitHub Actions
test-fedora-39-cpp GitHub Actions
test-ubuntu-22.04-cpp GitHub Actions
test-ubuntu-22.04-cpp-20 GitHub Actions
test-ubuntu-22.04-cpp-bundled GitHub Actions
test-ubuntu-22.04-cpp-emscripten GitHub Actions
test-ubuntu-22.04-cpp-no-threading GitHub Actions
test-ubuntu-24.04-cpp GitHub Actions
test-ubuntu-24.04-cpp-bundled-offline GitHub Actions
test-ubuntu-24.04-cpp-gcc-13-bundled GitHub Actions
test-ubuntu-24.04-cpp-gcc-14 GitHub Actions
test-ubuntu-24.04-cpp-minimal-with-formats GitHub Actions
test-ubuntu-24.04-cpp-thread-sanitizer GitHub Actions

@zanmato1984
zanmato1984 force-pushed the reduce-swiss-join-thread-state branch from f9b37fc to 7033df9 Compare March 21, 2025 10:19
@zanmato1984

Copy link
Copy Markdown
Contributor Author

@github-actions crossbow submit -g cpp

@github-actions

Copy link
Copy Markdown

Revision: 7033df9

Submitted crossbow builds: ursacomputing/crossbow @ actions-6da124e9bf

Task Status
example-cpp-minimal-build-static GitHub Actions
example-cpp-minimal-build-static-system-dependency GitHub Actions
example-cpp-tutorial GitHub Actions
test-alpine-linux-cpp GitHub Actions
test-build-cpp-fuzz GitHub Actions
test-conda-cpp GitHub Actions
test-conda-cpp-meson GitHub Actions
test-conda-cpp-valgrind GitHub Actions
test-cuda-cpp-ubuntu-22.04-cuda-11.7.1 GitHub Actions
test-debian-12-cpp-amd64 GitHub Actions
test-debian-12-cpp-i386 GitHub Actions
test-fedora-39-cpp GitHub Actions
test-ubuntu-22.04-cpp GitHub Actions
test-ubuntu-22.04-cpp-20 GitHub Actions
test-ubuntu-22.04-cpp-bundled GitHub Actions
test-ubuntu-22.04-cpp-emscripten GitHub Actions
test-ubuntu-22.04-cpp-no-threading GitHub Actions
test-ubuntu-24.04-cpp GitHub Actions
test-ubuntu-24.04-cpp-bundled-offline GitHub Actions
test-ubuntu-24.04-cpp-gcc-13-bundled GitHub Actions
test-ubuntu-24.04-cpp-gcc-14 GitHub Actions
test-ubuntu-24.04-cpp-minimal-with-formats GitHub Actions
test-ubuntu-24.04-cpp-thread-sanitizer GitHub Actions

@zanmato1984

Copy link
Copy Markdown
Contributor Author

@github-actions crossbow submit -g cpp

@github-actions

Copy link
Copy Markdown

Revision: 16c26dc

Submitted crossbow builds: ursacomputing/crossbow @ actions-48f12825c2

Task Status
example-cpp-minimal-build-static GitHub Actions
example-cpp-minimal-build-static-system-dependency GitHub Actions
example-cpp-tutorial GitHub Actions
test-alpine-linux-cpp GitHub Actions
test-build-cpp-fuzz GitHub Actions
test-conda-cpp GitHub Actions
test-conda-cpp-meson GitHub Actions
test-conda-cpp-valgrind GitHub Actions
test-cuda-cpp-ubuntu-22.04-cuda-11.7.1 GitHub Actions
test-debian-12-cpp-amd64 GitHub Actions
test-debian-12-cpp-i386 GitHub Actions
test-fedora-39-cpp GitHub Actions
test-ubuntu-22.04-cpp GitHub Actions
test-ubuntu-22.04-cpp-20 GitHub Actions
test-ubuntu-22.04-cpp-bundled GitHub Actions
test-ubuntu-22.04-cpp-emscripten GitHub Actions
test-ubuntu-22.04-cpp-no-threading GitHub Actions
test-ubuntu-24.04-cpp GitHub Actions
test-ubuntu-24.04-cpp-bundled-offline GitHub Actions
test-ubuntu-24.04-cpp-gcc-13-bundled GitHub Actions
test-ubuntu-24.04-cpp-gcc-14 GitHub Actions
test-ubuntu-24.04-cpp-minimal-with-formats GitHub Actions
test-ubuntu-24.04-cpp-thread-sanitizer GitHub Actions

@kou kou left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@github-actions github-actions Bot added awaiting merge Awaiting merge and removed awaiting review Awaiting review labels Mar 21, 2025
@zanmato1984

Copy link
Copy Markdown
Contributor Author

Thank you @kou for reviewing. I'm merging this.

@zanmato1984
zanmato1984 merged commit ea0b3c5 into apache:main Mar 24, 2025
@zanmato1984 zanmato1984 removed the awaiting merge Awaiting merge label Mar 24, 2025
@zanmato1984
zanmato1984 deleted the reduce-swiss-join-thread-state branch March 24, 2025 05:17
@conbench-apache-arrow

Copy link
Copy Markdown

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit ea0b3c5.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.

zanmato1984 added a commit to zanmato1984/arrow that referenced this pull request Apr 15, 2025
… by using 32-bit (apache#45878)

### Rationale for this change

See apache#45877.

### What changes are included in this PR?

1. Normalize all temp states/variables representing "row id"s to `uint32_t`.
2. Cleanup many `DCHECK`s (some added though) and `static_cast`s.

### Are these changes tested?

Existing tests should suffice.

### Are there any user-facing changes?

None.

* GitHub Issue: apache#45877

Authored-by: Rossi Sun <zanmato1984@gmail.com>
Signed-off-by: Rossi Sun <zanmato1984@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants