Skip to content

feat(cuda): CUDA/cuDF C++ reproducible setup with Pixi - #11436

Merged
0ax1 merged 7 commits into
developfrom
ad/cudf-test-environment
Nov 16, 2026
Merged

0ax1 merged 7 commits into
developfrom
ad/cudf-test-environment

Conversation

@0ax1

@0ax1 0ax1 commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Add a Pixi environment with the dependencies needed to build and test CUDA/cuDF C++ code.

  • Include cuDF, GTest, CMake/Ninja, and C++/CUDA compilers.
  • Check in a lockfile for Linux x86-64 and AArch64, with CUDA pinned to 13.0 for CI driver compatibility.
  • Document how to install Pixi and enter the environment.

This PR only adds the environment and documentation.

0ax1 added 2 commits November 13, 2026 11:36
Pin prebuilt cuDF, GTest, CUDA 13.0 compilers and build tools for Linux x86-64 and AArch64. Exercise a CUDA kernel and cuDF binary operation in a path-scoped GPU smoke workflow, independently of Cargo and BenchPress.

Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@0ax1 0ax1 changed the title ci(cuda): add locked cuDF C++ test environment ci(cuda): add shared locked C++ and Python cuDF environments Nov 13, 2026
Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@0ax1 0ax1 changed the title ci(cuda): add shared locked C++ and Python cuDF environments ci(cuda): add reproducible cuDF GPU test infrastructure Nov 13, 2026
@0ax1 0ax1 changed the title ci(cuda): add reproducible cuDF GPU test infrastructure ci(cuda): reproducible cuDF env with Pixi Nov 13, 2026
@0ax1 0ax1 changed the title ci(cuda): reproducible cuDF env with Pixi ci(cuda): reproducible CUDA env with Pixi Nov 13, 2026
Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@0ax1 0ax1 changed the title ci(cuda): reproducible CUDA env with Pixi build(cuda): add a locked Pixi environment for cuDF C++ Nov 16, 2026
0ax1 added 2 commits November 16, 2026 10:56
Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@0ax1 0ax1 changed the title build(cuda): add a locked Pixi environment for cuDF C++ build(cuda): make CUDA/cuDF C++ setup reproducible with Pixi Nov 16, 2026
@0ax1
0ax1 marked this pull request as ready for review November 16, 2026 11:24
@0ax1 0ax1 changed the title build(cuda): make CUDA/cuDF C++ setup reproducible with Pixi feat(cuda): CUDA/cuDF C++ reproducible setup with Pixi Nov 16, 2026
@0ax1 0ax1 added the changelog/feature A new feature label Nov 16, 2026
@0ax1
0ax1 enabled auto-merge (squash) November 16, 2026 11:26
Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@codspeed

codspeed Bot commented Nov 16, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 12.27%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

❌ 3 regressed benchmarks
✅ 1983 untouched benchmarks
⏩ 6 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Walltime compare_u8_neon 1.6 µs 1.8 µs -13.03%
❌ Walltime compare_int_nullable_neon 4.2 µs 4.8 µs -11.97%
❌ Walltime compare_int_constant_neon 3.3 µs 3.7 µs -11.8%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ad/cudf-test-environment (f58f45c) with develop (6b0bb31)

Open in CodSpeed

Footnotes

  1. 6 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@0ax1
0ax1 merged commit acde560 into develop Nov 16, 2026
77 of 78 checks passed
@0ax1
0ax1 deleted the ad/cudf-test-environment branch November 16, 2026 11:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants