Skip to content

CI: report-only Si5351 regression tests - #111

Merged
NT7S merged 4 commits into
masterfrom
ci-regression-tests
Oct 30, 2026
Merged

NT7S merged 4 commits into
masterfrom
ci-regression-tests

Conversation

@NT7S

@NT7S NT7S commented Oct 30, 2026 •

Copy link
Copy Markdown
Member

Adds Test Lab's Si5351 regression harness under tests/regression and a GitHub Actions workflow (.github/workflows/regression.yml) that runs it on every pull request and on pushes to non-master branches.

Report-only. This is not a required check and never gates merges. No branch protection changes. Existing main.yml (lint/compile) and size-deltas.yml are untouched. No license changes.

Approved by Jason Milldrum (NT7S) on 2026-10-30.

What it runs

tests/regression/run_v231_checks.sh --src $GITHUB_WORKSPACE builds src/si5351.cpp natively with g++ against host Arduino/Wire stubs, then checks:

A summary is written to the job summary, and logs are uploaded as an artifact.

Expected status on master

Green: PASS 7, XFAIL 25 (v2.3.1 bugs), INFO 3, 0 FAIL. Latest run on the PR: https://github.com/etherkit/Si5351Arduino/actions/runs/41141012656 (green, same counts).

Harness by Test Lab, vendored unchanged from its working copy (ci/, without generated runs/).

Notes

  • tests/regression/sketches/Ctor106/Ctor106.ino is stored as Ctor106.ino.txt, because arduino-lint in main.yml rejects sketches outside examples/. run_v231_checks.sh copies it back to .ino when it builds with --cores. That's the only change from Test Lab's copy.
  • The existing CI workflow's compile jobs fail on this PR, and that isn't caused by this change. ubuntu-latest is now Ubuntu 26.04, and arduino/compile-sketches@v1 asks for Python 3.12.4, which isn't available for 26.04. Lint passes. main.yml is left untouched as asked, so this needs its own fix, such as pinning runs-on: ubuntu-24.04.

@NT7S
NT7S merged commit 87d7b47 into master Oct 30, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant