Skip to content

ci: give Test (runtime) 15 minutes - #7627

Merged
jrusso1020 merged 1 commit into
mainfrom
ci/runtime-test-timeout
Nov 12, 2026
Merged

jrusso1020 merged 1 commit into
mainfrom
ci/runtime-test-timeout

Conversation

@jrusso1020

Copy link
Copy Markdown
Collaborator

What

Raises the Test (runtime) job limit from 10 to 15 minutes, the same as Test (studio). Core plus engine tests now take 8 to 10 minutes, so the 10 minute limit cancels runs that are about to pass and dequeues their PRs.

Why

The job is under the required Test context, so each cancel takes the PR out of the merge queue as failed checks. On 2026-11-12:

Related work

None. Splitting core and engine into two jobs would also cut wall time, and is a possible follow-up.

How

One line in .github/workflows/ci.yml, plus a comment saying why.

Test plan

  • Unit tests added/updated
  • Manual testing performed
  • Documentation updated (if applicable)
  • Comments follow CONTRIBUTING.md "Comments": they say why, not what, and a bug fix says what the code must do and how to reproduce the bug

This PR's own CI runs the job with the new limit.

Claude Opus 5.5

Timing evidence

The test step (bun run --filter '@hyperframes/{core,engine}' test) takes about 510s of the job. Checkout takes about 21s and workspace setup about 61s. Sampled main push durations over the last day ranged from 417s to 598s, so the job is already close to the limit on most runs, not just slow ones.

🤖 Generated with Claude Code

Core plus engine tests now take 8-10 minutes, so the 10 minute limit
cancels runs that are about to pass and dequeues their PRs from the
merge queue as failed checks. Match Test (studio)'s 15 minute limit.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Edit accuracy: accurate 267 (base branch 267), smooth 102 of those

The gate passes.
Smoothness is reported in the artifact, not gated. A case fails only if it fails 2 of 3 runs.

Quarantined, measured but not gated (8)

@heygengenesis heygengenesis Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verdict: APPROVE · 0 blocker · 0 important · 0 nits · head 3a1d9c8

Checked the timing claims against the runs. In merge-group run 43320080170, the core+engine test step finished green at 22:37:49, and the job was cancelled at its 10:00 limit at 22:37:53. On this head, Test (runtime) took 9m38s. 15 min matches Test (studio). The Test aggregator (3 min timeout) waits on its needs before it starts, so the change doesn't affect it, and no script pins this job's timeout.

@jrusso1020
jrusso1020 added this pull request to the merge queue Nov 12, 2026
Merged via the queue into main with commit d30f1f4 Nov 12, 2026
80 checks passed
@jrusso1020
jrusso1020 deleted the ci/runtime-test-timeout branch November 12, 2026 23:36
@miguel-heygen miguel-heygen mentioned this pull request Nov 13, 2026
3 of 5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant