Skip to content

docs(runbook): say why the Rules page counts one more than we do - #303

Merged
Gerrrt merged 1 commit into
mainfrom
gerrrt/deploy-runbook-rule-count
Sep 4, 2026
Merged

Gerrrt merged 1 commit into
mainfrom
gerrrt/deploy-runbook-rule-count

Conversation

@Gerrrt

@Gerrrt Gerrrt commented Sep 4, 2026

Copy link
Copy Markdown
Owner

Found while verifying the #114 deploy: docs/runbooks/deploy-stack.md step 2
says "56 rules loaded, none in error", and Prometheus' Rules page shows 57.

The extra one is homelab_suricata_expected_interface, the stack's only
recording rule. Everything this repository counts is alert rules.

This is pre-existing rather than something #114 introduced — the line said 53
when the page showed 54, and 39 when it showed 40. But it is the least useful
kind of wrong: an operator running the post-deploy check finds a number that
does not match and cannot tell whether that is this discrepancy or a real one.

Kept as "56 rules loaded" rather than rephrased, because scripts/check_docs.py
matches on exactly that phrase and moving the count into prose would retire the
check without saying so — the failure mode docs/observability.md warns about
two paragraphs below its own count.

Verified: ./scripts/check_docs.py still reads the claim (docs OK — 56 Prometheus + 16 Loki rules), and markdownlint passes.

🤖 Generated with Claude Code

Step 2 of the post-deploy check says "56 rules loaded, none in error", and the
page it points at lists 57. The extra is `homelab_suricata_expected_interface`,
the stack's only recording rule; every count in this repository — README,
docs/observability.md, scripts/check_docs.py — is alert rules.

The mismatch is not new. The line said 53 when the page showed 54, and 39 when
it showed 40. It has been off by exactly one recording rule since that rule was
added, which is the least useful kind of wrong: an operator following the
runbook after a deploy finds a number that does not match and has no way to
tell whether that is the discrepancy or a real one.

Kept as "56 rules loaded" so scripts/check_docs.py still reads the claim — it
matches on that phrase, and burying the count in prose would silently retire
the check.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@Gerrrt
Gerrrt merged commit 54f8f99 into main Sep 4, 2026
3 checks passed
@Gerrrt
Gerrrt deleted the gerrrt/deploy-runbook-rule-count branch September 4, 2026 22:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant