Skip to content

feat(evalboard): add a Studio Web badge and keep the front-page cache warm - #251

Merged
bai-uipath merged 3 commits into
mainfrom
bai/evalboard-studio-web-icon
Nov 6, 2026
Merged

bai-uipath merged 3 commits into
mainfrom
bai/evalboard-studio-web-icon

Conversation

@bai-uipath

@bai-uipath bai-uipath commented Nov 6, 2026 •

Copy link
Copy Markdown
Collaborator

Two front-page fixes. Runs on the studio-web harness had no badge, so the evalboard printed the raw id "studio-web" where every other harness shows its mark. And the front page is sometimes slow: the per-run cache is per process, so after a restart or when a recent run's cache entry expires, the next visitor re-reads and re-parses every run in the 30-day window before anything renders.

Changes

  • Studio Web badge. evalboard/public/harness/studio-web.png is a 128×128 "SW" tile in the UiPath logo's orange outline style, the same size as the other harness logos. It reads as a UiPath harness, and the letters tell it apart from Delegate's "Ui". harness-badge.tsx maps studio-web to it: alt text "Studio Web · UiPath", short label "Studio Web".
  • Background cache warming. lib/warm.ts, started from instrumentation.ts, requests the server's own / 15 s after start and then every 4 minutes, under the 5-minute cache lifetime of a recent run. The warm request pays for a rebuild instead of a visitor.
    • It targets the host and port the standalone server binds (HOSTNAME, PORT).
    • It skips a round while the previous one is still rendering, and logs a warning on a failed request without ever throwing.
    • It runs in production only. EVALBOARD_WARM_INTERVAL_SECONDS sets the interval, and 0 turns it off (documented in the README).
  • Out of scope: the chart series color for studio-web stays the neutral fallback. The container listing is still uncached per render.

Validation

Check Result
vitest run 829 passed, including 8 new warmer tests (off outside production, interval parsing, target URL, first warm then interval, no overlap, failures warn and the next round runs)
tsc --noEmit, next build Clean
Standalone server (node server.js) on a local runs mirror, first visitor 45 s after start 0.35 s with warming off, 0.07 s with warming on. Local disk makes the cold cost small; in production it comes from blob reads.
Local front page with four synthetic runs Studio Web badge in the selector, the legend and the runs table (screenshot below)

Studio Web badge on the evalboard front page, with synthetic runs

🤖 Generated with Claude Code

bai-uipath and others added 3 commits November 6, 2026 14:00
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…e outline style

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The per-run cache is per process, so after a restart or when a recent run's
entry expires, the next visitor re-read and re-parsed every run in the window.
The server now requests its own front page 15 s after start and every 4
minutes, so that request pays for the rebuild instead.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@bai-uipath bai-uipath changed the title feat(evalboard): give Studio Web runs their own harness badge feat(evalboard): add a Studio Web badge and keep the front-page cache warm Nov 6, 2026
@bai-uipath
bai-uipath marked this pull request as ready for review November 6, 2026 22:14
@github-actions

github-actions Bot commented Nov 6, 2026 •

Copy link
Copy Markdown

Claude finished @bai-uipath's task in 1m 36s —— View job


🔍 Reviewing PR #251

Working on review...

Todo List:

  • Read .github/code_review.md for review standards
  • Read CLAUDE.md for project conventions
  • Get full diff with git diff origin/main...HEAD
  • Read and analyze each changed file in full
  • Perform cross-file consistency checks
  • Analyze design decisions and what's missing
  • Post comprehensive review

@uipreliga uipreliga left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚢

@bai-uipath
bai-uipath merged commit 68cd17f into main Nov 6, 2026
18 of 19 checks passed
@bai-uipath
bai-uipath deleted the bai/evalboard-studio-web-icon branch November 6, 2026 22:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants