Repository navigation
rpc-cost: Solana-only vendors are unranked with a reason, not unavailable - #3170
Merged
Merged
Conversation
…lable, 0 %" Major from the second 2026-10-22 audit of bench 282. On the unfiltered view the loader backfills every declared provider without a figure as availability "unavailable" with successRate 0. On the two RPC cost benches that missing figure is a product fact: Helius, Syndica and Triton sell Solana only and the default view is the Ethereum dapp mix. The variant API, /api/stat and MCP therefore listed three products that lead Solana cells as dead, on a bench that sends no traffic. They are now pushed as unranked rows carrying the not-served label, the shape spec-declared unranked members already use, which every ranking helper skips. MCP rows carry no success rate on a bench with ledger_reliability: false. Also: the polled-artifact count is 25, not 24 (Prometheus agrees), and the FAQ no longer says no provider was billed while two other answers describe Chainstack's measured billing.
bakabhai993
pushed a commit
to bakabhai993/OpenChainBench
that referenced
this pull request
Oct 23, 2026
…lable, 0 %" (ChainBench#3170) Major from the second 2026-10-22 audit of bench 282. On the unfiltered view the loader backfills every declared provider without a figure as availability "unavailable" with successRate 0. On the two RPC cost benches that missing figure is a product fact: Helius, Syndica and Triton sell Solana only and the default view is the Ethereum dapp mix. The variant API, /api/stat and MCP therefore listed three products that lead Solana cells as dead, on a bench that sends no traffic. They are now pushed as unranked rows carrying the not-served label, the shape spec-declared unranked members already use, which every ranking helper skips. MCP rows carry no success rate on a bench with ledger_reliability: false. Also: the polled-artifact count is 25, not 24 (Prometheus agrees), and the FAQ no longer says no provider was billed while two other answers describe Chainstack's measured billing. (cherry picked from commit 0cd7bdc, without benchmarks/rpc-cost.yml: main does not carry it)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Major of the second 2026-10-22 audit of bench 282: the unfiltered-view backfill marked Helius, Syndica and Triton
unavailable,successRate: 0in the variant API, /api/stat and MCP. On the two RPC cost benches they are now unranked rows labelled with the not-served reason (same shape as spec-declared unranked members, skipped by every ranking helper). MCP omits success rate onledger_reliability: falsebenches. Minors: artifact count 24 → 25; FAQ billing sentence no longer contradicts the Chainstack measurement.Checks:
pnpm validate,tsc,bun test src/(712 pass).