behavioral-testing

CRAB (Clean Rebuild of Anything's Behavior): rebuild software from behavior, not source code. An MCP-powered toolkit for black-box observation, clean-room reimplementation, and behavioral verification.

AgentBehaviorBench (ABB): A benchmark for evaluating AI agents’ ability to test other agents and detect behavioral defects.

Community-driven behavioral reliability benchmark for LLMs. 231 probes across 19 modules, deterministic scoring, perplexity correlation, layer sensitivity mapping, quant method capture, hardware-stratified community rankings. Every test contributes to the community dataset.

Runtime behavioral contracts for AI agents: define YAML contracts, check adapter outputs, and raise explicit contract violations. Agent Behavioral Contracts (ABC).

LLM drift detector — know within 5 min when GPT-4o, Claude, or Gemini silently changes behaviour. Open source, self-hostable.

Executable behavioral contracts and hidden-evaluation harness for coding agents across nine software domains.

🩺 Behavioral testing for skill triggers — diagnose why a skill never fires (or fires too often), prescribe a fixed description, save a regression suite. One SKILL.md, 79 agents (Claude Code, Hermes, Codex, Gemini...)

A toolkit for controlled behavioral evaluation of LLMs

Model behavioral diffing - compare LLM outputs across versions, detect regressions.

Agent Skill for Claude Code that measures whether coding agents actually follow a skill, rule or agent definition: it generates scenarios from supportive to competing prompts, runs an agent on each, and reports compliance rates with classified tool call timelines.

Behavioral regression testing for LLMs — diff, drift, fingerprint. Zero deps.

E2E behavioral testing for AI agents — grounded in 24 research papers. pip install agentgate-eval

AI agent behavioral testing — learns what correct looks like, catches deviations automatically. Zero API keys needed.

How does a model behave when nobody told it what to do? This protocol observes LLM defaults before asking about preferences, then packages the findings into a reusable profile. Works on local Ollama models and cloud APIs alike.

Open-source ML behavioral regression testing for comparing decision-system versions, identifying changed actions, attributing shifts, and gating releases with Decision Contracts.

AI persona-based behavioral testing for web apps. No test scripts. YAML-configured. Vision-powered.

Offline detection-as-code lab for original Sigma rules, synthetic behavioral tests, ATT&CK mapping, coverage analysis, and pySigma query conversion.

Production-grade LLM evaluation framework measuring model behavior across 5 dimensions with human-vs-LLM judge agreement validation and Cohen's Kappa scoring

Behavioral regression testing across LLMs by task type