Standards for building agents, better
-
Updated
Jun 3, 2026 - TypeScript
#
agent-testing
Here are 147 public repositories matching this topic...
Agentic testing for agentic codebases
-
Updated
Sep 9, 2026 - Python
AI agents can generate code, but they still struggle to understand what they build. Reticle gives them runtime perception of web & desktop applications.
automated-testing testing-tool ai-testing-tool agent-skills claude-code playwright-mcp agent-testing agent-verification claude-skills agent-skill skills-sh proof-layer reticle-mcp
-
Updated
Sep 9, 2026 - TypeScript
The definitive benchmark for AI agents on OpenClaw. 45 tasks across 4 tiers. Powered by MyClaw.ai
-
Updated
Jul 20, 2026 - Python
Playwright for coding agents. Benchmark Claude Code, Codex, Gemini, and OpenCode on your own tasks - and test that your skills, MCP servers, and CLIs work when an agent uses them. Sandboxed YAML suites, activation checks, A/B experiments, CI gates.
gemini regression-testing codex evaluation-framework claude github-actions anthropic coding-agents agent-skills claude-code agent-evaluation swe-bench agent-testing terminal-bench claude-agent-sdk claude-code-plugins-marketplace claude-skills claude-code-skills skill-testing long-horizon-agents
-
Updated
Sep 9, 2026 - Python
Ship agents you can audit.
-
Updated
Nov 9, 2025 - Python
Testing and observability for multi-agent delegation, MCP tools, permissions, sandboxed actions, prompts, and workflow replay.
mcp multi-agent ai-agents ai-security ai-agent model-context-protocol agent-orchestration agent-security agent-testing
-
Updated
Aug 14, 2026 - TypeScript
Agent Verifier is a coding agent skill that verifies code against organizational policies, code quality patterns, security requirements, and framework best practices — before code ships. Works with Claude Code, Cursor, Windsurf, and 30+ agents.
security skills devtools code-review code-quality cursor cline windsurf code-verification ai-agent langgraph agent-skills claude-code ai-coding-assistant coding-agent agent-testing agent-verification
-
Updated
Aug 27, 2026
The open-source MultiAgentOps evaluation and verification harness for any industry business workflow.
python open-source benchmarking data-science multi-agent-systems ai-agents industries agentops llm generative-ai llm-tools ai-agents-framework ai-agent-tools agent-observability agent-testing evaluation-harness agent-verification ai-reliability business-workflow-automation agent-debugging
-
Updated
Sep 9, 2026 - Python
Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI
python mcp pytest agents ai-safety ai-agents red-teaming rag llmops prompt-injection genai evals llm-evaluation hallucination-detection llm-testing agent-evaluation ai-red-teaming agent-testing adversarial-testing
-
Updated
Aug 14, 2026 - Python
Toolkit for AI whitehats, internal red teams, llm bug bounty hunters and mlops - Adversarial testing for AI, LLMs, and Agents.
ai-safety ai-security ai-red-team llm-security llm-testing ai-red-teaming agent-testing adversarial-testing ai-bug-bounty
-
Updated
Jul 31, 2026 - Python
The Regression Testing Framework for AI Agents. Replay · Evaluate · Assert · Catch Regressions — in CI. Like Jest for your AI layer.
coverage typescript jest nextjs devtools assertions ci-cd developer-tools regression-testing replay testing-framework ai-agents playwright agentops ai-agent prompt-engineering ai-testing llm-evaluation llm-testing agent-testing
-
Updated
Jul 17, 2026 - TypeScript
infrastructure chaos to test the resilience of ai agents
python testing reliability stress-testing developer-tools resilience-testing fault-injection ai-safety chaos-testing ai-agents chaos-engineering llm agent-testing
-
Updated
May 24, 2026 - Python
Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit prompts.
nodejs testing cli diff typescript ai tracing openai developer-tools regression-testing agents observability ai-agents ai-tools llm llmops anthropic evals llm-evaluation agent-testing
-
Updated
Aug 6, 2026 - TypeScript
Record-and-replay for agent decision graphs: reproduce a prod agent failure as a committed regression test, and re-run your fix without live LLM calls.
-
Updated
Sep 3, 2026 - Python
Turn failed AI agent runs into replayable regression tests. Catch regressions before you ship.
python open-source sdk regression-testing ai-agents release-control prompt-testing llm-ops llm-testing ai-infrastructure agent-ops agent-testing ai-reliability replay-testing
-
Updated
Jun 4, 2026 - Python
Typed Kotlin DSL framework for AI agent systems.
kotlin open-source automation ai mcp kotlin-dsl multi-agent-systems ai-agents agent-oriented-programming a2a agent-framework llm compile-time-safety genai llm-agent agentic-framework agentic-workflow agentframeworks aiagentframework agent-testing
-
Updated
Sep 1, 2026 - Kotlin
GitHub template for agent-testable SaaS apps. Next.js 16 + shadcn/ui + Neon Postgres + agent-browser e2e testing via accessibility tree.
react open-source typescript accessibility nextjs a11y ai-agents saas-template shadcn-ui drizzle-orm neon-postgres agent-testing
-
Updated
Mar 3, 2026 - TypeScript
Behavior-regression testing for LLM agents. 4-class attribution, 6-field FAIL schema, $-cost gating, flaky detection. Bash + jq. Works with opencode today, runner-pluggable.
bash opencode ci-cd developer-tools regression-testing eval ai-agents claude prompt-engineering llmops anthropic llm-evaluation llm-testing agent-testing
-
Updated
Jul 3, 2026 - Shell
pytest plugin for deterministic testing of AI agents. Assert agent actions, not vibes.
-
Updated
Jun 19, 2026 - Python
Add this topic to your repo
To associate your repository with the agent-testing topic, visit your repo's landing page and select "manage topics."