September 11, 2026 · MarkTechPost
Anthropic adds automated evaluation tooling for Claude Code plugins
Anthropic released a claude plugin eval command that runs a Claude Code plugin against realistic prompts, grades the output using six grader types, and compares results against a run with no plugin loaded. It can be wired into continuous integration (CI) as a gate before shipping.
Why it matters: As Claude Code's plugin and skill ecosystem grows, developers previously had no standard way to verify a plugin does what it claims versus just adding noise; a built-in eval and CI gate gives plugin authors a way to catch regressions before they reach users.