promptfoo-evaluation
An agent skill by daymade, from daymade/claude-code-skills. Tags: ai, evaluation, python, testing, validation.
What it does
Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts. Triggers on keywords like "promptfoo", "eval", "LLM evaluation", "prompt testing", or "model comparison".
Install
With the skills CLI, which installs into Claude Code, Codex, Cursor and other agents:
npx skills add daymade/claude-code-skills --skill promptfoo-evaluationOr copy the skill folder into Claude Code's skills directory by hand (~/.claude/skills for every project, or .claude/skills inside one):
git clone --depth 1 https://github.com/daymade/claude-code-skills
cp -r claude-code-skills/promptfoo-evaluation ~/.claude/skills/promptfoo-evaluationSafety box score
Not rated yet. A safety box score grades what a skill and its scripts can reach on the machine of whoever installs it, across eight categories from shell execution to secrets access. Anyone can request one from this page; it is saved for everyone. How the score works.
Source
- Repository
- daymade/claude-code-skills (all skills from this repository)
- Path
- promptfoo-evaluation/SKILL.md
- Branch
- main
- Updated
- 2026-09-20
Related skills
- ab-testing — When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program.
- agents-pay — Use when THIS agent needs to pay for x402-protected content at runtime: hitting a paywall mid-task, settling it via AgentCore Payments.
- atheris — Sets up and runs Atheris, the coverage-guided Python fuzzer built on libFuzzer.
- aws-sdk-python-usage — AWS SDK for Python (boto3/botocore) development patterns. You MUST use this skill when writing Python code that uses AWS services via boto3 or botocore.
- fp-check — Systematically verifies suspected security bugs to eliminate false positives.
- pentesting-with-aws-security-agent — Run an AWS Security Agent penetration test against a live web application — registers and verifies the target domain.