Promptfoo
Config-file-driven open-source CLI for prompt evals, regression testing and LLM red-teaming that runs in CI.
| Category | Evals & Testing |
| Open source | Yes |
| Self-hostable | Yes |
| Pricing model | freemium |
| Pricing notes | CLI/library free (MIT); paid enterprise for red-teaming at scale |
| Framework integrations | openai-sdk, anthropic, langchain, ollama, vercel-ai |
| Funding / ownership | $5M seed (a16z, 2024) |
| GitHub stars | 22,159 |
| Maintenance | active (commit 2026-06-13) |
| License (GitHub) | MIT |
| Open issues | 320 |
| Maturity signal | 100/100 (Mature) — computed from public GitHub signals, see methodology |
Pricing/feature source: https://www.promptfoo.dev/pricing/
Maturity signal is computed from public GitHub data only. How it is calculated.
Frequently asked questions
Is Promptfoo open source?
Yes. Licensed under MIT.
Can I self-host Promptfoo?
Yes — Promptfoo can run in your own infrastructure.
How much does Promptfoo cost?
Freemium. CLI/library free (MIT); paid enterprise for red-teaming at scale