Promptfoo
by Promptfoo · open-source · Last verified 2026-03-17
Open-source tool for testing and evaluating LLM outputs with systematic prompt comparison. Provides a CLI and web UI for running evaluations across multiple models with custom assertions and red teaming.
https://promptfoo.dev ↗C+
C+—Average
Adoption: C+Quality: AFreshness: A+Citations: C+Engagement: F
Specifications
- License
- MIT
- Pricing
- open-source
- Capabilities
- prompt-evaluation, model-comparison, red-teaming, custom-assertions, ci-cd-integration
- Integrations
- openai, anthropic, langchain, ollama
- Use Cases
- prompt-testing, model-selection, red-teaming, regression-testing
- API Available
- Yes
- SDK Languages
- typescript, python
- Deployment
- self-hosted, cli
- Rate Limits
- N/A (open-source)
- Data Privacy
- Self-hosted, user-managed; runs locally
- Tags
- evaluation, prompt-testing, red-teaming, ci-cd, open-source
- Added
- 2026-03-17
- Completeness
- 100%
Index Score
53Adoption
58
Quality
84
Freshness
92
Citations
52
Engagement
0