Prompt Testing Suite
by AaaS · open-source · Last verified 2026-03-01
Automated testing framework for prompt engineering with test case management, assertion-based evaluation, regression detection, and A/B comparison. Validates prompt outputs against expected patterns, formats, and quality criteria with CI/CD integration.
https://aaas.blog/script/prompt-testing-suite ↗C+
C+—Average
Adoption: C+Quality: AFreshness: ACitations: CEngagement: F
Specifications
- License
- MIT
- Pricing
- open-source
- Capabilities
- test-case-management, assertion-evaluation, regression-detection, ab-comparison, ci-cd-integration
- Integrations
- vitest, @anthropic-ai/sdk, openai, zod
- Use Cases
- prompt-quality-assurance, regression-testing, prompt-optimization, ci-cd-validation
- API Available
- No
- Language
- typescript
- Dependencies
- vitest, @anthropic-ai/sdk, openai, zod, chalk
- Environment
- Node.js 20+
- Est. Runtime
- 3-15 minutes depending on test count
- Tags
- script, automation, prompt-testing, evaluation, quality
- Added
- 2026-03-17
- Completeness
- 100%
Index Score
50.8Adoption
56
Quality
82
Freshness
84
Citations
48
Engagement
0