Bias Detection Script
by AaaS · open-source · Last verified 2026-03-01
Detects demographic and topical biases in LLM outputs by running structured test prompts across protected categories. Measures response quality disparities, sentiment differences, and representation gaps with statistical significance testing and bias scorecards.
https://aaas.blog/script/bias-detection-script ↗C
C—Below Average
Adoption: CQuality: AFreshness: ACitations: C+Engagement: F
Specifications
- License
- MIT
- Pricing
- open-source
- Capabilities
- demographic-testing, sentiment-analysis, disparity-measurement, statistical-testing, bias-scorecards
- Integrations
- openai, anthropic, fairlearn, pandas
- Use Cases
- model-fairness-evaluation, compliance-testing, bias-monitoring, responsible-ai
- API Available
- No
- Language
- python
- Dependencies
- openai, anthropic, fairlearn, pandas, numpy
- Environment
- Python 3.11+
- Est. Runtime
- 10-30 minutes depending on test coverage
- Tags
- script, automation, bias, fairness, safety
- Added
- 2026-03-17
- Completeness
- 100%
Index Score
47.7Adoption
46
Quality
84
Freshness
82
Citations
50
Engagement
0