Aider Polyglot
by Aider · open-source · Last verified 2026-03-01
Multi-language code editing benchmark testing models' ability to make targeted code changes across Python, JavaScript, TypeScript, Java, C++, and other languages. Evaluates real-world code modification tasks rather than generation from scratch.
https://aider.chat/docs/leaderboards/ ↗C+
C+—Average
Adoption: BQuality: AFreshness: ACitations: BEngagement: F
Specifications
- License
- Apache-2.0
- Pricing
- open-source
- Capabilities
- model-evaluation, code-editing-testing, multi-language-assessment
- Integrations
- aider
- Use Cases
- code-editing-evaluation, multi-language-comparison, real-world-coding-assessment
- API Available
- No
- Evaluated Models
- claude-4, gpt-5, gemini-2.5-pro, deepseek-v3, qwen-3-72b
- Metrics
- pass-rate, edit-accuracy
- Methodology
- Code editing tasks across multiple programming languages. Models receive existing code and instructions for modifications, evaluated by test execution.
- Last Run
- 2026-03-10
- Tags
- benchmark, evaluation, coding, polyglot, multi-language
- Added
- 2026-03-17
- Completeness
- 100%
Index Score
58.2Adoption
66
Quality
84
Freshness
88
Citations
60
Engagement
0