LMSYS
by LMSYS / UC Berkeley · open-source · Last verified 2026-03-17
LMSYS (Large Model Systems Organization) is a research collective from UC Berkeley known for creating Chatbot Arena—the leading human preference-based LLM evaluation leaderboard—and developing high-performance open-source inference systems including vLLM and FastChat. LMSYS research on Elo-based evaluation and serving efficiency has become foundational to the field.
https://lmsys.org ↗B
B—Above Average
Adoption: B+Quality: AFreshness: B+Citations: A+Engagement: F
Specifications
- License
- Apache-2.0
- Pricing
- open-source
- Capabilities
- llm-evaluation, inference-optimization, benchmarking, open-research
- Integrations
- hugging-face
- Use Cases
- research, benchmarking, model-serving, open-llm-development
- API Available
- No
- Tags
- open-source, benchmarking, research, llm, academic
- Added
- 2026-03-17
- Completeness
- 100%
Index Score
68.6Adoption
70
Quality
88
Freshness
78
Citations
92
Engagement
0
Put AI to work for your business
Deploy this provider alongside autonomous AaaS agents that handle tasks end-to-end — no babysitting required.