LMSYS
by LMSYS / UC Berkeley · open-source · Last verified 2026-03-17
LMSYS (Large Model Systems Organization) is a research collective from UC Berkeley known for creating Chatbot Arena—the leading human preference-based LLM evaluation leaderboard—and developing high-performance open-source inference systems including vLLM and FastChat. LMSYS research on Elo-based evaluation and serving efficiency has become foundational to the field.
https://lmsys.org ↗C
C—Below Average
Adoption: B+Quality: AFreshness: B+Citations: FEngagement: F
Specifications
- License
- Apache-2.0
- Pricing
- open-source
- Capabilities
- llm-evaluation, inference-optimization, benchmarking, open-research
- Integrations
- hugging-face
- Use Cases
- research, benchmarking, model-serving, open-llm-development
- API Available
- No
- Tags
- open-source, benchmarking, research, llm, academic
- Added
- 2026-03-17
- Completeness
- 100%
Index Score
46Adoption
70
Quality
88
Freshness
78
Citations
0
Engagement
0