Model Quantization
by AaaS · open-source · Last verified 2026-03-01
Reduces model size and inference cost by converting weights from higher to lower precision (FP16 to INT8/INT4). Covers GPTQ, AWQ, GGUF, and bitsandbytes quantization methods with quality-preservation techniques that minimize accuracy degradation.
https://aaas.blog/skill/model-quantization ↗C
C—Below Average
Adoption: C+Quality: AFreshness: ACitations: FEngagement: F
Specifications
- License
- MIT
- Pricing
- open-source
- Capabilities
- weight-quantization, calibration, quality-evaluation, format-conversion, memory-optimization
- Integrations
- auto-gptq, bitsandbytes, llama-cpp, transformers
- Use Cases
- cost-reduction, edge-deployment, consumer-gpu-inference, mobile-deployment
- API Available
- No
- Difficulty
- advanced
- Prerequisites
- fine-tuning
- Supported Agents
- Tags
- quantization, optimization, compression, efficiency, inference
- Added
- 2026-03-17
- Completeness
- 87%
Index Score
40Adoption
58
Quality
80
Freshness
82
Citations
2
Engagement
0