quant-playground / README.md
3morixd's picture
Upload README.md with huggingface_hub
c0b2015 verified
|
Raw
History Blame Contribute Delete
851 Bytes
---
title: Quant Playground
emoji: 🎯
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: "4.44.0"
app_file: app.py
pinned: false
license: apache-2.0
tags:
- quantization
- comparison
- mobile
- benchmark
- gguf
- dispatchai
---
# 🎯 dispatchAI Quantization Playground
Compare GGUF quantization levels side-by-side. See exactly how much size, speed, and quality you trade off at each quant level.
## Features
- **Side-by-side comparison**: Size, speed, quality, and RAM for every quant level
- **Sample output comparison**: See actual text quality differences between quants
- **Phone RAM recommender**: Input your phone's RAM, get the best model+quant combo
- **Real hardware data**: All benchmarks from Snapdragon 865 (Samsung S20 FE)
πŸš€ [dispatchAI](https://huggingface.co/dispatchAI) β€” Small. Mobile. Free. UAE-built.