quant-playground / README.md
3morixd's picture
Upload README.md with huggingface_hub
c0b2015 verified
|
Raw
History Blame Contribute Delete
851 Bytes

A newer version of the Gradio SDK is available: 6.19.0

Upgrade
metadata
title: Quant Playground
emoji: 🎯
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 4.44.0
app_file: app.py
pinned: false
license: apache-2.0
tags:
  - quantization
  - comparison
  - mobile
  - benchmark
  - gguf
  - dispatchai

🎯 dispatchAI Quantization Playground

Compare GGUF quantization levels side-by-side. See exactly how much size, speed, and quality you trade off at each quant level.

Features

  • Side-by-side comparison: Size, speed, quality, and RAM for every quant level
  • Sample output comparison: See actual text quality differences between quants
  • Phone RAM recommender: Input your phone's RAM, get the best model+quant combo
  • Real hardware data: All benchmarks from Snapdragon 865 (Samsung S20 FE)

πŸš€ dispatchAI β€” Small. Mobile. Free. UAE-built.