electblake
fix: run GGUF quants directly with llama.cpp
604e6eb
|
Raw
History Blame Contribute Delete
1.02 kB
---
title: Spreadsheet Data Agent
emoji: ๐Ÿ“Š
colorFrom: blue
colorTo: pink
sdk: gradio
sdk_version: 6.17.3
python_version: '3.12.12'
app_file: app.py
pinned: false
license: apache-2.0
preload_from_hub:
- mradermacher/Spreadsheet-RL-4B-GGUF Spreadsheet-RL-4B.Q4_K_M.gguf
models:
- Spreadsheet-RL/Spreadsheet-RL-4B
- mradermacher/Spreadsheet-RL-4B-GGUF
---
# Spreadsheet Data Agent
A basic text-and-file inference app for Spreadsheet-RL-4B, modeled on the prompt entry point in the Spreadsheet-RL agent-system diagram.
The app accepts a system prompt, user prompt, and optional text or spreadsheet file. Its quantization selector exposes the 4B GGUF variants captured in the project reference material, with Q4_K_M selected by default. Inference runs directly on the selected quantized tensors through llama.cpp without converting them into full PyTorch weights.
ZeroGPU support is enabled with the `spaces` package and `@spaces.GPU`. Select ZeroGPU in the Hugging Face Space hardware settings after deployment.