CompactAI's picture
Upload folder using huggingface_hub
11a9df8 verified
metadata
license: apache-2.0
tags:
  - pruned
  - python
  - optimized
  - wanda
base_model: tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct
pipeline_tag: text-generation

Falcon-H1-Tiny-Multilingual-100M-Instruct-python-safe

🎯 PYTHON-optimized | πŸ“¦ Safe pruning | ⚑ 1% weights pruned

This model is a conservatively pruned version of tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct.

Performance Comparison

Category Original Pruned Change
Python 0.0% 0.0% ⭐ β†’
Html 0.0% 0.0% β†’
Trivia 16.7% 16.7% β†’
Math 0.0% 0.0% β†’
Reasoning 0.0% 0.0% β†’
Medical 33.3% 33.3% β†’
Linux 0.0% 0.0% β†’
Writing 0.0% 0.0% β†’

Average: 6.2% β†’ 6.2% (+0.0%)

Comparison Graph

Quick Start

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("CompactAI/Falcon-H1-Tiny-Multilingual-100M-Instruct-python-safe")
tokenizer = AutoTokenizer.from_pretrained("CompactAI/Falcon-H1-Tiny-Multilingual-100M-Instruct-python-safe")

inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Technical Details

Property Value
Base Model tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct
Specialization Python
Prune Mode Safe
Weight Reduction 1% weights pruned

License

This model inherits the license from the base model.