CompactAI's picture
Upload folder using huggingface_hub
c604ca1 verified
metadata
license: apache-2.0
tags:
  - pruned
  - python
  - optimized
  - wanda
base_model: LiquidAI/LFM2.5-1.2B-Instruct
pipeline_tag: text-generation

LFM2.5-1.2B-Instruct-python-safe

🎯 PYTHON-optimized | πŸ“¦ Safe pruning | ⚑ 1% weights pruned

This model is a conservatively pruned version of LiquidAI/LFM2.5-1.2B-Instruct.

Performance Comparison

Category Original Pruned Change
Python 50.0% 50.0% ⭐ β†’
Html 83.3% 83.3% β†’
Trivia 91.7% 91.7% β†’
Math 100.0% 100.0% β†’
Reasoning 66.7% 66.7% β†’
Medical 75.0% 66.7% ↓ 8.3%
Linux 16.7% 16.7% β†’
Writing 33.3% 33.3% β†’

Average: 64.6% β†’ 63.5% (-1.0%)

Python Retention: 100.0%

Comparison Graph

Quick Start

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("CompactAI/LFM2.5-1.2B-Instruct-python-safe")
tokenizer = AutoTokenizer.from_pretrained("CompactAI/LFM2.5-1.2B-Instruct-python-safe")

inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Technical Details

Property Value
Base Model LiquidAI/LFM2.5-1.2B-Instruct
Specialization Python
Prune Mode Safe
Weight Reduction 1% weights pruned

License

This model inherits the license from the base model.