YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Language Specific Neuron SLA
This is done specifically for the Qwen2.5 family of models
Guide
- Run
load_data.pyto fetch data from https://huggingface.co/datasets/wikimedia/wikipedia/viewer/20231101 - Calculate the activation from the fetched data with
activation.py - Identify language specific neurons with
identify.py
Ref
Note taking
python3 load_data_oscar.py --languages en,zh,eu,ga --model-id qwen2.5 --tokenizer Qwen/Qwen2.5-0.5B
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support