How to use PrunaAI/katanemo-Arch-Router-1.5B-HQQ-8bit-smashed with Pruna AI:
from pruna import PrunaModel model = PrunaModel.from_pretrained("PrunaAI/katanemo-Arch-Router-1.5B-HQQ-8bit-smashed")