Instructions to use facebook/MobileLLM-R1-140M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use facebook/MobileLLM-R1-140M with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("facebook/MobileLLM-R1-140M", dtype="auto") - Notebooks
- Google Colab
- Kaggle
ONNX on mobile
#1
by DarrenChen - opened
Can I convert this series of mobileLLM-R1 models to the ONNX format for deployment on mobile phones? Of course, if there are more recommended official methods for deploying and integrating on mobile devices, please share them.