Text Generation
Transformers
Safetensors
t5
text2text-generation
biology
single-cell
single-cell analysis
text-generation-inference
Instructions to use zjunlp/chatcell-small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zjunlp/chatcell-small with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="zjunlp/chatcell-small")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("zjunlp/chatcell-small") model = AutoModelForSeq2SeqLM.from_pretrained("zjunlp/chatcell-small") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use zjunlp/chatcell-small with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "zjunlp/chatcell-small" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "zjunlp/chatcell-small", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/zjunlp/chatcell-small
- SGLang
How to use zjunlp/chatcell-small with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "zjunlp/chatcell-small" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "zjunlp/chatcell-small", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "zjunlp/chatcell-small" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "zjunlp/chatcell-small", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use zjunlp/chatcell-small with Docker Model Runner:
docker model run hf.co/zjunlp/chatcell-small
Commit History
Update README.md e34a592 verified
Update README.md fec6b06 verified
Update README.md 3877fb2 verified
Update README.md 7a89d27 verified
Update README.md f8bbb76 verified
Update README.md a5a9037 verified
Update README.md aaa034a verified
Update README.md 9db3531 verified
Yin Fang commited on
Update README.md 1dc4c45 verified
Yin Fang commited on
Update handler.py 8f6a7e9 verified
Update handler.py 2e98537 verified
Update handler.py 930f282 verified
Update handler.py 6bfc699 verified
Update handler.py abfdef5 verified
Upload handler.py 71a9ba7 verified
Update README.md 6a250b3 verified
Delete rng_state.pth 1dc17fb verified
Yin Fang commited on
Delete optimizer.pt dc80070 verified
Yin Fang commited on
Delete scheduler.pt 654ac3a verified
Yin Fang commited on
Delete trainer_state.json 11bc24a verified
Yin Fang commited on
Delete training_args.bin 28ed5a6 verified
Yin Fang commited on
Update README.md d891f14 verified
Yin Fang commited on
Update README.md a2bb4a0 verified
Yin Fang commited on
Update README.md 5beaa18 verified
Yin Fang commited on
Update README.md 66c0768 verified
Yin Fang commited on
Update README.md 32696c9 verified
Yin Fang commited on
Update README.md c2a1ae4 verified
Yin Fang commited on
Upload 7 files 0a3b951 verified
Yin Fang commited on
Delete figures 9420250 verified
Yin Fang commited on
Create README.md 836a12a verified
Yin Fang commited on
Upload 7 files 0fc24a7 verified
Yin Fang commited on