Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
openbmb
/
MiniCPM3-4B
like
419
Follow
OpenBMB
2.98k
Text Generation
Transformers
PyTorch
Chinese
English
minicpm3
conversational
custom_code
arxiv:
2404.06395
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
44
Deploy
Use this model
如何进行batch inference？
#19
by
Rebelliousgang
- opened
Sep 14, 2024
Discussion
Rebelliousgang
Sep 14, 2024
如何进行batch inference？
neoz
OpenBMB org
Sep 18, 2024
vLLM 和 SGLang 等推理框架都默认支持batch inference。
See translation
neoz
changed discussion status to
closed
Sep 18, 2024
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
