Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
OpenTransformer
/
llama.cpp-prismml
like
0
arxiv:
2302.13971
arxiv:
2005.14165
arxiv:
2203.02155
Model card
Files
Files and versions
xet
Community
main
llama.cpp-prismml
/
examples
/
batched.swift
/
README.md
OpenTransformer
Q1_0_g128 CPU kernel fix + AVX2 SIMD (fork of PrismML-Eng/llama.cpp)
03ba2cd
verified
about 1 month ago
preview
code
|
raw
Copy download link
history
blame
contribute
delete
113 Bytes
This is a swift clone of
`examples/batched`
.
```bash
$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]
```