README: add ISK 0.3.0 + sageattention mirror, list the wheels that were missing
Browse files
README.md
CHANGED
|
@@ -17,8 +17,13 @@ Prebuilt Python 3.11 wheels.
|
|
| 17 |
| File | OS | CUDA | Torch | Source | Notes |
|
| 18 |
|---|---|---|---|---|---|
|
| 19 |
| `ace_step-1.6.0-py3-none-any.whl` | any | — | — | built by us | Pure-Python, cross-platform |
|
|
|
|
|
|
|
| 20 |
| `block_sparse_attn-0.0.2-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | Used by video pipeline |
|
|
|
|
| 21 |
| `q8_kernels-0.0.5-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | Used by LTX video |
|
|
|
|
|
|
|
| 22 |
| `flash_attn-2.8.2+cu128torch2.8-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels/releases/tag/v0.4.10) | Mirror of upstream release |
|
| 23 |
| `flash_attn-2.8.3+cu130torch2.10-cp311-cp311-win_amd64.whl` | Windows x64 | 13.0 | 2.10 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels) | Mirror of upstream release |
|
| 24 |
| `flash_attn-2.8.3+cu128torch2.8-cp311-cp311-linux_x86_64.whl` | Linux x86_64 | 12.8 | 2.8 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels/releases/tag/v0.7.16) | Mirror of upstream release |
|
|
@@ -29,17 +34,44 @@ Prebuilt Python 3.11 wheels.
|
|
| 29 |
BASE=https://huggingface.co/deAPI-ai/image-server-wheels/resolve/main
|
| 30 |
|
| 31 |
# Windows
|
|
|
|
| 32 |
pip install $BASE/q8_kernels-0.0.5-cp311-cp311-win_amd64.whl
|
| 33 |
pip install $BASE/block_sparse_attn-0.0.2-cp311-cp311-win_amd64.whl
|
| 34 |
pip install $BASE/flash_attn-2.8.2+cu128torch2.8-cp311-cp311-win_amd64.whl
|
|
|
|
| 35 |
pip install --no-deps $BASE/ace_step-1.6.0-py3-none-any.whl
|
|
|
|
| 36 |
|
| 37 |
# Linux
|
|
|
|
|
|
|
| 38 |
pip install --no-deps $BASE/flash_attn-2.8.3+cu128torch2.8-cp311-cp311-linux_x86_64.whl
|
| 39 |
```
|
| 40 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
## Credits
|
| 42 |
|
| 43 |
-
`flash_attn` wheels are mirrored from
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
|
| 45 |
-
The remaining wheels (`ace_step`, `
|
|
|
|
|
|
| 17 |
| File | OS | CUDA | Torch | Source | Notes |
|
| 18 |
|---|---|---|---|---|---|
|
| 19 |
| `ace_step-1.6.0-py3-none-any.whl` | any | — | — | built by us | Pure-Python, cross-platform |
|
| 20 |
+
| `qwen_tts-0.1.1+deapi3-py3-none-any.whl` | any | — | — | built by us | Pure-Python, patched fork (`+deapi3`) |
|
| 21 |
+
| `image_server_kernels-0.3.0-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | FP8 dense + grouped GEMM, NVFP4 W4A4, INT8 W8A8 + ConvRot, fused QK-norm+RoPE. SM89 + SM120 |
|
| 22 |
| `block_sparse_attn-0.0.2-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | Used by video pipeline |
|
| 23 |
+
| `block_sparse_attn-0.0.2-cp311-cp311-linux_x86_64.whl` | Linux x86_64 | 12.8 | 2.8 | built by us | Used by video pipeline |
|
| 24 |
| `q8_kernels-0.0.5-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | Used by LTX video |
|
| 25 |
+
| `q8_kernels-0.0.5-cp311-cp311-linux_x86_64.whl` | Linux x86_64 | 12.8 | 2.8 | built by us | Used by LTX video |
|
| 26 |
+
| `sageattention-2.2.0+cu128torch2.8.0-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | [woct0rdho/SageAttention](https://github.com/woct0rdho/SageAttention/releases/tag/v2.2.0-windows) | Mirror of upstream release |
|
| 27 |
| `flash_attn-2.8.2+cu128torch2.8-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels/releases/tag/v0.4.10) | Mirror of upstream release |
|
| 28 |
| `flash_attn-2.8.3+cu130torch2.10-cp311-cp311-win_amd64.whl` | Windows x64 | 13.0 | 2.10 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels) | Mirror of upstream release |
|
| 29 |
| `flash_attn-2.8.3+cu128torch2.8-cp311-cp311-linux_x86_64.whl` | Linux x86_64 | 12.8 | 2.8 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels/releases/tag/v0.7.16) | Mirror of upstream release |
|
|
|
|
| 34 |
BASE=https://huggingface.co/deAPI-ai/image-server-wheels/resolve/main
|
| 35 |
|
| 36 |
# Windows
|
| 37 |
+
pip install $BASE/image_server_kernels-0.3.0-cp311-cp311-win_amd64.whl
|
| 38 |
pip install $BASE/q8_kernels-0.0.5-cp311-cp311-win_amd64.whl
|
| 39 |
pip install $BASE/block_sparse_attn-0.0.2-cp311-cp311-win_amd64.whl
|
| 40 |
pip install $BASE/flash_attn-2.8.2+cu128torch2.8-cp311-cp311-win_amd64.whl
|
| 41 |
+
pip install $BASE/sageattention-2.2.0+cu128torch2.8.0-cp311-cp311-win_amd64.whl
|
| 42 |
pip install --no-deps $BASE/ace_step-1.6.0-py3-none-any.whl
|
| 43 |
+
pip install --no-deps $BASE/qwen_tts-0.1.1+deapi3-py3-none-any.whl
|
| 44 |
|
| 45 |
# Linux
|
| 46 |
+
pip install $BASE/q8_kernels-0.0.5-cp311-cp311-linux_x86_64.whl
|
| 47 |
+
pip install $BASE/block_sparse_attn-0.0.2-cp311-cp311-linux_x86_64.whl
|
| 48 |
pip install --no-deps $BASE/flash_attn-2.8.3+cu128torch2.8-cp311-cp311-linux_x86_64.whl
|
| 49 |
```
|
| 50 |
|
| 51 |
+
`sageattention` is required by the MiniMax-H3 video model, which imports it
|
| 52 |
+
unconditionally. Every other model that can use it falls back to SDPA when it is
|
| 53 |
+
absent, so on a box that does not serve H3 the wheel is optional.
|
| 54 |
+
|
| 55 |
+
> Wheels are Windows-only unless a `linux_x86_64` row exists above. There is
|
| 56 |
+
> currently no Linux build of `image_server_kernels` or `sageattention` here.
|
| 57 |
+
|
| 58 |
## Credits
|
| 59 |
|
| 60 |
+
`flash_attn` wheels are mirrored from
|
| 61 |
+
[mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels)
|
| 62 |
+
— all credit for those builds goes to the upstream author.
|
| 63 |
+
|
| 64 |
+
`sageattention` is **a mirror, not our build**. The library is
|
| 65 |
+
[thu-ml/SageAttention](https://github.com/thu-ml/SageAttention) (Apache-2.0); the
|
| 66 |
+
Windows wheel is built and published by
|
| 67 |
+
[woct0rdho](https://github.com/woct0rdho/SageAttention/releases), and we found it
|
| 68 |
+
through [wildminder/AI-windows-whl](https://github.com/wildminder/AI-windows-whl),
|
| 69 |
+
which indexes Windows CUDA wheels. All credit for the library and the build goes to
|
| 70 |
+
them. The file here is byte-identical to the upstream release
|
| 71 |
+
(`sha256:4379951403809dfcd5b1e10d35e287abf42afafb7b27615c09d6062cfbdf230a`).
|
| 72 |
+
|
| 73 |
+
We mirror third-party wheels so the install scripts have a single source of truth and
|
| 74 |
+
do not break if upstream release URLs change.
|
| 75 |
|
| 76 |
+
The remaining wheels (`ace_step`, `qwen_tts`, `image_server_kernels`,
|
| 77 |
+
`block_sparse_attn`, `q8_kernels`) were built in-house.
|