dawidope commited on
Commit
2c5249c
·
verified ·
1 Parent(s): 1edceb8

README: add ISK 0.3.0 + sageattention mirror, list the wheels that were missing

Browse files
Files changed (1) hide show
  1. README.md +34 -2
README.md CHANGED
@@ -17,8 +17,13 @@ Prebuilt Python 3.11 wheels.
17
  | File | OS | CUDA | Torch | Source | Notes |
18
  |---|---|---|---|---|---|
19
  | `ace_step-1.6.0-py3-none-any.whl` | any | — | — | built by us | Pure-Python, cross-platform |
 
 
20
  | `block_sparse_attn-0.0.2-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | Used by video pipeline |
 
21
  | `q8_kernels-0.0.5-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | Used by LTX video |
 
 
22
  | `flash_attn-2.8.2+cu128torch2.8-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels/releases/tag/v0.4.10) | Mirror of upstream release |
23
  | `flash_attn-2.8.3+cu130torch2.10-cp311-cp311-win_amd64.whl` | Windows x64 | 13.0 | 2.10 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels) | Mirror of upstream release |
24
  | `flash_attn-2.8.3+cu128torch2.8-cp311-cp311-linux_x86_64.whl` | Linux x86_64 | 12.8 | 2.8 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels/releases/tag/v0.7.16) | Mirror of upstream release |
@@ -29,17 +34,44 @@ Prebuilt Python 3.11 wheels.
29
  BASE=https://huggingface.co/deAPI-ai/image-server-wheels/resolve/main
30
 
31
  # Windows
 
32
  pip install $BASE/q8_kernels-0.0.5-cp311-cp311-win_amd64.whl
33
  pip install $BASE/block_sparse_attn-0.0.2-cp311-cp311-win_amd64.whl
34
  pip install $BASE/flash_attn-2.8.2+cu128torch2.8-cp311-cp311-win_amd64.whl
 
35
  pip install --no-deps $BASE/ace_step-1.6.0-py3-none-any.whl
 
36
 
37
  # Linux
 
 
38
  pip install --no-deps $BASE/flash_attn-2.8.3+cu128torch2.8-cp311-cp311-linux_x86_64.whl
39
  ```
40
 
 
 
 
 
 
 
 
41
  ## Credits
42
 
43
- `flash_attn` wheels are mirrored from [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels) — all credit for those builds goes to the upstream author. We mirror them here so the install scripts have a single source of truth and do not break if upstream release URLs change.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
 
45
- The remaining wheels (`ace_step`, `block_sparse_attn`, `q8_kernels`) were built in-house.
 
 
17
  | File | OS | CUDA | Torch | Source | Notes |
18
  |---|---|---|---|---|---|
19
  | `ace_step-1.6.0-py3-none-any.whl` | any | — | — | built by us | Pure-Python, cross-platform |
20
+ | `qwen_tts-0.1.1+deapi3-py3-none-any.whl` | any | — | — | built by us | Pure-Python, patched fork (`+deapi3`) |
21
+ | `image_server_kernels-0.3.0-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | FP8 dense + grouped GEMM, NVFP4 W4A4, INT8 W8A8 + ConvRot, fused QK-norm+RoPE. SM89 + SM120 |
22
  | `block_sparse_attn-0.0.2-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | Used by video pipeline |
23
+ | `block_sparse_attn-0.0.2-cp311-cp311-linux_x86_64.whl` | Linux x86_64 | 12.8 | 2.8 | built by us | Used by video pipeline |
24
  | `q8_kernels-0.0.5-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | built by us | Used by LTX video |
25
+ | `q8_kernels-0.0.5-cp311-cp311-linux_x86_64.whl` | Linux x86_64 | 12.8 | 2.8 | built by us | Used by LTX video |
26
+ | `sageattention-2.2.0+cu128torch2.8.0-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | [woct0rdho/SageAttention](https://github.com/woct0rdho/SageAttention/releases/tag/v2.2.0-windows) | Mirror of upstream release |
27
  | `flash_attn-2.8.2+cu128torch2.8-cp311-cp311-win_amd64.whl` | Windows x64 | 12.8 | 2.8 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels/releases/tag/v0.4.10) | Mirror of upstream release |
28
  | `flash_attn-2.8.3+cu130torch2.10-cp311-cp311-win_amd64.whl` | Windows x64 | 13.0 | 2.10 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels) | Mirror of upstream release |
29
  | `flash_attn-2.8.3+cu128torch2.8-cp311-cp311-linux_x86_64.whl` | Linux x86_64 | 12.8 | 2.8 | [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels/releases/tag/v0.7.16) | Mirror of upstream release |
 
34
  BASE=https://huggingface.co/deAPI-ai/image-server-wheels/resolve/main
35
 
36
  # Windows
37
+ pip install $BASE/image_server_kernels-0.3.0-cp311-cp311-win_amd64.whl
38
  pip install $BASE/q8_kernels-0.0.5-cp311-cp311-win_amd64.whl
39
  pip install $BASE/block_sparse_attn-0.0.2-cp311-cp311-win_amd64.whl
40
  pip install $BASE/flash_attn-2.8.2+cu128torch2.8-cp311-cp311-win_amd64.whl
41
+ pip install $BASE/sageattention-2.2.0+cu128torch2.8.0-cp311-cp311-win_amd64.whl
42
  pip install --no-deps $BASE/ace_step-1.6.0-py3-none-any.whl
43
+ pip install --no-deps $BASE/qwen_tts-0.1.1+deapi3-py3-none-any.whl
44
 
45
  # Linux
46
+ pip install $BASE/q8_kernels-0.0.5-cp311-cp311-linux_x86_64.whl
47
+ pip install $BASE/block_sparse_attn-0.0.2-cp311-cp311-linux_x86_64.whl
48
  pip install --no-deps $BASE/flash_attn-2.8.3+cu128torch2.8-cp311-cp311-linux_x86_64.whl
49
  ```
50
 
51
+ `sageattention` is required by the MiniMax-H3 video model, which imports it
52
+ unconditionally. Every other model that can use it falls back to SDPA when it is
53
+ absent, so on a box that does not serve H3 the wheel is optional.
54
+
55
+ > Wheels are Windows-only unless a `linux_x86_64` row exists above. There is
56
+ > currently no Linux build of `image_server_kernels` or `sageattention` here.
57
+
58
  ## Credits
59
 
60
+ `flash_attn` wheels are mirrored from
61
+ [mjun0812/flash-attention-prebuild-wheels](https://github.com/mjun0812/flash-attention-prebuild-wheels)
62
+ — all credit for those builds goes to the upstream author.
63
+
64
+ `sageattention` is **a mirror, not our build**. The library is
65
+ [thu-ml/SageAttention](https://github.com/thu-ml/SageAttention) (Apache-2.0); the
66
+ Windows wheel is built and published by
67
+ [woct0rdho](https://github.com/woct0rdho/SageAttention/releases), and we found it
68
+ through [wildminder/AI-windows-whl](https://github.com/wildminder/AI-windows-whl),
69
+ which indexes Windows CUDA wheels. All credit for the library and the build goes to
70
+ them. The file here is byte-identical to the upstream release
71
+ (`sha256:4379951403809dfcd5b1e10d35e287abf42afafb7b27615c09d6062cfbdf230a`).
72
+
73
+ We mirror third-party wheels so the install scripts have a single source of truth and
74
+ do not break if upstream release URLs change.
75
 
76
+ The remaining wheels (`ace_step`, `qwen_tts`, `image_server_kernels`,
77
+ `block_sparse_attn`, `q8_kernels`) were built in-house.