Kernels:

---

kernels-community

/

rotary

Like 0

Follow

kernels-community 483

Trusted publisher

These rotary kernels are based on the old CUDA implementations in the FlashAttention repository. These kernels are no longer maintained upstream.

This is the repository card of kernels-community/rotary that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.

How to use

# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel

kernel_module = get_kernel("kernels-community/rotary", version=2)
apply_rotary = kernel_module.apply_rotary

apply_rotary(...)

Available functions

• apply_rotary
• apply_rotary_transformers

Available layers

• apply_rotary_transformers

Benchmarks

Benchmarking script is available for this kernel. Run kernels benchmark kernels-community/rotary --version 2.