Migrating to new kernel repo type
Hello there 👋
We're in the process of migrating the kernels to a new repo type "kernel", which will provide better integration support from the rest of the Hugging Face Hub ecosystem. Here is an example kernel page: https://huggingface.co/kernels/sgl-project/sgl-flash-attn3. This kernel has the "model" repo type, hence, we're reaching out.
Support for this new repo type has been shipped to the kernels library and we have dropped support for loading the kernels with the "model" repo type in our latest release. Users, however, will be able to use this repo but with an older version of kernels.
To help you through this migration, we have prepared the following steps:
- Please request access to the "kernel" repo type for your username/org (Settings -> Account)
- Rebuild your library with the latest kernels version
- Use the migration tool https://github.com/huggingface/migrate-to-kernel-repo-tool or hugging face cli to create a new kernel repo and upload to the new repo type
- Ensure downstream users are using v0.14.0 (in pre release) at the moment
uv add --reinstall --pre kernelsto use the new repo type
Let us know if you have any questions or need further assistance! Thank you for being a early user of the kernels library! 🤗
Some additions to this, we plan to release kernels 0.14.0 this week. In addition to only supporting the new kernel repo type, there are two other major changes that affect kernels:
- Kernel metadata (
metadata.json) is mandatory now, along with some metadata fields: https://huggingface.co/docs/kernels/main/en/kernel-requirements#kernel-metadata The metadata is automatically generated when building a kernel with the kernel-buildermainbranch. kernels0.14.0 will not trust non-HF kernel repositories by default, similar to how transformers does not execute remote code. Users will still be able to load kernels from arbitrary repositories by passingtrust_remote_code=True. In the future we are planning to make this more fine-grained, by allowing users to opt-in to additional signing identities (once kernel signing is supported).