File size: 677 Bytes
56bca05
 
5d26454
56bca05
9c01195
72da31c
 
 
9c01195
 
 
 
854c683
1
2
3
4
5
6
7
8
9
10
11
12
13
---
tags:
- kernels
---

> [!CAUTION]
> Starting from September 13, 2026, we will be removing the "model" type repositories of kernels (e.g., kernels-community/flash-attn3). Make sure you're using a latest version of kernels. If you face any disruption, please report them here: https://github.com/huggingface/kernels/issues/new.

> [!WARNING]
> This repository will soon be deleted as it's now deprecated. Please use [kernels-community/layer-norm](https://huggingface.co/kernels-community/layer-norm).


This CUDA extension implements fused dropout + residual + LayerNorm from the [flash-attention](https://github.com/Dao-AILab/flash-attention/tree/main/csrc/layer_norm) repo.