When Attention Goes Blind: Numerical Failure in ALiBi Positional Encodings Paper • 2608.03994 • Published 12 days ago • 8
Obfuscated ModernBERT Collection Models pretrained on various obfuscated versions of the same dataset to analyse how the obfuscation affects downstream performance. • 13 items • Updated 19 days ago